Nov 06 15:12:02 devstack cinder-volume[76052]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 06 15:12:02 devstack cinder-volume[76052]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 06 15:12:02 devstack cinder-volume[76052]: we strongly recommend against using it for new projects. Nov 06 15:12:02 devstack cinder-volume[76052]: If you are already using Eventlet, we recommend migrating to a different Nov 06 15:12:02 devstack cinder-volume[76052]: framework. For more detail see Nov 06 15:12:02 devstack cinder-volume[76052]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 06 15:12:02 devstack cinder-volume[76052]: import eventlet # noqa Nov 06 15:12:04 devstack cinder-volume[76052]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76052) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 06 15:12:04 devstack cinder-volume[76052]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76052) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 06 15:12:04 devstack cinder-volume[76052]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76052) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 06 15:12:05 devstack cinder-volume[76052]: INFO dbcounter [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] Registered counter for database cinder Nov 06 15:12:05 devstack cinder-volume[76052]: DEBUG oslo_db.sqlalchemy.engines [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76052) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 06 15:12:06 devstack cinder-volume[76052]: DEBUG dbcounter [-] [76052] Writer thread running {{(pid=76052) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 06 15:12:06 devstack cinder-volume[76052]: INFO cinder.rpc [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 06 15:12:06 devstack cinder-volume[76052]: INFO cinder.rpc [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 06 15:12:06 devstack cinder-volume[76052]: DEBUG oslo_db.sqlalchemy.engines [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76052) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 06 15:12:06 devstack cinder-volume[76052]: INFO cinder.volume.manager [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] Determined volume DB was empty at startup. Nov 06 15:12:06 devstack cinder-volume[76052]: DEBUG cinder.volume.manager [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76052) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 06 15:12:06 devstack cinder-volume[76052]: INFO cinder.volume.manager [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] Service not found for updating active_backend_id, assuming default for driver init. Nov 06 15:12:06 devstack cinder-volume[76052]: WARNING stevedore.named [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 15:12:06 devstack cinder-volume[76052]: WARNING castellan.key_manager [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 15:12:06 devstack cinder-volume[76052]: WARNING cinder.keymgr.conf_key_mgr [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 15:12:06 devstack cinder-volume[76052]: DEBUG cinder.volume.drivers.lvm [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76052) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Nov 06 15:12:06 devstack cinder-volume[76052]: DEBUG oslo_concurrency.processutils [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76052) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:12:06 devstack cinder-volume[76052]: DEBUG oslo_concurrency.processutils [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] CMD "cinder-rtstool verify" returned: 0 in 0.543s {{(pid=76052) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:12:06 devstack cinder-volume[76052]: DEBUG oslo_db.sqlalchemy.engines [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76052) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 06 15:12:06 devstack cinder-volume[76052]: INFO cinder.rpc [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Nov 06 15:12:06 devstack cinder-volume[76052]: INFO cinder.rpc [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Nov 06 15:12:06 devstack cinder-volume[76052]: WARNING stevedore.named [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 15:12:06 devstack cinder-volume[76052]: WARNING castellan.key_manager [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 15:12:06 devstack cinder-volume[76052]: INFO cinder.volume.manager [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Nov 06 15:12:06 devstack cinder-volume[76052]: DEBUG oslo_db.sqlalchemy.engines [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76052) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 06 15:12:06 devstack cinder-volume[76052]: INFO oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] Starting 1 workers Nov 06 15:12:06 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] Started child 76214 {{(pid=76052) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 06 15:12:06 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] Full set of CONF: {{(pid=76052) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 06 15:12:06 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] ******************************************************************************** {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 06 15:12:06 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] Configuration options gathered from: {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 06 15:12:06 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 06 15:12:06 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 06 15:12:06 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] ================================================================================ {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 06 15:12:06 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] allow_availability_zone_fallback = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:06 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] allow_compression_on_image_upload = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] allowed_direct_url_schemes = [] {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] api_rate_limit = True {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] auth_strategy = keystone {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] az_cache_duration = 3600 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] backend_availability_zone = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] backend_host = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] backend_name = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] backend_stats_polling_interval = 60 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] backup_api_class = cinder.backup.api.API {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] backup_name_template = backup-%s {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] backup_use_same_host = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76214]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.1) Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] backup_use_temp_snapshot = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] chap_password = **** {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] chap_username = {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] cinder_internal_tenant_project_id = cfb634951c074617950da95e524efb65 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] cinder_internal_tenant_user_id = e11d23170c0e467080dd79d856394138 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] cloned_volume_same_az = True {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] cluster = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] compression_format = gzip {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] compute_api_class = cinder.compute.nova.API {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] config_dir = [] {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] config_source = [] {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] control_exchange = openstack {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] debug = True {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] default_availability_zone = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] default_group_type = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] default_volume_type = lvmdriver-1 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] disk_geometry = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] driver_client_cert = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] driver_client_cert_key = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] driver_data_namespace = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] driver_ssl_cert_path = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] driver_ssl_cert_verify = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] driver_use_ssl = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] enable_force_upload = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] enable_new_services = True {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] enable_unsupported_driver = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] enabled_backends = ['lvmdriver-1'] {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] enforce_multipath_for_image_xfer = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] filter_function = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] glance_api_insecure = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] glance_api_servers = ['http://192.168.122.144/image'] {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] glance_api_ssl_compression = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] glance_ca_certificates_file = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] glance_catalog_info = image:glance:publicURL {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] glance_certfile = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] glance_keyfile = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] glance_num_retries = 3 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] glance_request_timeout = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] goodness_function = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] graceful_shutdown_timeout = 5 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] group_api_class = cinder.group.api.API {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] host = devstack {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] image_compress_on_upload = True {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] image_conversion_address_space_limit = 1 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] image_conversion_cpu_limit = 60 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] image_conversion_disable = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] image_introspection_address_space_limit = 1 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] image_introspection_cpu_limit = 60 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] image_upload_use_cinder_backend = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] image_upload_use_internal_tenant = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] image_volume_cache_enabled = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] image_volume_cache_max_count = 0 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] image_volume_cache_max_size_gb = 0 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] init_host_max_objects_retrieval = 0 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] instance_format = [instance: %(uuid)s] {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] iscsi_target_flags = {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] iscsi_write_cache = on {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] iser_helper = tgtadm {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] iser_ip_address = 192.168.122.144 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] iser_port = 3260 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] log_color = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] log_config_append = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] log_dir = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] log_file = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] log_options = True {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] log_rotate_interval = 1 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] log_rotate_interval_type = days {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] log_rotation_type = none {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] max_age = 0 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] max_logfile_count = 30 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] max_logfile_size_mb = 200 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] max_over_subscription_ratio = 20.0 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] message_reap_interval = 86400 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] message_ttl = 2592000 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] migration_create_volume_timeout_secs = 300 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] monkey_patch = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] monkey_patch_modules = [] {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] my_ip = 192.168.122.144 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] no_snapshot_gb_quota = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] num_iser_scan_tries = 3 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] num_shell_tries = 3 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] num_volume_device_scan_tries = 3 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] nvmeof_conn_info_version = 1 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] nvmet_ns_id = 10 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] nvmet_port_id = 1 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] osapi_max_limit = 1000 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] osapi_volume_ext_list = [] {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] osapi_volume_listen = 0.0.0.0 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] osapi_volume_listen_port = 8776 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] osapi_volume_use_ssl = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] osapi_volume_workers = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76214]: INFO cinder.volume.manager [None req-7093876d-f0d3-4ed5-a5f4-db748cd63233 None None] Starting volume driver LVMVolumeDriver (3.0.0) Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] per_volume_size_limit = -1 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] periodic_fuzzy_delay = 60 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76214]: DEBUG oslo_concurrency.processutils [None req-7093876d-f0d3-4ed5-a5f4-db748cd63233 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76214) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] periodic_interval = 60 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] project_id_regex = [0-9a-f\-]+ {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] public_endpoint = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] publish_errors = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] quota_backup_gigabytes = 1000 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] quota_backups = 10 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] quota_gigabytes = 1000 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] quota_groups = 10 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] quota_snapshots = 10 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] quota_volumes = 10 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] rate_limit_burst = 0 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] rate_limit_except_level = CRITICAL {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] rate_limit_interval = 0 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] reinit_driver_count = 3 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] replication_device = **** {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] report_discard_supported = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] report_interval = 120 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] reservation_clean_interval = 86400 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] reservation_expire = 86400 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] reserved_image_namespaces = [] {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] reserved_percentage = 0 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] rpc_response_timeout = 120 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] run_external_periodic_tasks = True {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] scst_target_driver = iscsi {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] scst_target_iqn_name = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] service_down_time = 720 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] shell_completion = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] snapshot_name_template = snapshot-%s {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] snapshot_same_host = True {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] split_loggers = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] state_path = /opt/stack/data/cinder {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] storage_availability_zone = nova {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] storage_protocol = iSCSI {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] syslog_log_facility = LOG_USER {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] target_helper = lioadm {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] target_ip_address = 192.168.122.144 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] target_port = 3260 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76214]: DEBUG oslo_concurrency.processutils [None req-7093876d-f0d3-4ed5-a5f4-db748cd63233 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.036s {{(pid=76214) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] target_protocol = iscsi {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] target_secondary_ip_addresses = [] {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] trace_flags = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] transfer_api_class = cinder.transfer.api.API {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] transport_url = **** {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] until_refresh = 0 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] use_chap_auth = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] use_default_quota_class = True {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] use_journal = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] use_json = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76214]: DEBUG oslo_concurrency.processutils [None req-7093876d-f0d3-4ed5-a5f4-db748cd63233 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76214) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] use_multipath_for_image_xfer = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] use_stderr = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] use_syslog = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] verify_glance_signatures = enabled {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] volume_api_class = cinder.volume.api.API {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] volume_backend_name = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] volume_clear = zero {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] volume_clear_ionice = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] volume_clear_size = 0 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] volume_copy_bps_limit = 0 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] volume_dd_blocksize = 1M {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] volume_name_template = volume-%s {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] volume_service_inithost_offload = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] volume_usage_audit_period = month {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] zoning_mode = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] oslo_concurrency.disable_process_locking = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] keystone_authtoken.auth_section = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] keystone_authtoken.auth_type = password {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] keystone_authtoken.auth_version = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] keystone_authtoken.cache = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] keystone_authtoken.certfile = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] keystone_authtoken.delay_auth_decision = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] keystone_authtoken.http_connect_timeout = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] keystone_authtoken.include_service_catalog = True {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] keystone_authtoken.insecure = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] keystone_authtoken.interface = public {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] keystone_authtoken.keyfile = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] keystone_authtoken.memcache_password = **** {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] keystone_authtoken.memcache_username = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] keystone_authtoken.region_name = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] keystone_authtoken.service_token_roles_required = True {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] keystone_authtoken.service_type = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] keystone_authtoken.token_cache_time = 300 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.144/identity {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] cache.backend = dogpile.cache.null {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] cache.backend_argument = **** {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] cache.backend_expiration_time = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] cache.config_prefix = cache.oslo {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] cache.debug_cache_backend = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] cache.enable_retry_client = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] cache.enable_socket_keepalive = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] cache.enabled = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] cache.expiration_time = 600 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76214]: DEBUG oslo_concurrency.processutils [None req-7093876d-f0d3-4ed5-a5f4-db748cd63233 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.038s {{(pid=76214) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] cache.hashclient_retry_attempts = 2 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] cache.memcache_dead_retry = 300 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] cache.memcache_pool_maxsize = 10 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76214]: DEBUG oslo_concurrency.processutils [None req-7093876d-f0d3-4ed5-a5f4-db748cd63233 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76214) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] cache.memcache_sasl_enabled = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] cache.password = **** {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] cache.proxies = [] {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] cache.redis_db = 0 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] cache.redis_sentinel_service_name = mymaster {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] cache.redis_server = localhost:6379 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] cache.retry_attempts = 2 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] cache.retry_delay = 0.0 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] cache.socket_keepalive_count = 1 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] cache.socket_keepalive_idle = 1 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] cache.socket_keepalive_interval = 1 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] cache.socket_timeout = 1.0 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] cache.tls_allowed_ciphers = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] cache.tls_cafile = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] cache.tls_certfile = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] cache.tls_enabled = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] cache.tls_keyfile = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] cache.username = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] coordination.backend_url = **** {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] database.asyncio_connection = **** {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] database.asyncio_slave_connection = **** {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] database.backend = sqlalchemy {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] database.connection = **** {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] database.connection_debug = 0 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] database.connection_parameters = {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] database.connection_recycle_time = 3600 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] database.connection_trace = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] database.db_inc_retry_interval = True {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] database.db_max_retries = 20 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] database.db_max_retry_interval = 10 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] database.db_retry_interval = 1 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] database.max_overflow = 50 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] database.max_pool_size = 5 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] database.max_retries = 10 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] database.mysql_wsrep_sync_wait = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] database.pool_timeout = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] database.retry_interval = 10 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] database.slave_connection = **** {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] database.sqlite_synchronous = True {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] database.synchronous_reader = True {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] database.use_db_reconnect = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] oslo_messaging_tracing.insecure = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] profiler.connection_string = messaging:// {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] profiler.enabled = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] profiler.es_doc_type = notification {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] profiler.es_scroll_size = 10000 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] profiler.es_scroll_time = 2m {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] profiler.filter_error_trace = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] profiler.hmac_keys = **** {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] profiler.sentinel_service_name = mymaster {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] profiler.socket_timeout = 0.1 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76214]: DEBUG oslo_concurrency.processutils [None req-7093876d-f0d3-4ed5-a5f4-db748cd63233 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=76214) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] profiler.trace_requests = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] profiler.trace_sqlalchemy = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] profiler_jaeger.process_tags = {} {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] profiler_jaeger.service_name_prefix = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] profiler_otlp.service_name_prefix = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] oslo_policy.enforce_new_defaults = True {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] oslo_policy.policy_default_rule = default {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] oslo_policy.policy_file = policy.yaml {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76214]: DEBUG oslo_concurrency.processutils [None req-7093876d-f0d3-4ed5-a5f4-db748cd63233 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76214) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] oslo_policy.remote_timeout = 60.0 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] privsep_osbrick.group = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] privsep_osbrick.helper_command = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] privsep_osbrick.user = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] cinder_sys_admin.group = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] cinder_sys_admin.helper_command = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] cinder_sys_admin.user = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] service_user.auth_section = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] service_user.auth_type = password {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] service_user.cafile = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] service_user.certfile = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] service_user.collect_timing = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] service_user.insecure = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] service_user.keyfile = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] service_user.send_service_user_token = True {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] service_user.split_loggers = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] service_user.timeout = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] service_user.tls_ciphers = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] service_user.tls_min_version = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] glance.auth_section = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] glance.auth_type = password {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] glance.certfile = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] glance.collect_timing = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] glance.insecure = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] glance.keyfile = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] glance.region_name = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] glance.split_loggers = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] glance.timeout = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack sudo[76219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] glance.tls_ciphers = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] glance.tls_min_version = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] backend_defaults.backend_availability_zone = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] backend_defaults.chap_password = **** {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] backend_defaults.chap_username = {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack sudo[76219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] backend_defaults.disk_geometry = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] backend_defaults.driver_client_cert = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] backend_defaults.driver_client_cert_key = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] backend_defaults.driver_data_namespace = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] backend_defaults.driver_use_ssl = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] backend_defaults.enable_unsupported_driver = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] backend_defaults.extra_capabilities = {} {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] backend_defaults.filter_function = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] backend_defaults.goodness_function = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] backend_defaults.iscsi_target_flags = {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] backend_defaults.iscsi_write_cache = on {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] backend_defaults.iser_helper = tgtadm {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] backend_defaults.iser_ip_address = 192.168.122.144 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] backend_defaults.iser_port = 3260 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] backend_defaults.lvm_mirrors = 0 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] backend_defaults.lvm_share_target = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] backend_defaults.lvm_type = auto {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] backend_defaults.num_shell_tries = 3 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] backend_defaults.nvmet_port_id = 1 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] backend_defaults.replication_device = **** {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] backend_defaults.report_discard_supported = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] backend_defaults.reserved_percentage = 0 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] backend_defaults.scst_target_driver = iscsi {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] backend_defaults.scst_target_iqn_name = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] backend_defaults.storage_protocol = iSCSI {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] backend_defaults.target_helper = tgtadm {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] backend_defaults.target_ip_address = 192.168.122.144 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] backend_defaults.target_port = 3260 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] backend_defaults.target_protocol = iscsi {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] backend_defaults.trace_flags = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] backend_defaults.unique_fqdn_network = True {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] backend_defaults.use_chap_auth = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] backend_defaults.volume_backend_name = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] backend_defaults.volume_clear = zero {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] backend_defaults.volume_clear_ionice = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] backend_defaults.volume_clear_size = 0 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] backend_defaults.volume_group = cinder-volumes {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] oslo_reports.file_event_handler = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] oslo_reports.log_dir = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] lvmdriver-1.backend_availability_zone = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] lvmdriver-1.backend_host = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] lvmdriver-1.chap_password = **** {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] lvmdriver-1.chap_username = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] lvmdriver-1.chiscsi_conf = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] lvmdriver-1.disk_geometry = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] lvmdriver-1.driver_client_cert = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] lvmdriver-1.driver_data_namespace = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] lvmdriver-1.driver_use_ssl = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] lvmdriver-1.extra_capabilities = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] lvmdriver-1.filter_function = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] lvmdriver-1.goodness_function = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] lvmdriver-1.iser_helper = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] lvmdriver-1.iser_ip_address = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] lvmdriver-1.iser_port = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] lvmdriver-1.iser_target_prefix = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] lvmdriver-1.lvm_conf_file = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] lvmdriver-1.lvm_mirrors = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] lvmdriver-1.lvm_share_target = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] lvmdriver-1.lvm_type = auto {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] lvmdriver-1.num_shell_tries = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] lvmdriver-1.nvmet_port_id = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] lvmdriver-1.replication_device = **** {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] lvmdriver-1.report_discard_supported = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] lvmdriver-1.reserved_percentage = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] lvmdriver-1.scst_target_driver = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] lvmdriver-1.storage_protocol = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] lvmdriver-1.target_helper = lioadm {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] lvmdriver-1.target_ip_address = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] lvmdriver-1.target_port = 3260 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] lvmdriver-1.target_protocol = iscsi {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] lvmdriver-1.trace_flags = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] lvmdriver-1.use_chap_auth = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] lvmdriver-1.volume_clear = zero {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] lvmdriver-1.volume_clear_size = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] lvmdriver-1.volumes_dir = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] oslo_messaging_rabbit.ssl = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] oslo_messaging_rabbit.ssl_version = {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] oslo_messaging_notifications.driver = [] {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] oslo_messaging_notifications.retry = -1 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] oslo_messaging_notifications.transport_url = **** {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] key_manager.fixed_key = **** {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] barbican.barbican_api_version = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] barbican.barbican_endpoint = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] barbican.barbican_endpoint_type = public {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] barbican.barbican_region_name = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] barbican.cafile = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] barbican.certfile = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] barbican.collect_timing = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] barbican.insecure = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] barbican.keyfile = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] barbican.number_of_retries = 60 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] barbican.retry_delay = 1 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] barbican.send_service_user_token = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] barbican.split_loggers = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] barbican.timeout = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] barbican.tls_ciphers = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] barbican.tls_min_version = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] barbican.verify_ssl = True {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] barbican.verify_ssl_path = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] barbican_service_user.auth_section = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] barbican_service_user.auth_type = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] barbican_service_user.cafile = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] barbican_service_user.certfile = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] barbican_service_user.collect_timing = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] barbican_service_user.insecure = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] barbican_service_user.keyfile = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] barbican_service_user.split_loggers = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] barbican_service_user.timeout = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] barbican_service_user.tls_ciphers = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] barbican_service_user.tls_min_version = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] vault.approle_role_id = **** {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] vault.approle_secret_id = **** {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] vault.auth_method = approle {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] vault.auth_path = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] vault.kv_mountpoint = secret {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] vault.kv_path = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] vault.kv_version = 2 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] vault.namespace = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] vault.root_token_id = **** {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] vault.ssl_ca_crt_file = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] vault.timeout = 60.0 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] vault.token_file = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] vault.token_role = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] vault.use_ssl = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:12:07 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] ******************************************************************************** {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 06 15:12:07 devstack sudo[76219]: pam_unix(sudo:session): session closed for user root Nov 06 15:12:07 devstack cinder-volume[76214]: DEBUG oslo_concurrency.processutils [None req-7093876d-f0d3-4ed5-a5f4-db748cd63233 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.345s {{(pid=76214) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:12:07 devstack cinder-volume[76214]: DEBUG oslo_concurrency.processutils [None req-7093876d-f0d3-4ed5-a5f4-db748cd63233 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76214) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:12:07 devstack sudo[76222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 06 15:12:07 devstack sudo[76222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:12:07 devstack sudo[76222]: pam_unix(sudo:session): session closed for user root Nov 06 15:12:07 devstack cinder-volume[76214]: DEBUG oslo_concurrency.processutils [None req-7093876d-f0d3-4ed5-a5f4-db748cd63233 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.249s {{(pid=76214) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:12:07 devstack cinder-volume[76214]: DEBUG oslo_concurrency.processutils [None req-7093876d-f0d3-4ed5-a5f4-db748cd63233 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76214) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 15:12:07 devstack cinder-volume[76214]: INFO cinder.brick.local_dev.lvm [None req-7093876d-f0d3-4ed5-a5f4-db748cd63233 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Nov 06 15:12:07 devstack cinder-volume[76214]: DEBUG oslo_concurrency.processutils [None req-7093876d-f0d3-4ed5-a5f4-db748cd63233 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76214) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:12:07 devstack cinder-volume[76214]: DEBUG oslo_concurrency.processutils [None req-7093876d-f0d3-4ed5-a5f4-db748cd63233 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=76214) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:12:07 devstack cinder-volume[76214]: DEBUG oslo_concurrency.processutils [None req-7093876d-f0d3-4ed5-a5f4-db748cd63233 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76214) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:12:07 devstack sudo[76256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 06 15:12:07 devstack sudo[76256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:12:08 devstack sudo[76256]: pam_unix(sudo:session): session closed for user root Nov 06 15:12:08 devstack cinder-volume[76214]: DEBUG oslo_concurrency.processutils [None req-7093876d-f0d3-4ed5-a5f4-db748cd63233 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.283s {{(pid=76214) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:12:08 devstack cinder-volume[76214]: DEBUG cinder.brick.local_dev.lvm [None req-7093876d-f0d3-4ed5-a5f4-db748cd63233 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76214) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Nov 06 15:12:08 devstack cinder-volume[76214]: DEBUG oslo_concurrency.processutils [None req-7093876d-f0d3-4ed5-a5f4-db748cd63233 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76214) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:12:08 devstack sudo[76418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 06 15:12:08 devstack sudo[76418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:12:08 devstack sudo[76418]: pam_unix(sudo:session): session closed for user root Nov 06 15:12:08 devstack cinder-volume[76214]: DEBUG oslo_concurrency.processutils [None req-7093876d-f0d3-4ed5-a5f4-db748cd63233 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.683s {{(pid=76214) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:12:08 devstack cinder-volume[76214]: DEBUG oslo_concurrency.processutils [None req-7093876d-f0d3-4ed5-a5f4-db748cd63233 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76214) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:12:08 devstack cinder-volume[76214]: DEBUG oslo_concurrency.processutils [None req-7093876d-f0d3-4ed5-a5f4-db748cd63233 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76214) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:12:08 devstack cinder-volume[76214]: DEBUG oslo_concurrency.processutils [None req-7093876d-f0d3-4ed5-a5f4-db748cd63233 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76214) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:12:08 devstack sudo[76625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 06 15:12:08 devstack sudo[76625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:12:09 devstack sudo[76625]: pam_unix(sudo:session): session closed for user root Nov 06 15:12:09 devstack cinder-volume[76214]: DEBUG oslo_concurrency.processutils [None req-7093876d-f0d3-4ed5-a5f4-db748cd63233 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.262s {{(pid=76214) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:12:09 devstack cinder-volume[76214]: DEBUG oslo_concurrency.processutils [None req-7093876d-f0d3-4ed5-a5f4-db748cd63233 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76214) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:12:09 devstack cinder-volume[76214]: DEBUG oslo_concurrency.processutils [None req-7093876d-f0d3-4ed5-a5f4-db748cd63233 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76214) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:12:09 devstack cinder-volume[76214]: DEBUG oslo_concurrency.processutils [None req-7093876d-f0d3-4ed5-a5f4-db748cd63233 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76214) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:12:09 devstack sudo[76715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Nov 06 15:12:09 devstack sudo[76715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:12:09 devstack sudo[76715]: pam_unix(sudo:session): session closed for user root Nov 06 15:12:09 devstack cinder-volume[76214]: DEBUG oslo_concurrency.processutils [None req-7093876d-f0d3-4ed5-a5f4-db748cd63233 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.305s {{(pid=76214) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:12:09 devstack cinder-volume[76214]: DEBUG oslo_concurrency.processutils [None req-7093876d-f0d3-4ed5-a5f4-db748cd63233 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76214) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:12:09 devstack sudo[76836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 06 15:12:09 devstack sudo[76836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:12:09 devstack sudo[76836]: pam_unix(sudo:session): session closed for user root Nov 06 15:12:09 devstack cinder-volume[76214]: DEBUG oslo_concurrency.processutils [None req-7093876d-f0d3-4ed5-a5f4-db748cd63233 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=76214) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:12:09 devstack cinder-volume[76214]: DEBUG oslo_concurrency.processutils [None req-7093876d-f0d3-4ed5-a5f4-db748cd63233 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76214) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:12:09 devstack sudo[76839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 06 15:12:09 devstack sudo[76839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:12:09 devstack sudo[76839]: pam_unix(sudo:session): session closed for user root Nov 06 15:12:09 devstack cinder-volume[76214]: DEBUG oslo_concurrency.processutils [None req-7093876d-f0d3-4ed5-a5f4-db748cd63233 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.296s {{(pid=76214) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:12:09 devstack cinder-volume[76214]: DEBUG oslo_concurrency.processutils [None req-7093876d-f0d3-4ed5-a5f4-db748cd63233 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76214) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:12:09 devstack sudo[76922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 15:12:09 devstack sudo[76922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:12:10 devstack sudo[76922]: pam_unix(sudo:session): session closed for user root Nov 06 15:12:10 devstack cinder-volume[76214]: DEBUG oslo_concurrency.processutils [None req-7093876d-f0d3-4ed5-a5f4-db748cd63233 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=76214) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:12:10 devstack cinder-volume[76214]: DEBUG oslo_concurrency.processutils [None req-7093876d-f0d3-4ed5-a5f4-db748cd63233 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76214) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:12:10 devstack sudo[76927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 06 15:12:10 devstack sudo[76927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:12:10 devstack sudo[76927]: pam_unix(sudo:session): session closed for user root Nov 06 15:12:10 devstack cinder-volume[76214]: DEBUG oslo_concurrency.processutils [None req-7093876d-f0d3-4ed5-a5f4-db748cd63233 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.281s {{(pid=76214) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:12:10 devstack cinder-volume[76214]: DEBUG oslo_concurrency.processutils [None req-7093876d-f0d3-4ed5-a5f4-db748cd63233 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76214) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:12:10 devstack cinder-volume[76214]: DEBUG oslo_concurrency.processutils [None req-7093876d-f0d3-4ed5-a5f4-db748cd63233 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.030s {{(pid=76214) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:12:10 devstack cinder-volume[76214]: DEBUG oslo_concurrency.processutils [None req-7093876d-f0d3-4ed5-a5f4-db748cd63233 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76214) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:12:10 devstack sudo[76955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 06 15:12:10 devstack sudo[76955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:12:10 devstack sudo[76955]: pam_unix(sudo:session): session closed for user root Nov 06 15:12:10 devstack cinder-volume[76214]: DEBUG oslo_concurrency.processutils [None req-7093876d-f0d3-4ed5-a5f4-db748cd63233 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.272s {{(pid=76214) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:12:10 devstack cinder-volume[76214]: INFO cinder.volume.drivers.lvm [None req-7093876d-f0d3-4ed5-a5f4-db748cd63233 None None] Enabling LVM thin provisioning by default because a thin pool exists. Nov 06 15:12:10 devstack cinder-volume[76214]: DEBUG oslo_concurrency.processutils [None req-7093876d-f0d3-4ed5-a5f4-db748cd63233 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76214) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:12:10 devstack cinder-volume[76214]: DEBUG oslo_concurrency.processutils [None req-7093876d-f0d3-4ed5-a5f4-db748cd63233 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=76214) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:12:10 devstack cinder-volume[76214]: DEBUG oslo_concurrency.processutils [None req-7093876d-f0d3-4ed5-a5f4-db748cd63233 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76214) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:12:10 devstack sudo[77021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 06 15:12:10 devstack sudo[77021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:12:11 devstack sudo[77021]: pam_unix(sudo:session): session closed for user root Nov 06 15:12:11 devstack cinder-volume[76214]: DEBUG oslo_concurrency.processutils [None req-7093876d-f0d3-4ed5-a5f4-db748cd63233 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.297s {{(pid=76214) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:12:11 devstack cinder-volume[76214]: DEBUG cinder.volume.drivers.lvm [None req-7093876d-f0d3-4ed5-a5f4-db748cd63233 None None] Updating volume stats {{(pid=76214) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 06 15:12:11 devstack cinder-volume[76214]: DEBUG oslo_concurrency.processutils [None req-7093876d-f0d3-4ed5-a5f4-db748cd63233 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76214) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:12:11 devstack sudo[77024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 06 15:12:11 devstack sudo[77024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:12:11 devstack sudo[77024]: pam_unix(sudo:session): session closed for user root Nov 06 15:12:11 devstack cinder-volume[76214]: DEBUG oslo_concurrency.processutils [None req-7093876d-f0d3-4ed5-a5f4-db748cd63233 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=76214) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:12:11 devstack cinder-volume[76214]: DEBUG oslo_concurrency.processutils [None req-7093876d-f0d3-4ed5-a5f4-db748cd63233 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76214) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:12:11 devstack sudo[77033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 15:12:11 devstack sudo[77033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:12:11 devstack sudo[77033]: pam_unix(sudo:session): session closed for user root Nov 06 15:12:11 devstack cinder-volume[76214]: DEBUG oslo_concurrency.processutils [None req-7093876d-f0d3-4ed5-a5f4-db748cd63233 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=76214) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:12:11 devstack cinder-volume[76214]: DEBUG oslo_concurrency.processutils [None req-7093876d-f0d3-4ed5-a5f4-db748cd63233 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76214) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:12:11 devstack sudo[77036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 06 15:12:11 devstack sudo[77036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:12:11 devstack sudo[77036]: pam_unix(sudo:session): session closed for user root Nov 06 15:12:11 devstack cinder-volume[76214]: DEBUG oslo_concurrency.processutils [None req-7093876d-f0d3-4ed5-a5f4-db748cd63233 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.249s {{(pid=76214) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:12:11 devstack cinder-volume[76214]: DEBUG oslo_concurrency.processutils [None req-7093876d-f0d3-4ed5-a5f4-db748cd63233 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76214) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:12:11 devstack sudo[77039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 15:12:11 devstack sudo[77039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:12:12 devstack sudo[77039]: pam_unix(sudo:session): session closed for user root Nov 06 15:12:12 devstack cinder-volume[76214]: DEBUG oslo_concurrency.processutils [None req-7093876d-f0d3-4ed5-a5f4-db748cd63233 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=76214) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:12:12 devstack cinder-volume[76214]: INFO cinder.volume.driver [None req-7093876d-f0d3-4ed5-a5f4-db748cd63233 None None] Driver hasn't implemented _init_vendor_properties() Nov 06 15:12:12 devstack cinder-volume[76214]: DEBUG cinder.volume.driver [None req-7093876d-f0d3-4ed5-a5f4-db748cd63233 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76214) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 06 15:12:12 devstack cinder-volume[76214]: DEBUG oslo_db.sqlalchemy.engines [None req-7093876d-f0d3-4ed5-a5f4-db748cd63233 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76214) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 06 15:12:12 devstack cinder-volume[76214]: DEBUG dbcounter [-] [76214] Writer thread running {{(pid=76214) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 06 15:12:12 devstack cinder-volume[76214]: DEBUG cinder.db.api [None req-7093876d-f0d3-4ed5-a5f4-db748cd63233 None None] Building query based on filter {{(pid=76214) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Nov 06 15:12:12 devstack cinder-volume[76214]: DEBUG cinder.image.image_utils [None req-7093876d-f0d3-4ed5-a5f4-db748cd63233 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76214) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Nov 06 15:12:12 devstack cinder-volume[76214]: INFO cinder.keymgr.migration [None req-f1363e81-3150-4a66-9384-b15132463daf None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 06 15:12:12 devstack cinder-volume[76214]: DEBUG cinder.volume.drivers.lvm [None req-7093876d-f0d3-4ed5-a5f4-db748cd63233 None None] Updating volume stats {{(pid=76214) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 06 15:12:12 devstack cinder-volume[76214]: DEBUG oslo_concurrency.processutils [None req-7093876d-f0d3-4ed5-a5f4-db748cd63233 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76214) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:12:12 devstack sudo[77043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 06 15:12:12 devstack sudo[77043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:12:12 devstack sudo[77043]: pam_unix(sudo:session): session closed for user root Nov 06 15:12:12 devstack cinder-volume[76214]: DEBUG oslo_concurrency.processutils [None req-7093876d-f0d3-4ed5-a5f4-db748cd63233 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=76214) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:12:12 devstack cinder-volume[76214]: DEBUG oslo_concurrency.processutils [None req-7093876d-f0d3-4ed5-a5f4-db748cd63233 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76214) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:12:12 devstack sudo[77046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 15:12:12 devstack sudo[77046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:12:12 devstack sudo[77046]: pam_unix(sudo:session): session closed for user root Nov 06 15:12:12 devstack cinder-volume[76214]: DEBUG oslo_concurrency.processutils [None req-7093876d-f0d3-4ed5-a5f4-db748cd63233 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.249s {{(pid=76214) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:12:12 devstack cinder-volume[76214]: DEBUG oslo_concurrency.processutils [None req-7093876d-f0d3-4ed5-a5f4-db748cd63233 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76214) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:12:12 devstack sudo[77050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 06 15:12:12 devstack sudo[77050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:12:13 devstack sudo[77050]: pam_unix(sudo:session): session closed for user root Nov 06 15:12:13 devstack cinder-volume[76214]: DEBUG oslo_concurrency.processutils [None req-7093876d-f0d3-4ed5-a5f4-db748cd63233 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.250s {{(pid=76214) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:12:13 devstack cinder-volume[76214]: DEBUG oslo_concurrency.processutils [None req-7093876d-f0d3-4ed5-a5f4-db748cd63233 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76214) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:12:13 devstack sudo[77054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 15:12:13 devstack sudo[77054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:12:13 devstack sudo[77054]: pam_unix(sudo:session): session closed for user root Nov 06 15:12:13 devstack cinder-volume[76214]: DEBUG oslo_concurrency.processutils [None req-7093876d-f0d3-4ed5-a5f4-db748cd63233 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=76214) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:12:13 devstack cinder-volume[76214]: DEBUG cinder.manager [None req-7093876d-f0d3-4ed5-a5f4-db748cd63233 None None] Notifying Schedulers of capabilities ... {{(pid=76214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:12:13 devstack cinder-volume[76214]: INFO cinder.volume.manager [None req-7093876d-f0d3-4ed5-a5f4-db748cd63233 None None] Driver initialization completed successfully. Nov 06 15:12:13 devstack cinder-volume[76214]: INFO cinder.manager [None req-7093876d-f0d3-4ed5-a5f4-db748cd63233 None None] Initiating service 2 cleanup Nov 06 15:12:13 devstack cinder-volume[76214]: INFO cinder.manager [None req-7093876d-f0d3-4ed5-a5f4-db748cd63233 None None] Service 2 cleanup completed. Nov 06 15:12:13 devstack cinder-volume[76214]: DEBUG cinder.service [None req-7093876d-f0d3-4ed5-a5f4-db748cd63233 None None] Creating RPC server for service cinder-volume {{(pid=76214) start /opt/stack/cinder/cinder/service.py:231}} Nov 06 15:12:13 devstack cinder-volume[76214]: DEBUG cinder.service [None req-7093876d-f0d3-4ed5-a5f4-db748cd63233 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76214) start /opt/stack/cinder/cinder/service.py:237}} Nov 06 15:12:13 devstack cinder-volume[76214]: INFO cinder.volume.manager [None req-7093876d-f0d3-4ed5-a5f4-db748cd63233 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Nov 06 15:12:13 devstack cinder-volume[76214]: DEBUG cinder.volume.drivers.lvm [None req-7093876d-f0d3-4ed5-a5f4-db748cd63233 None None] Updating volume stats {{(pid=76214) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 06 15:12:13 devstack cinder-volume[76214]: DEBUG oslo_concurrency.processutils [None req-7093876d-f0d3-4ed5-a5f4-db748cd63233 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76214) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:12:13 devstack sudo[77057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 06 15:12:13 devstack sudo[77057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:12:13 devstack sudo[77057]: pam_unix(sudo:session): session closed for user root Nov 06 15:12:13 devstack cinder-volume[76214]: DEBUG oslo_concurrency.processutils [None req-7093876d-f0d3-4ed5-a5f4-db748cd63233 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.283s {{(pid=76214) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:12:13 devstack cinder-volume[76214]: DEBUG oslo_concurrency.processutils [None req-7093876d-f0d3-4ed5-a5f4-db748cd63233 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76214) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:12:13 devstack sudo[77061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 15:12:13 devstack sudo[77061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:12:14 devstack sudo[77061]: pam_unix(sudo:session): session closed for user root Nov 06 15:12:14 devstack cinder-volume[76214]: DEBUG oslo_concurrency.processutils [None req-7093876d-f0d3-4ed5-a5f4-db748cd63233 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.270s {{(pid=76214) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:12:14 devstack cinder-volume[76214]: DEBUG oslo_concurrency.processutils [None req-7093876d-f0d3-4ed5-a5f4-db748cd63233 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76214) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:12:14 devstack sudo[77065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 06 15:12:14 devstack sudo[77065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:12:14 devstack sudo[77065]: pam_unix(sudo:session): session closed for user root Nov 06 15:12:14 devstack cinder-volume[76214]: DEBUG oslo_concurrency.processutils [None req-7093876d-f0d3-4ed5-a5f4-db748cd63233 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.260s {{(pid=76214) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:12:14 devstack cinder-volume[76214]: DEBUG oslo_concurrency.processutils [None req-7093876d-f0d3-4ed5-a5f4-db748cd63233 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76214) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:12:14 devstack sudo[77070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 15:12:14 devstack sudo[77070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:12:14 devstack sudo[77070]: pam_unix(sudo:session): session closed for user root Nov 06 15:12:14 devstack cinder-volume[76214]: DEBUG oslo_concurrency.processutils [None req-7093876d-f0d3-4ed5-a5f4-db748cd63233 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=76214) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:12:14 devstack cinder-volume[76214]: INFO cinder.volume.manager [None req-7093876d-f0d3-4ed5-a5f4-db748cd63233 None None] Driver post RPC initialization completed successfully. Nov 06 15:12:16 devstack cinder-volume[76052]: DEBUG dbcounter [-] [76052] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76052) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 15:12:24 devstack cinder-volume[76214]: DEBUG dbcounter [-] [76214] Writing DB stats cinder:SELECT=3 {{(pid=76214) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 15:12:24 devstack cinder-volume[76214]: DEBUG dbcounter [-] [76214] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=76214) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 15:13:02 devstack cinder-volume[76214]: DEBUG oslo_service.periodic_task [None req-96f2d04a-a845-4a56-8616-a8b6dd881d38 None None] Running periodic task VolumeManager._thread_info {{(pid=76214) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 15:13:02 devstack cinder-volume[76214]: DEBUG cinder.volume.manager [None req-96f2d04a-a845-4a56-8616-a8b6dd881d38 None None] thread count: 6 {{(pid=76214) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 15:13:02 devstack cinder-volume[76214]: DEBUG cinder.volume.manager [None req-96f2d04a-a845-4a56-8616-a8b6dd881d38 None None] thread info: [<_MainThread(MainThread, started 132475554787456)>, , , , , ] {{(pid=76214) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 06 15:14:02 devstack cinder-volume[76214]: DEBUG oslo_service.periodic_task [None req-96f2d04a-a845-4a56-8616-a8b6dd881d38 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76214) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 15:14:02 devstack cinder-volume[76214]: DEBUG cinder.volume.drivers.lvm [None req-96f2d04a-a845-4a56-8616-a8b6dd881d38 None None] Updating volume stats {{(pid=76214) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 06 15:14:02 devstack cinder-volume[76214]: DEBUG oslo_concurrency.processutils [None req-96f2d04a-a845-4a56-8616-a8b6dd881d38 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76214) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:14:02 devstack sudo[82197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 06 15:14:02 devstack sudo[82197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:14:02 devstack sudo[82197]: pam_unix(sudo:session): session closed for user root Nov 06 15:14:02 devstack cinder-volume[76214]: DEBUG oslo_concurrency.processutils [None req-96f2d04a-a845-4a56-8616-a8b6dd881d38 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=76214) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:14:02 devstack cinder-volume[76214]: DEBUG oslo_concurrency.processutils [None req-96f2d04a-a845-4a56-8616-a8b6dd881d38 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76214) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:14:02 devstack sudo[82201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 15:14:02 devstack sudo[82201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:14:03 devstack sudo[82201]: pam_unix(sudo:session): session closed for user root Nov 06 15:14:03 devstack cinder-volume[76214]: DEBUG oslo_concurrency.processutils [None req-96f2d04a-a845-4a56-8616-a8b6dd881d38 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.246s {{(pid=76214) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:14:03 devstack cinder-volume[76214]: DEBUG oslo_concurrency.processutils [None req-96f2d04a-a845-4a56-8616-a8b6dd881d38 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76214) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:14:03 devstack sudo[82204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 06 15:14:03 devstack sudo[82204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:14:03 devstack sudo[82204]: pam_unix(sudo:session): session closed for user root Nov 06 15:14:03 devstack cinder-volume[76214]: DEBUG oslo_concurrency.processutils [None req-96f2d04a-a845-4a56-8616-a8b6dd881d38 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.255s {{(pid=76214) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:14:03 devstack cinder-volume[76214]: DEBUG oslo_concurrency.processutils [None req-96f2d04a-a845-4a56-8616-a8b6dd881d38 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76214) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:14:03 devstack sudo[82224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 15:14:03 devstack sudo[82224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:14:03 devstack sudo[82224]: pam_unix(sudo:session): session closed for user root Nov 06 15:14:03 devstack cinder-volume[76214]: DEBUG oslo_concurrency.processutils [None req-96f2d04a-a845-4a56-8616-a8b6dd881d38 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=76214) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:14:03 devstack cinder-volume[76214]: DEBUG cinder.manager [None req-96f2d04a-a845-4a56-8616-a8b6dd881d38 None None] Notifying Schedulers of capabilities ... {{(pid=76214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:14:03 devstack cinder-volume[76214]: DEBUG oslo_service.periodic_task [None req-96f2d04a-a845-4a56-8616-a8b6dd881d38 None None] Running periodic task VolumeManager._thread_info {{(pid=76214) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 15:14:03 devstack cinder-volume[76214]: DEBUG cinder.volume.manager [None req-96f2d04a-a845-4a56-8616-a8b6dd881d38 None None] thread count: 6 {{(pid=76214) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 15:14:03 devstack cinder-volume[76214]: DEBUG cinder.volume.manager [None req-96f2d04a-a845-4a56-8616-a8b6dd881d38 None None] thread info: [<_MainThread(MainThread, started 132475554787456)>, , , , , ] {{(pid=76214) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 06 15:14:24 devstack cinder-volume[76214]: DEBUG dbcounter [-] [76214] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=76214) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 15:15:02 devstack cinder-volume[76214]: DEBUG oslo_service.periodic_task [None req-96f2d04a-a845-4a56-8616-a8b6dd881d38 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76214) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 15:15:02 devstack cinder-volume[76214]: DEBUG cinder.volume.drivers.lvm [None req-96f2d04a-a845-4a56-8616-a8b6dd881d38 None None] Updating volume stats {{(pid=76214) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 06 15:15:02 devstack cinder-volume[76214]: DEBUG oslo_concurrency.processutils [None req-96f2d04a-a845-4a56-8616-a8b6dd881d38 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76214) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:15:02 devstack sudo[84196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 06 15:15:02 devstack sudo[84196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:15:02 devstack sudo[84196]: pam_unix(sudo:session): session closed for user root Nov 06 15:15:02 devstack cinder-volume[76214]: DEBUG oslo_concurrency.processutils [None req-96f2d04a-a845-4a56-8616-a8b6dd881d38 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=76214) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:15:02 devstack cinder-volume[76214]: DEBUG oslo_concurrency.processutils [None req-96f2d04a-a845-4a56-8616-a8b6dd881d38 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76214) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:15:02 devstack sudo[84205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 15:15:02 devstack sudo[84205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:15:03 devstack sudo[84205]: pam_unix(sudo:session): session closed for user root Nov 06 15:15:03 devstack cinder-volume[76214]: DEBUG oslo_concurrency.processutils [None req-96f2d04a-a845-4a56-8616-a8b6dd881d38 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=76214) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:15:03 devstack cinder-volume[76214]: DEBUG oslo_concurrency.processutils [None req-96f2d04a-a845-4a56-8616-a8b6dd881d38 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76214) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:15:03 devstack sudo[84223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 06 15:15:03 devstack sudo[84223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:15:03 devstack sudo[84223]: pam_unix(sudo:session): session closed for user root Nov 06 15:15:03 devstack cinder-volume[76214]: DEBUG oslo_concurrency.processutils [None req-96f2d04a-a845-4a56-8616-a8b6dd881d38 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.248s {{(pid=76214) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:15:03 devstack cinder-volume[76214]: DEBUG oslo_concurrency.processutils [None req-96f2d04a-a845-4a56-8616-a8b6dd881d38 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76214) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:15:03 devstack sudo[84231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 15:15:03 devstack sudo[84231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:15:03 devstack sudo[84231]: pam_unix(sudo:session): session closed for user root Nov 06 15:15:03 devstack cinder-volume[76214]: DEBUG oslo_concurrency.processutils [None req-96f2d04a-a845-4a56-8616-a8b6dd881d38 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=76214) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:15:03 devstack cinder-volume[76214]: DEBUG cinder.manager [None req-96f2d04a-a845-4a56-8616-a8b6dd881d38 None None] Notifying Schedulers of capabilities ... {{(pid=76214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:15:03 devstack cinder-volume[76214]: DEBUG oslo_service.periodic_task [None req-96f2d04a-a845-4a56-8616-a8b6dd881d38 None None] Running periodic task VolumeManager._thread_info {{(pid=76214) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 15:15:03 devstack cinder-volume[76214]: DEBUG cinder.volume.manager [None req-96f2d04a-a845-4a56-8616-a8b6dd881d38 None None] thread count: 6 {{(pid=76214) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 15:15:03 devstack cinder-volume[76214]: DEBUG cinder.volume.manager [None req-96f2d04a-a845-4a56-8616-a8b6dd881d38 None None] thread info: [<_MainThread(MainThread, started 132475554787456)>, , , , , ] {{(pid=76214) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 06 15:16:02 devstack cinder-volume[76214]: DEBUG oslo_service.periodic_task [None req-96f2d04a-a845-4a56-8616-a8b6dd881d38 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76214) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 15:16:02 devstack cinder-volume[76214]: DEBUG cinder.volume.drivers.lvm [None req-96f2d04a-a845-4a56-8616-a8b6dd881d38 None None] Updating volume stats {{(pid=76214) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 06 15:16:02 devstack cinder-volume[76214]: DEBUG oslo_concurrency.processutils [None req-96f2d04a-a845-4a56-8616-a8b6dd881d38 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76214) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:16:02 devstack sudo[85579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 06 15:16:02 devstack sudo[85579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:16:02 devstack sudo[85579]: pam_unix(sudo:session): session closed for user root Nov 06 15:16:02 devstack cinder-volume[76214]: DEBUG oslo_concurrency.processutils [None req-96f2d04a-a845-4a56-8616-a8b6dd881d38 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.247s {{(pid=76214) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:16:02 devstack cinder-volume[76214]: DEBUG oslo_concurrency.processutils [None req-96f2d04a-a845-4a56-8616-a8b6dd881d38 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76214) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:16:02 devstack sudo[85582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 15:16:02 devstack sudo[85582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:16:03 devstack sudo[85582]: pam_unix(sudo:session): session closed for user root Nov 06 15:16:03 devstack cinder-volume[76214]: DEBUG oslo_concurrency.processutils [None req-96f2d04a-a845-4a56-8616-a8b6dd881d38 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=76214) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:16:03 devstack cinder-volume[76214]: DEBUG oslo_concurrency.processutils [None req-96f2d04a-a845-4a56-8616-a8b6dd881d38 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76214) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:16:03 devstack sudo[85585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 06 15:16:03 devstack sudo[85585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:16:03 devstack sudo[85585]: pam_unix(sudo:session): session closed for user root Nov 06 15:16:03 devstack cinder-volume[76214]: DEBUG oslo_concurrency.processutils [None req-96f2d04a-a845-4a56-8616-a8b6dd881d38 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.246s {{(pid=76214) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:16:03 devstack cinder-volume[76214]: DEBUG oslo_concurrency.processutils [None req-96f2d04a-a845-4a56-8616-a8b6dd881d38 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76214) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:16:03 devstack sudo[85599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 15:16:03 devstack sudo[85599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:16:03 devstack sudo[85599]: pam_unix(sudo:session): session closed for user root Nov 06 15:16:03 devstack cinder-volume[76214]: DEBUG oslo_concurrency.processutils [None req-96f2d04a-a845-4a56-8616-a8b6dd881d38 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.246s {{(pid=76214) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:16:03 devstack cinder-volume[76214]: DEBUG cinder.manager [None req-96f2d04a-a845-4a56-8616-a8b6dd881d38 None None] Notifying Schedulers of capabilities ... {{(pid=76214) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:16:24 devstack cinder-volume[76214]: DEBUG dbcounter [-] [76214] Writing DB stats cinder:SELECT=1 {{(pid=76214) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 15:16:24 devstack cinder-volume[76214]: DEBUG dbcounter [-] [76214] Writing DB stats cinder:UPDATE=1 {{(pid=76214) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 15:16:32 devstack cinder-volume[76052]: INFO oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] Caught SIGTERM, stopping children Nov 06 15:16:32 devstack cinder-volume[76052]: DEBUG oslo_concurrency.lockutils [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] Acquiring lock "singleton_lock" {{(pid=76052) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 06 15:16:32 devstack cinder-volume[76052]: DEBUG oslo_concurrency.lockutils [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] Acquired lock "singleton_lock" {{(pid=76052) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 06 15:16:32 devstack cinder-volume[76052]: DEBUG oslo_concurrency.lockutils [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] Releasing lock "singleton_lock" {{(pid=76052) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 06 15:16:32 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] Stop services. {{(pid=76052) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Nov 06 15:16:32 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] Killing children. {{(pid=76052) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Nov 06 15:16:32 devstack cinder-volume[76052]: INFO oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] Waiting on 1 children to exit Nov 06 15:16:33 devstack cinder-volume[76214]: DEBUG oslo_concurrency.lockutils [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] Acquiring lock "singleton_lock" {{(pid=76214) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 06 15:16:33 devstack cinder-volume[76214]: DEBUG oslo_concurrency.lockutils [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] Acquired lock "singleton_lock" {{(pid=76214) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 06 15:16:33 devstack cinder-volume[76214]: DEBUG oslo_concurrency.lockutils [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] Releasing lock "singleton_lock" {{(pid=76214) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 06 15:16:33 devstack cinder-volume[76214]: WARNING amqp [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 06 15:16:33 devstack cinder-volume[76214]: WARNING amqp [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 06 15:16:33 devstack cinder-volume[76052]: INFO oslo_service.backend._eventlet.service [None req-46398bcc-3943-4460-9f9f-1c7223dad4a7 None None] Child 76214 exited with status 0 Nov 06 15:16:33 devstack cinder-volume[86268]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 06 15:16:33 devstack cinder-volume[86268]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 06 15:16:33 devstack cinder-volume[86268]: we strongly recommend against using it for new projects. Nov 06 15:16:33 devstack cinder-volume[86268]: If you are already using Eventlet, we recommend migrating to a different Nov 06 15:16:33 devstack cinder-volume[86268]: framework. For more detail see Nov 06 15:16:33 devstack cinder-volume[86268]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 06 15:16:33 devstack cinder-volume[86268]: import eventlet # noqa Nov 06 15:16:35 devstack cinder-volume[86268]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86268) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 06 15:16:35 devstack cinder-volume[86268]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86268) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 06 15:16:35 devstack cinder-volume[86268]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86268) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 06 15:16:36 devstack cinder-volume[86268]: INFO dbcounter [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] Registered counter for database cinder Nov 06 15:16:36 devstack cinder-volume[86268]: DEBUG oslo_db.sqlalchemy.engines [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86268) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 06 15:16:36 devstack cinder-volume[86268]: DEBUG dbcounter [-] [86268] Writer thread running {{(pid=86268) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 06 15:16:36 devstack cinder-volume[86268]: INFO cinder.rpc [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 06 15:16:36 devstack cinder-volume[86268]: INFO cinder.rpc [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 06 15:16:36 devstack cinder-volume[86268]: DEBUG oslo_db.sqlalchemy.engines [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86268) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 06 15:16:36 devstack cinder-volume[86268]: INFO cinder.volume.manager [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] Determined volume DB was empty at startup. Nov 06 15:16:36 devstack cinder-volume[86268]: DEBUG cinder.volume.manager [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86268) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 06 15:16:36 devstack cinder-volume[86268]: INFO cinder.volume.manager [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] Service not found for updating active_backend_id, assuming default for driver init. Nov 06 15:16:36 devstack cinder-volume[86268]: WARNING stevedore.named [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 15:16:36 devstack cinder-volume[86268]: WARNING castellan.key_manager [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 15:16:36 devstack cinder-volume[86268]: WARNING cinder.keymgr.conf_key_mgr [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 15:16:36 devstack cinder-volume[86268]: INFO cinder.volume.manager [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] Image-volume cache disabled for host devstack@QuobyteHD. Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_db.sqlalchemy.engines [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86268) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 06 15:16:37 devstack cinder-volume[86268]: INFO oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] Starting 1 workers Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] Started child 86485 {{(pid=86268) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] Full set of CONF: {{(pid=86268) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] ******************************************************************************** {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] Configuration options gathered from: {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] ================================================================================ {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] allow_availability_zone_fallback = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] allow_compression_on_image_upload = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] allowed_direct_url_schemes = [] {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] api_rate_limit = True {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] auth_strategy = keystone {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] backend_availability_zone = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] backend_host = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] backend_name = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] backend_stats_polling_interval = 60 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] backup_api_class = cinder.backup.api.API {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] backup_name_template = backup-%s {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] backup_use_same_host = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] backup_use_temp_snapshot = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] chap_password = **** {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] chap_username = {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] cinder_internal_tenant_project_id = cfb634951c074617950da95e524efb65 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] cinder_internal_tenant_user_id = e11d23170c0e467080dd79d856394138 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] cluster = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] compression_format = gzip {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] compute_api_class = cinder.compute.nova.API {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] config_dir = [] {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] config_source = [] {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] control_exchange = openstack {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] debug = True {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] default_availability_zone = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] default_group_type = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86485]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.1) Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] default_volume_type = QuobyteHD {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] disk_geometry = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] driver_client_cert = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] driver_client_cert_key = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] driver_data_namespace = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] driver_ssl_cert_path = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] driver_ssl_cert_verify = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] driver_use_ssl = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] enable_new_services = True {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] enable_unsupported_driver = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] enabled_backends = ['QuobyteHD'] {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] enforce_multipath_for_image_xfer = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] filter_function = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] glance_api_insecure = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] glance_api_servers = ['http://192.168.122.144/image'] {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] glance_api_ssl_compression = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] glance_ca_certificates_file = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] glance_catalog_info = image:glance:publicURL {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] glance_certfile = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] glance_keyfile = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] glance_num_retries = 3 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] glance_request_timeout = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] goodness_function = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] graceful_shutdown_timeout = 5 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] group_api_class = cinder.group.api.API {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] host = devstack {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] image_compress_on_upload = True {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] image_conversion_address_space_limit = 1 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] image_conversion_cpu_limit = 60 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] image_conversion_disable = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] image_introspection_address_space_limit = 1 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] image_introspection_cpu_limit = 60 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] image_upload_use_cinder_backend = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] image_upload_use_internal_tenant = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] image_volume_cache_enabled = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] image_volume_cache_max_count = 0 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] image_volume_cache_max_size_gb = 0 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] init_host_max_objects_retrieval = 0 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] instance_format = [instance: %(uuid)s] {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] iscsi_target_flags = {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] iscsi_write_cache = on {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] iser_helper = tgtadm {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] iser_ip_address = 192.168.122.144 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] iser_port = 3260 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] log_color = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] log_config_append = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] log_dir = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] log_file = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] log_options = True {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] log_rotate_interval = 1 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] log_rotate_interval_type = days {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] log_rotation_type = none {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] max_age = 0 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] max_logfile_count = 30 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] max_logfile_size_mb = 200 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] max_over_subscription_ratio = 20.0 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] message_reap_interval = 86400 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] message_ttl = 2592000 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] migration_create_volume_timeout_secs = 300 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] monkey_patch = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] monkey_patch_modules = [] {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] my_ip = 192.168.122.144 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] no_snapshot_gb_quota = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] num_iser_scan_tries = 3 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] num_shell_tries = 3 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] num_volume_device_scan_tries = 3 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] nvmeof_conn_info_version = 1 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] nvmet_ns_id = 10 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] nvmet_port_id = 1 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] osapi_max_limit = 1000 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] osapi_volume_ext_list = [] {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] osapi_volume_listen = 0.0.0.0 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] osapi_volume_listen_port = 8776 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] osapi_volume_use_ssl = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] osapi_volume_workers = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] per_volume_size_limit = -1 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] periodic_fuzzy_delay = 60 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] periodic_interval = 60 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] project_id_regex = [0-9a-f\-]+ {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] public_endpoint = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] publish_errors = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] quota_backup_gigabytes = 1000 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] quota_backups = 10 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] quota_gigabytes = 1000 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] quota_groups = 10 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] quota_snapshots = 10 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] quota_volumes = 10 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] rate_limit_burst = 0 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] rate_limit_except_level = CRITICAL {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] rate_limit_interval = 0 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] reinit_driver_count = 3 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] replication_device = **** {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] report_discard_supported = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] report_interval = 120 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] reservation_clean_interval = 86400 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] reservation_expire = 86400 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] reserved_image_namespaces = [] {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] reserved_percentage = 0 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] rpc_response_timeout = 120 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] run_external_periodic_tasks = True {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] scst_target_driver = iscsi {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] scst_target_iqn_name = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] service_down_time = 720 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] shell_completion = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] snapshot_name_template = snapshot-%s {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] split_loggers = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] state_path = /opt/stack/data/cinder {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] storage_availability_zone = nova {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] storage_protocol = iSCSI {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] syslog_log_facility = LOG_USER {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] target_helper = lioadm {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] target_ip_address = 192.168.122.144 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] target_port = 3260 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] target_protocol = iscsi {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] target_secondary_ip_addresses = [] {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] trace_flags = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] transfer_api_class = cinder.transfer.api.API {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] transport_url = **** {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] until_refresh = 0 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] use_chap_auth = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] use_default_quota_class = True {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] use_journal = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] use_json = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] use_multipath_for_image_xfer = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] use_stderr = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] use_syslog = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] verify_glance_signatures = enabled {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] volume_api_class = cinder.volume.api.API {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] volume_backend_name = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] volume_clear = zero {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] volume_clear_ionice = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] volume_clear_size = 0 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] volume_copy_bps_limit = 0 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] volume_dd_blocksize = 1M {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] volume_name_template = volume-%s {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] volume_service_inithost_offload = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] volume_usage_audit_period = month {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] zoning_mode = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] oslo_concurrency.disable_process_locking = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] keystone_authtoken.auth_section = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] keystone_authtoken.auth_type = password {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] keystone_authtoken.auth_version = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] keystone_authtoken.cache = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] keystone_authtoken.certfile = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86485]: INFO cinder.volume.manager [None req-62e5d7b6-7c97-4208-bb9a-fde08eb92eaa None None] Starting volume driver QuobyteDriver (1.2.1) Nov 06 15:16:37 devstack cinder-volume[86485]: DEBUG cinder.volume.drivers.remotefs [None req-62e5d7b6-7c97-4208-bb9a-fde08eb92eaa None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86485) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] keystone_authtoken.delay_auth_decision = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] keystone_authtoken.http_connect_timeout = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] keystone_authtoken.include_service_catalog = True {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] keystone_authtoken.insecure = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] keystone_authtoken.interface = public {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] keystone_authtoken.keyfile = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] keystone_authtoken.memcache_password = **** {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] keystone_authtoken.memcache_username = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] keystone_authtoken.region_name = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] keystone_authtoken.service_token_roles_required = True {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] keystone_authtoken.service_type = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] keystone_authtoken.token_cache_time = 300 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.144/identity {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] cache.backend = dogpile.cache.null {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] cache.backend_argument = **** {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] cache.backend_expiration_time = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] cache.config_prefix = cache.oslo {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] cache.debug_cache_backend = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] cache.enable_retry_client = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] cache.enable_socket_keepalive = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] cache.enabled = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] cache.expiration_time = 600 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] cache.hashclient_retry_attempts = 2 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] cache.memcache_dead_retry = 300 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] cache.memcache_pool_maxsize = 10 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] cache.memcache_sasl_enabled = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] cache.password = **** {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] cache.proxies = [] {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] cache.redis_db = 0 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] cache.redis_sentinel_service_name = mymaster {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] cache.redis_server = localhost:6379 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] cache.retry_attempts = 2 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] cache.retry_delay = 0.0 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] cache.socket_keepalive_count = 1 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] cache.socket_keepalive_idle = 1 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] cache.socket_keepalive_interval = 1 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] cache.socket_timeout = 1.0 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] cache.tls_allowed_ciphers = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] cache.tls_cafile = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] cache.tls_certfile = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] cache.tls_enabled = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] cache.tls_keyfile = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] cache.username = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] coordination.backend_url = **** {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] database.asyncio_connection = **** {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] database.asyncio_slave_connection = **** {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] database.backend = sqlalchemy {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] database.connection = **** {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] database.connection_debug = 0 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] database.connection_parameters = {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] database.connection_recycle_time = 3600 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] database.connection_trace = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] database.db_inc_retry_interval = True {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] database.db_max_retries = 20 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] database.db_max_retry_interval = 10 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] database.db_retry_interval = 1 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] database.max_overflow = 50 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] database.max_pool_size = 5 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] database.max_retries = 10 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] database.mysql_wsrep_sync_wait = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] database.pool_timeout = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] database.retry_interval = 10 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] database.slave_connection = **** {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] database.sqlite_synchronous = True {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] database.synchronous_reader = True {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] database.use_db_reconnect = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] oslo_messaging_tracing.insecure = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] profiler.connection_string = messaging:// {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] profiler.enabled = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] profiler.es_doc_type = notification {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] profiler.es_scroll_size = 10000 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] profiler.es_scroll_time = 2m {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] profiler.filter_error_trace = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] profiler.hmac_keys = **** {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] profiler.sentinel_service_name = mymaster {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] profiler.socket_timeout = 0.1 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] profiler.trace_requests = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] profiler.trace_sqlalchemy = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] profiler_jaeger.process_tags = {} {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] profiler_jaeger.service_name_prefix = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] profiler_otlp.service_name_prefix = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] oslo_policy.enforce_new_defaults = True {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] oslo_policy.policy_default_rule = default {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] oslo_policy.policy_file = policy.yaml {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] oslo_policy.remote_timeout = 60.0 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] privsep_osbrick.group = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] privsep_osbrick.helper_command = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] privsep_osbrick.user = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] cinder_sys_admin.group = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] cinder_sys_admin.helper_command = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] cinder_sys_admin.user = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] service_user.auth_section = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] service_user.auth_type = password {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] service_user.cafile = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] service_user.certfile = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] service_user.collect_timing = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] service_user.insecure = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] service_user.keyfile = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] service_user.send_service_user_token = True {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] service_user.split_loggers = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86485]: DEBUG cinder.volume.drivers.quobyte [None req-62e5d7b6-7c97-4208-bb9a-fde08eb92eaa None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86485) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Nov 06 15:16:37 devstack cinder-volume[86485]: WARNING cinder.volume.drivers.quobyte [None req-62e5d7b6-7c97-4208-bb9a-fde08eb92eaa None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Nov 06 15:16:37 devstack cinder-volume[86485]: WARNING cinder.volume.drivers.quobyte [None req-62e5d7b6-7c97-4208-bb9a-fde08eb92eaa None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] service_user.timeout = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] service_user.tls_ciphers = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] service_user.tls_min_version = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] glance.auth_section = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] glance.auth_type = password {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] glance.certfile = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] glance.collect_timing = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86485]: DEBUG oslo_concurrency.processutils [None req-62e5d7b6-7c97-4208-bb9a-fde08eb92eaa None None] Running cmd (subprocess): mount.quobyte {{(pid=86485) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] glance.insecure = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] glance.keyfile = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] glance.region_name = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] glance.split_loggers = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] glance.timeout = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] glance.tls_ciphers = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] glance.tls_min_version = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] backend_defaults.backend_availability_zone = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] backend_defaults.chap_password = **** {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] backend_defaults.chap_username = {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] backend_defaults.disk_geometry = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] backend_defaults.driver_client_cert = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] backend_defaults.driver_client_cert_key = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] backend_defaults.driver_data_namespace = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] backend_defaults.driver_use_ssl = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] backend_defaults.enable_unsupported_driver = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] backend_defaults.extra_capabilities = {} {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] backend_defaults.filter_function = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] backend_defaults.goodness_function = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] backend_defaults.iscsi_target_flags = {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] backend_defaults.iscsi_write_cache = on {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] backend_defaults.iser_helper = tgtadm {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] backend_defaults.iser_ip_address = 192.168.122.144 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] backend_defaults.iser_port = 3260 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] backend_defaults.nas_host = {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] backend_defaults.nas_login = admin {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] backend_defaults.nas_mount_options = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] backend_defaults.nas_password = **** {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] backend_defaults.nas_private_key = {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] backend_defaults.nas_share_path = {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] backend_defaults.nas_ssh_port = 22 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] backend_defaults.num_shell_tries = 3 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] backend_defaults.nvmet_port_id = 1 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] backend_defaults.quobyte_client_cfg = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] backend_defaults.quobyte_volume_url = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] backend_defaults.replication_device = **** {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] backend_defaults.report_discard_supported = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] backend_defaults.reserved_percentage = 0 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] backend_defaults.scst_target_driver = iscsi {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] backend_defaults.scst_target_iqn_name = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] backend_defaults.storage_protocol = iSCSI {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] backend_defaults.target_helper = tgtadm {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] backend_defaults.target_ip_address = 192.168.122.144 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] backend_defaults.target_port = 3260 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] backend_defaults.target_protocol = iscsi {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] backend_defaults.trace_flags = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] backend_defaults.unique_fqdn_network = True {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] backend_defaults.use_chap_auth = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] backend_defaults.volume_backend_name = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] backend_defaults.volume_clear = zero {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] backend_defaults.volume_clear_ionice = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] backend_defaults.volume_clear_size = 0 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] oslo_reports.file_event_handler = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] oslo_reports.log_dir = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] QuobyteHD.backend_availability_zone = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] QuobyteHD.backend_host = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] QuobyteHD.chap_password = **** {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] QuobyteHD.chap_username = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] QuobyteHD.chiscsi_conf = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] QuobyteHD.disk_geometry = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] QuobyteHD.driver_client_cert = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] QuobyteHD.driver_client_cert_key = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] QuobyteHD.driver_data_namespace = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] QuobyteHD.driver_use_ssl = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] QuobyteHD.extra_capabilities = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] QuobyteHD.filter_function = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] QuobyteHD.goodness_function = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] QuobyteHD.iscsi_target_flags = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] QuobyteHD.iscsi_write_cache = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] QuobyteHD.iser_helper = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] QuobyteHD.iser_ip_address = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] QuobyteHD.iser_port = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] QuobyteHD.iser_target_prefix = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] QuobyteHD.nas_host = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] QuobyteHD.nas_login = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] QuobyteHD.nas_mount_options = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] QuobyteHD.nas_password = **** {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] QuobyteHD.nas_private_key = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] QuobyteHD.nas_share_path = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] QuobyteHD.nas_ssh_port = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] QuobyteHD.num_shell_tries = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] QuobyteHD.nvmet_ns_id = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] QuobyteHD.nvmet_port_id = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] QuobyteHD.replication_device = **** {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] QuobyteHD.report_discard_supported = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] QuobyteHD.reserved_percentage = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] QuobyteHD.scst_target_driver = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] QuobyteHD.storage_protocol = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] QuobyteHD.target_helper = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] QuobyteHD.target_ip_address = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] QuobyteHD.target_port = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] QuobyteHD.target_prefix = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] QuobyteHD.target_protocol = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] QuobyteHD.trace_flags = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] QuobyteHD.unique_fqdn_network = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] QuobyteHD.use_chap_auth = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] QuobyteHD.volume_clear = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] QuobyteHD.volume_clear_ionice = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] QuobyteHD.volume_clear_size = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] QuobyteHD.volumes_dir = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] oslo_messaging_rabbit.ssl = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] oslo_messaging_rabbit.ssl_version = {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] oslo_messaging_notifications.driver = [] {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] oslo_messaging_notifications.retry = -1 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] oslo_messaging_notifications.transport_url = **** {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] key_manager.fixed_key = **** {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] barbican.barbican_api_version = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] barbican.barbican_endpoint = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] barbican.barbican_endpoint_type = public {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] barbican.barbican_region_name = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] barbican.cafile = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] barbican.certfile = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] barbican.collect_timing = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] barbican.insecure = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] barbican.keyfile = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] barbican.number_of_retries = 60 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] barbican.retry_delay = 1 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] barbican.send_service_user_token = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] barbican.split_loggers = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] barbican.timeout = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] barbican.tls_ciphers = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] barbican.tls_min_version = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] barbican.verify_ssl = True {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] barbican.verify_ssl_path = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] barbican_service_user.auth_section = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] barbican_service_user.auth_type = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] barbican_service_user.cafile = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] barbican_service_user.certfile = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] barbican_service_user.collect_timing = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] barbican_service_user.insecure = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] barbican_service_user.keyfile = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] barbican_service_user.split_loggers = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] barbican_service_user.timeout = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] barbican_service_user.tls_ciphers = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack quobyte-client[86486]: Reading configuration file: /etc/quobyte/client.cfg Nov 06 15:16:37 devstack quobyte-client[86486]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] barbican_service_user.tls_min_version = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] vault.approle_role_id = **** {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] vault.approle_secret_id = **** {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] vault.auth_method = approle {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] vault.auth_path = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] vault.kv_mountpoint = secret {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] vault.kv_path = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] vault.kv_version = 2 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] vault.namespace = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] vault.root_token_id = **** {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] vault.ssl_ca_crt_file = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] vault.timeout = 60.0 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] vault.token_file = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] vault.token_role = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] vault.use_ssl = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:37 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] ******************************************************************************** {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 06 15:16:37 devstack cinder-volume[86485]: DEBUG oslo_concurrency.processutils [None req-62e5d7b6-7c97-4208-bb9a-fde08eb92eaa None None] CMD "mount.quobyte" returned: 1 in 0.146s {{(pid=86485) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:16:37 devstack cinder-volume[86485]: DEBUG oslo_concurrency.lockutils [None req-62e5d7b6-7c97-4208-bb9a-fde08eb92eaa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86485) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:16:37 devstack cinder-volume[86485]: DEBUG oslo_concurrency.lockutils [None req-62e5d7b6-7c97-4208-bb9a-fde08eb92eaa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86485) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:16:37 devstack cinder-volume[86485]: DEBUG cinder.volume.drivers.quobyte [None req-62e5d7b6-7c97-4208-bb9a-fde08eb92eaa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=86485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:16:37 devstack cinder-volume[86485]: INFO cinder.volume.drivers.quobyte [None req-62e5d7b6-7c97-4208-bb9a-fde08eb92eaa None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b ... Nov 06 15:16:37 devstack cinder-volume[86485]: DEBUG oslo_concurrency.processutils [None req-62e5d7b6-7c97-4208-bb9a-fde08eb92eaa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 -c /etc/quobyte/client-cinder.cfg {{(pid=86485) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:16:37 devstack sudo[86489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 -c /etc/quobyte/client-cinder.cfg Nov 06 15:16:37 devstack sudo[86489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:16:37 devstack sudo[86489]: pam_unix(sudo:session): session closed for user root Nov 06 15:16:37 devstack cinder-volume[86485]: DEBUG oslo_concurrency.processutils [None req-62e5d7b6-7c97-4208-bb9a-fde08eb92eaa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.421s {{(pid=86485) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:16:37 devstack cinder-volume[86485]: INFO cinder.volume.drivers.quobyte [None req-62e5d7b6-7c97-4208-bb9a-fde08eb92eaa None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b succeeded Nov 06 15:16:38 devstack cinder-volume[86485]: DEBUG cinder.volume.drivers.quobyte [None req-62e5d7b6-7c97-4208-bb9a-fde08eb92eaa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=86485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:16:38 devstack cinder-volume[86485]: DEBUG oslo_concurrency.lockutils [None req-62e5d7b6-7c97-4208-bb9a-fde08eb92eaa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.438s {{(pid=86485) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:16:38 devstack cinder-volume[86485]: DEBUG oslo_concurrency.processutils [None req-62e5d7b6-7c97-4208-bb9a-fde08eb92eaa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=86485) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:16:38 devstack sudo[86593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:16:38 devstack sudo[86593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:16:38 devstack sudo[86593]: pam_unix(sudo:session): session closed for user root Nov 06 15:16:38 devstack cinder-volume[86485]: DEBUG oslo_concurrency.processutils [None req-62e5d7b6-7c97-4208-bb9a-fde08eb92eaa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.253s {{(pid=86485) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:16:38 devstack cinder-volume[86485]: INFO cinder.volume.driver [None req-62e5d7b6-7c97-4208-bb9a-fde08eb92eaa None None] Driver hasn't implemented _init_vendor_properties() Nov 06 15:16:38 devstack cinder-volume[86485]: DEBUG cinder.volume.driver [None req-62e5d7b6-7c97-4208-bb9a-fde08eb92eaa None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.3725776672363, 'free_capacity_gb': 1773.3725776672363, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86485) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 06 15:16:38 devstack cinder-volume[86485]: DEBUG oslo_db.sqlalchemy.engines [None req-62e5d7b6-7c97-4208-bb9a-fde08eb92eaa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86485) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 06 15:16:38 devstack cinder-volume[86485]: DEBUG dbcounter [-] [86485] Writer thread running {{(pid=86485) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 06 15:16:38 devstack cinder-volume[86485]: DEBUG cinder.db.api [None req-62e5d7b6-7c97-4208-bb9a-fde08eb92eaa None None] Building query based on filter {{(pid=86485) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Nov 06 15:16:38 devstack cinder-volume[86485]: DEBUG cinder.image.image_utils [None req-62e5d7b6-7c97-4208-bb9a-fde08eb92eaa None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86485) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Nov 06 15:16:38 devstack cinder-volume[86485]: INFO cinder.keymgr.migration [None req-31f796b2-02e5-498e-bf94-867a6ec0ff72 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 06 15:16:38 devstack cinder-volume[86485]: DEBUG oslo_concurrency.lockutils [None req-62e5d7b6-7c97-4208-bb9a-fde08eb92eaa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86485) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:16:38 devstack cinder-volume[86485]: DEBUG oslo_concurrency.lockutils [None req-62e5d7b6-7c97-4208-bb9a-fde08eb92eaa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86485) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:16:38 devstack cinder-volume[86485]: DEBUG cinder.volume.drivers.quobyte [None req-62e5d7b6-7c97-4208-bb9a-fde08eb92eaa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=86485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:16:38 devstack cinder-volume[86485]: DEBUG cinder.volume.drivers.quobyte [None req-62e5d7b6-7c97-4208-bb9a-fde08eb92eaa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=86485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:16:38 devstack cinder-volume[86485]: DEBUG oslo_concurrency.lockutils [None req-62e5d7b6-7c97-4208-bb9a-fde08eb92eaa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86485) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:16:38 devstack cinder-volume[86485]: DEBUG oslo_concurrency.processutils [None req-62e5d7b6-7c97-4208-bb9a-fde08eb92eaa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=86485) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:16:38 devstack sudo[86597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:16:38 devstack sudo[86597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:16:38 devstack sudo[86597]: pam_unix(sudo:session): session closed for user root Nov 06 15:16:38 devstack cinder-volume[86485]: DEBUG oslo_concurrency.processutils [None req-62e5d7b6-7c97-4208-bb9a-fde08eb92eaa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.237s {{(pid=86485) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:16:38 devstack cinder-volume[86485]: DEBUG cinder.manager [None req-62e5d7b6-7c97-4208-bb9a-fde08eb92eaa None None] Notifying Schedulers of capabilities ... {{(pid=86485) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:16:38 devstack cinder-volume[86485]: INFO cinder.volume.manager [None req-62e5d7b6-7c97-4208-bb9a-fde08eb92eaa None None] Driver initialization completed successfully. Nov 06 15:16:38 devstack cinder-volume[86485]: INFO cinder.manager [None req-62e5d7b6-7c97-4208-bb9a-fde08eb92eaa None None] Initiating service 3 cleanup Nov 06 15:16:38 devstack cinder-volume[86485]: INFO cinder.manager [None req-62e5d7b6-7c97-4208-bb9a-fde08eb92eaa None None] Service 3 cleanup completed. Nov 06 15:16:38 devstack cinder-volume[86485]: DEBUG cinder.service [None req-62e5d7b6-7c97-4208-bb9a-fde08eb92eaa None None] Creating RPC server for service cinder-volume {{(pid=86485) start /opt/stack/cinder/cinder/service.py:231}} Nov 06 15:16:38 devstack cinder-volume[86485]: DEBUG cinder.service [None req-62e5d7b6-7c97-4208-bb9a-fde08eb92eaa None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86485) start /opt/stack/cinder/cinder/service.py:237}} Nov 06 15:16:38 devstack cinder-volume[86485]: INFO cinder.volume.manager [None req-62e5d7b6-7c97-4208-bb9a-fde08eb92eaa None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Nov 06 15:16:38 devstack cinder-volume[86485]: DEBUG oslo_concurrency.lockutils [None req-62e5d7b6-7c97-4208-bb9a-fde08eb92eaa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86485) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:16:38 devstack cinder-volume[86485]: DEBUG oslo_concurrency.lockutils [None req-62e5d7b6-7c97-4208-bb9a-fde08eb92eaa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86485) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:16:38 devstack cinder-volume[86485]: DEBUG cinder.volume.drivers.quobyte [None req-62e5d7b6-7c97-4208-bb9a-fde08eb92eaa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=86485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:16:38 devstack cinder-volume[86485]: DEBUG cinder.volume.drivers.quobyte [None req-62e5d7b6-7c97-4208-bb9a-fde08eb92eaa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=86485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:16:38 devstack cinder-volume[86485]: DEBUG oslo_concurrency.lockutils [None req-62e5d7b6-7c97-4208-bb9a-fde08eb92eaa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86485) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:16:38 devstack cinder-volume[86485]: DEBUG oslo_concurrency.processutils [None req-62e5d7b6-7c97-4208-bb9a-fde08eb92eaa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=86485) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:16:38 devstack sudo[86600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:16:38 devstack sudo[86600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:16:39 devstack sudo[86600]: pam_unix(sudo:session): session closed for user root Nov 06 15:16:39 devstack cinder-volume[86485]: DEBUG oslo_concurrency.processutils [None req-62e5d7b6-7c97-4208-bb9a-fde08eb92eaa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.249s {{(pid=86485) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:16:39 devstack cinder-volume[86485]: INFO cinder.volume.manager [None req-62e5d7b6-7c97-4208-bb9a-fde08eb92eaa None None] Driver post RPC initialization completed successfully. Nov 06 15:16:43 devstack cinder-volume[86485]: DEBUG oslo_concurrency.lockutils [None req-b43db234-5a12-48ae-ba8f-57204be76672 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86485) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:16:43 devstack cinder-volume[86485]: DEBUG oslo_concurrency.lockutils [None req-b43db234-5a12-48ae-ba8f-57204be76672 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86485) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:16:43 devstack cinder-volume[86485]: DEBUG cinder.volume.drivers.quobyte [None req-b43db234-5a12-48ae-ba8f-57204be76672 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=86485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:16:43 devstack cinder-volume[86485]: DEBUG cinder.volume.drivers.quobyte [None req-b43db234-5a12-48ae-ba8f-57204be76672 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=86485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:16:43 devstack cinder-volume[86485]: DEBUG oslo_concurrency.lockutils [None req-b43db234-5a12-48ae-ba8f-57204be76672 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86485) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:16:43 devstack cinder-volume[86485]: DEBUG oslo_concurrency.processutils [None req-b43db234-5a12-48ae-ba8f-57204be76672 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=86485) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:16:43 devstack sudo[86756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:16:43 devstack sudo[86756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:16:43 devstack sudo[86756]: pam_unix(sudo:session): session closed for user root Nov 06 15:16:43 devstack cinder-volume[86485]: DEBUG oslo_concurrency.processutils [None req-b43db234-5a12-48ae-ba8f-57204be76672 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.252s {{(pid=86485) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:16:43 devstack cinder-volume[86485]: DEBUG cinder.manager [None req-b43db234-5a12-48ae-ba8f-57204be76672 None None] Notifying Schedulers of capabilities ... {{(pid=86485) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:16:44 devstack cinder-volume[86268]: INFO oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] Caught SIGTERM, stopping children Nov 06 15:16:44 devstack cinder-volume[86268]: DEBUG oslo_concurrency.lockutils [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] Acquiring lock "singleton_lock" {{(pid=86268) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 06 15:16:44 devstack cinder-volume[86268]: DEBUG oslo_concurrency.lockutils [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] Acquired lock "singleton_lock" {{(pid=86268) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 06 15:16:44 devstack cinder-volume[86268]: DEBUG oslo_concurrency.lockutils [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] Releasing lock "singleton_lock" {{(pid=86268) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 06 15:16:44 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] Stop services. {{(pid=86268) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Nov 06 15:16:44 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] Killing children. {{(pid=86268) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Nov 06 15:16:44 devstack cinder-volume[86268]: INFO oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] Waiting on 1 children to exit Nov 06 15:16:47 devstack cinder-volume[86485]: DEBUG oslo_concurrency.lockutils [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] Acquiring lock "singleton_lock" {{(pid=86485) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 06 15:16:47 devstack cinder-volume[86485]: DEBUG oslo_concurrency.lockutils [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] Acquired lock "singleton_lock" {{(pid=86485) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 06 15:16:47 devstack cinder-volume[86485]: DEBUG oslo_concurrency.lockutils [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] Releasing lock "singleton_lock" {{(pid=86485) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 06 15:16:47 devstack cinder-volume[86485]: WARNING amqp [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 06 15:16:47 devstack cinder-volume[86485]: WARNING amqp [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 06 15:16:47 devstack cinder-volume[86268]: INFO oslo_service.backend._eventlet.service [None req-c5296de7-6d74-4868-950b-329ace81a54c None None] Child 86485 exited with status 0 Nov 06 15:16:47 devstack cinder-volume[86837]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 06 15:16:47 devstack cinder-volume[86837]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 06 15:16:47 devstack cinder-volume[86837]: we strongly recommend against using it for new projects. Nov 06 15:16:47 devstack cinder-volume[86837]: If you are already using Eventlet, we recommend migrating to a different Nov 06 15:16:47 devstack cinder-volume[86837]: framework. For more detail see Nov 06 15:16:47 devstack cinder-volume[86837]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 06 15:16:47 devstack cinder-volume[86837]: import eventlet # noqa Nov 06 15:16:50 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86837) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 06 15:16:50 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86837) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 06 15:16:50 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86837) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 06 15:16:51 devstack cinder-volume[86837]: INFO dbcounter [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] Registered counter for database cinder Nov 06 15:16:51 devstack cinder-volume[86837]: DEBUG oslo_db.sqlalchemy.engines [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86837) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG dbcounter [-] [86837] Writer thread running {{(pid=86837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 06 15:16:52 devstack cinder-volume[86837]: INFO cinder.rpc [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 06 15:16:52 devstack cinder-volume[86837]: INFO cinder.rpc [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_db.sqlalchemy.engines [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86837) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 06 15:16:52 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] Determined volume DB was empty at startup. Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86837) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 06 15:16:52 devstack cinder-volume[86837]: WARNING stevedore.named [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 15:16:52 devstack cinder-volume[86837]: WARNING castellan.key_manager [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 15:16:52 devstack cinder-volume[86837]: WARNING cinder.keymgr.conf_key_mgr [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 15:16:52 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] Image-volume cache disabled for host devstack@QuobyteHD. Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_db.sqlalchemy.engines [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86837) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 06 15:16:52 devstack cinder-volume[86837]: INFO oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] Starting 1 workers Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] Started child 87132 {{(pid=86837) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] Full set of CONF: {{(pid=86837) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] ******************************************************************************** {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] Configuration options gathered from: {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] ================================================================================ {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] allow_availability_zone_fallback = False {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] allow_compression_on_image_upload = False {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] allowed_direct_url_schemes = [] {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] api_rate_limit = True {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] auth_strategy = keystone {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] backend_availability_zone = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] backend_host = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] backend_name = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[87132]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.1) Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] backend_stats_polling_interval = 60 {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] backup_api_class = cinder.backup.api.API {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] backup_name_template = backup-%s {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] backup_use_same_host = False {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] backup_use_temp_snapshot = False {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] chap_password = **** {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] chap_username = {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] cinder_internal_tenant_project_id = cfb634951c074617950da95e524efb65 {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] cinder_internal_tenant_user_id = e11d23170c0e467080dd79d856394138 {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] cluster = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] compression_format = gzip {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] compute_api_class = cinder.compute.nova.API {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] config_dir = [] {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] config_source = [] {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] control_exchange = openstack {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] debug = True {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] default_availability_zone = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] default_group_type = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] default_volume_type = QuobyteHD {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] disk_geometry = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] driver_client_cert = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] driver_client_cert_key = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] driver_data_namespace = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] driver_ssl_cert_path = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] driver_ssl_cert_verify = False {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] driver_use_ssl = False {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] enable_new_services = True {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] enable_unsupported_driver = False {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] enabled_backends = ['QuobyteHD'] {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] enforce_multipath_for_image_xfer = False {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] filter_function = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] glance_api_insecure = False {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] glance_api_servers = ['http://192.168.122.144/image'] {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] glance_api_ssl_compression = False {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] glance_ca_certificates_file = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] glance_catalog_info = image:glance:publicURL {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] glance_certfile = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] glance_keyfile = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] glance_num_retries = 3 {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] glance_request_timeout = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] goodness_function = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] graceful_shutdown_timeout = 5 {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] group_api_class = cinder.group.api.API {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] host = devstack {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] image_compress_on_upload = True {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] image_conversion_address_space_limit = 1 {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] image_conversion_cpu_limit = 60 {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] image_conversion_disable = False {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] image_introspection_address_space_limit = 1 {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] image_introspection_cpu_limit = 60 {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] image_upload_use_cinder_backend = False {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] image_upload_use_internal_tenant = False {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] image_volume_cache_enabled = False {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] image_volume_cache_max_count = 0 {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] image_volume_cache_max_size_gb = 0 {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] init_host_max_objects_retrieval = 0 {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] instance_format = [instance: %(uuid)s] {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] iscsi_target_flags = {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] iscsi_write_cache = on {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] iser_helper = tgtadm {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] iser_ip_address = 192.168.122.144 {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] iser_port = 3260 {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] log_color = False {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] log_config_append = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] log_dir = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] log_file = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] log_options = True {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] log_rotate_interval = 1 {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] log_rotate_interval_type = days {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] log_rotation_type = none {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] max_age = 0 {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] max_logfile_count = 30 {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] max_logfile_size_mb = 200 {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] max_over_subscription_ratio = 20.0 {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] message_reap_interval = 86400 {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] message_ttl = 2592000 {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] migration_create_volume_timeout_secs = 300 {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] monkey_patch = False {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] monkey_patch_modules = [] {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] my_ip = 192.168.122.144 {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] no_snapshot_gb_quota = False {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] num_iser_scan_tries = 3 {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] num_shell_tries = 3 {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] num_volume_device_scan_tries = 3 {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] nvmeof_conn_info_version = 1 {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] nvmet_ns_id = 10 {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] nvmet_port_id = 1 {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] osapi_max_limit = 1000 {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] osapi_volume_ext_list = [] {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] osapi_volume_listen_port = 8776 {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] osapi_volume_use_ssl = False {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] osapi_volume_workers = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] per_volume_size_limit = -1 {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-63fd2537-0ea0-472b-9688-04269c09f93c None None] Starting volume driver QuobyteDriver (1.2.1) Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] periodic_fuzzy_delay = 60 {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] periodic_interval = 60 {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] public_endpoint = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] publish_errors = False {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] quota_backup_gigabytes = 1000 {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] quota_backups = 10 {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-63fd2537-0ea0-472b-9688-04269c09f93c None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87132) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] quota_gigabytes = 1000 {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] quota_groups = 10 {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] quota_snapshots = 10 {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] quota_volumes = 10 {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] rate_limit_burst = 0 {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] rate_limit_except_level = CRITICAL {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] rate_limit_interval = 0 {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] reinit_driver_count = 3 {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] replication_device = **** {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] report_discard_supported = False {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] report_interval = 120 {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] reservation_clean_interval = 86400 {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] reservation_expire = 86400 {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] reserved_image_namespaces = [] {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] reserved_percentage = 0 {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] rpc_response_timeout = 120 {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] run_external_periodic_tasks = True {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] scst_target_driver = iscsi {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] scst_target_iqn_name = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] service_down_time = 720 {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] shell_completion = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] snapshot_name_template = snapshot-%s {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] split_loggers = False {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] state_path = /opt/stack/data/cinder {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] storage_availability_zone = nova {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] storage_protocol = iSCSI {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] syslog_log_facility = LOG_USER {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] target_helper = lioadm {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] target_ip_address = 192.168.122.144 {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] target_port = 3260 {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] target_protocol = iscsi {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] target_secondary_ip_addresses = [] {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] trace_flags = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] transport_url = **** {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] until_refresh = 0 {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] use_chap_auth = False {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] use_default_quota_class = True {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] use_journal = False {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] use_json = False {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] use_multipath_for_image_xfer = False {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] use_stderr = False {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] use_syslog = False {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] verify_glance_signatures = enabled {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] volume_api_class = cinder.volume.api.API {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] volume_backend_name = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] volume_clear = zero {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] volume_clear_ionice = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] volume_clear_size = 0 {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] volume_copy_bps_limit = 0 {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] volume_dd_blocksize = 1M {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] volume_name_template = volume-%s {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] volume_service_inithost_offload = False {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] volume_usage_audit_period = month {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] zoning_mode = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] oslo_concurrency.disable_process_locking = False {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] keystone_authtoken.auth_section = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] keystone_authtoken.auth_type = password {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] keystone_authtoken.auth_version = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] keystone_authtoken.cache = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] keystone_authtoken.certfile = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] keystone_authtoken.include_service_catalog = True {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] keystone_authtoken.insecure = False {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] keystone_authtoken.interface = public {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] keystone_authtoken.keyfile = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] keystone_authtoken.memcache_password = **** {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] keystone_authtoken.memcache_username = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] keystone_authtoken.region_name = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] keystone_authtoken.service_type = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.144/identity {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] cache.backend = dogpile.cache.null {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] cache.backend_argument = **** {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] cache.backend_expiration_time = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] cache.config_prefix = cache.oslo {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] cache.debug_cache_backend = False {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] cache.enable_retry_client = False {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] cache.enable_socket_keepalive = False {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] cache.enabled = False {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] cache.expiration_time = 600 {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] cache.hashclient_retry_attempts = 2 {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] cache.memcache_dead_retry = 300 {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] cache.memcache_pool_maxsize = 10 {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] cache.memcache_sasl_enabled = False {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] cache.password = **** {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] cache.proxies = [] {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] cache.redis_db = 0 {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] cache.redis_server = localhost:6379 {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] cache.retry_attempts = 2 {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] cache.retry_delay = 0.0 {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] cache.socket_keepalive_count = 1 {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] cache.socket_keepalive_idle = 1 {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] cache.socket_keepalive_interval = 1 {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] cache.socket_timeout = 1.0 {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] cache.tls_allowed_ciphers = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] cache.tls_cafile = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] cache.tls_certfile = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] cache.tls_enabled = False {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] cache.tls_keyfile = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] cache.username = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] coordination.backend_url = **** {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] database.asyncio_connection = **** {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] database.asyncio_slave_connection = **** {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] database.backend = sqlalchemy {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] database.connection = **** {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] database.connection_debug = 0 {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] database.connection_parameters = {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-63fd2537-0ea0-472b-9688-04269c09f93c None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87132) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] database.connection_recycle_time = 3600 {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] database.connection_trace = False {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] database.db_inc_retry_interval = True {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] database.db_max_retries = 20 {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] database.db_max_retry_interval = 10 {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] database.db_retry_interval = 1 {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.quobyte [None req-63fd2537-0ea0-472b-9688-04269c09f93c None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] database.max_overflow = 50 {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.quobyte [None req-63fd2537-0ea0-472b-9688-04269c09f93c None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] database.max_pool_size = 5 {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] database.max_retries = 10 {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] database.mysql_wsrep_sync_wait = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-63fd2537-0ea0-472b-9688-04269c09f93c None None] Running cmd (subprocess): mount.quobyte {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] database.pool_timeout = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] database.retry_interval = 10 {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] database.slave_connection = **** {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] database.sqlite_synchronous = True {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] database.synchronous_reader = True {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] database.use_db_reconnect = False {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] oslo_messaging_tracing.insecure = False {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] profiler.connection_string = messaging:// {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] profiler.enabled = False {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] profiler.es_doc_type = notification {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] profiler.es_scroll_size = 10000 {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] profiler.es_scroll_time = 2m {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] profiler.filter_error_trace = False {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] profiler.hmac_keys = **** {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] profiler.sentinel_service_name = mymaster {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] profiler.socket_timeout = 0.1 {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] profiler.trace_requests = False {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] profiler.trace_sqlalchemy = False {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] profiler_jaeger.process_tags = {} {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] profiler_jaeger.service_name_prefix = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] profiler_otlp.service_name_prefix = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] oslo_policy.enforce_new_defaults = True {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] oslo_policy.policy_default_rule = default {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] oslo_policy.policy_file = policy.yaml {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] privsep_osbrick.group = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] privsep_osbrick.helper_command = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] privsep_osbrick.user = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] cinder_sys_admin.group = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] cinder_sys_admin.helper_command = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] cinder_sys_admin.user = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] service_user.auth_section = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] service_user.auth_type = password {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] service_user.cafile = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] service_user.certfile = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] service_user.collect_timing = False {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] service_user.insecure = False {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] service_user.keyfile = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] service_user.send_service_user_token = True {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] service_user.split_loggers = False {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] service_user.timeout = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] service_user.tls_ciphers = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] service_user.tls_min_version = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] glance.auth_section = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] glance.auth_type = password {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] glance.certfile = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] glance.collect_timing = False {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] glance.insecure = False {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] glance.keyfile = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] glance.region_name = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] glance.split_loggers = False {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] glance.timeout = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] glance.tls_ciphers = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] glance.tls_min_version = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] backend_defaults.backend_availability_zone = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] backend_defaults.chap_password = **** {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] backend_defaults.chap_username = {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] backend_defaults.disk_geometry = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] backend_defaults.driver_client_cert = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] backend_defaults.driver_client_cert_key = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] backend_defaults.driver_data_namespace = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] backend_defaults.driver_use_ssl = False {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] backend_defaults.extra_capabilities = {} {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] backend_defaults.filter_function = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] backend_defaults.goodness_function = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] backend_defaults.iscsi_target_flags = {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] backend_defaults.iscsi_write_cache = on {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] backend_defaults.iser_helper = tgtadm {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] backend_defaults.iser_ip_address = 192.168.122.144 {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] backend_defaults.iser_port = 3260 {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] backend_defaults.nas_host = {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] backend_defaults.nas_login = admin {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] backend_defaults.nas_mount_options = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] backend_defaults.nas_password = **** {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] backend_defaults.nas_private_key = {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] backend_defaults.nas_share_path = {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] backend_defaults.num_shell_tries = 3 {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] backend_defaults.quobyte_volume_url = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] backend_defaults.replication_device = **** {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] backend_defaults.report_discard_supported = False {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] backend_defaults.reserved_percentage = 0 {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] backend_defaults.target_helper = tgtadm {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] backend_defaults.target_ip_address = 192.168.122.144 {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] backend_defaults.target_port = 3260 {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] backend_defaults.target_protocol = iscsi {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] backend_defaults.trace_flags = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] backend_defaults.unique_fqdn_network = True {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] backend_defaults.use_chap_auth = False {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] backend_defaults.volume_backend_name = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] backend_defaults.volume_clear = zero {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] backend_defaults.volume_clear_ionice = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] backend_defaults.volume_clear_size = 0 {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack quobyte-client[87137]: Reading configuration file: /etc/quobyte/client.cfg Nov 06 15:16:52 devstack quobyte-client[87137]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] oslo_reports.file_event_handler = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] oslo_reports.log_dir = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] QuobyteHD.backend_availability_zone = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] QuobyteHD.backend_host = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-63fd2537-0ea0-472b-9688-04269c09f93c None None] CMD "mount.quobyte" returned: 1 in 0.076s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:16:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-63fd2537-0ea0-472b-9688-04269c09f93c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:16:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-63fd2537-0ea0-472b-9688-04269c09f93c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:16:52 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-63fd2537-0ea0-472b-9688-04269c09f93c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] QuobyteHD.chap_password = **** {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] QuobyteHD.chap_username = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] QuobyteHD.chiscsi_conf = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] QuobyteHD.disk_geometry = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] QuobyteHD.driver_client_cert = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] QuobyteHD.driver_data_namespace = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] QuobyteHD.driver_use_ssl = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] QuobyteHD.extra_capabilities = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] QuobyteHD.filter_function = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] QuobyteHD.goodness_function = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] QuobyteHD.iser_helper = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] QuobyteHD.iser_ip_address = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] QuobyteHD.iser_port = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-63fd2537-0ea0-472b-9688-04269c09f93c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] QuobyteHD.iser_target_prefix = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-63fd2537-0ea0-472b-9688-04269c09f93c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] QuobyteHD.nas_host = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] QuobyteHD.nas_login = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-63fd2537-0ea0-472b-9688-04269c09f93c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] QuobyteHD.nas_mount_options = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] QuobyteHD.nas_password = **** {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] QuobyteHD.nas_private_key = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] QuobyteHD.nas_share_path = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] QuobyteHD.nas_ssh_port = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] QuobyteHD.num_shell_tries = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] QuobyteHD.nvmet_port_id = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] QuobyteHD.replication_device = **** {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] QuobyteHD.report_discard_supported = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] QuobyteHD.reserved_percentage = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] QuobyteHD.scst_target_driver = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] QuobyteHD.storage_protocol = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] QuobyteHD.target_helper = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] QuobyteHD.target_ip_address = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] QuobyteHD.target_port = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] QuobyteHD.target_prefix = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] QuobyteHD.target_protocol = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] QuobyteHD.trace_flags = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] QuobyteHD.use_chap_auth = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] QuobyteHD.volume_clear = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] QuobyteHD.volume_clear_size = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] QuobyteHD.volumes_dir = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] oslo_messaging_rabbit.ssl = False {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] oslo_messaging_notifications.driver = [] {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] oslo_messaging_notifications.retry = -1 {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] key_manager.fixed_key = **** {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] barbican.barbican_api_version = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] barbican.barbican_endpoint = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] barbican.barbican_endpoint_type = public {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] barbican.barbican_region_name = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] barbican.cafile = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] barbican.certfile = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] barbican.collect_timing = False {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] barbican.insecure = False {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] barbican.keyfile = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] barbican.number_of_retries = 60 {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] barbican.retry_delay = 1 {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] barbican.send_service_user_token = False {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] barbican.split_loggers = False {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] barbican.timeout = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] barbican.tls_ciphers = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] barbican.tls_min_version = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] barbican.verify_ssl = True {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] barbican.verify_ssl_path = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack sudo[87144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] barbican_service_user.auth_section = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] barbican_service_user.auth_type = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] barbican_service_user.cafile = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] barbican_service_user.certfile = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] barbican_service_user.collect_timing = False {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] barbican_service_user.insecure = False {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] barbican_service_user.keyfile = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:52 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] barbican_service_user.split_loggers = False {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:53 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] barbican_service_user.timeout = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:53 devstack sudo[87144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:16:53 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] barbican_service_user.tls_ciphers = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:53 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] barbican_service_user.tls_min_version = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:53 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] vault.approle_role_id = **** {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:53 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] vault.approle_secret_id = **** {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:53 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] vault.auth_method = approle {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:53 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] vault.auth_path = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:53 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] vault.kv_mountpoint = secret {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:53 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] vault.kv_path = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:53 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] vault.kv_version = 2 {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:53 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] vault.namespace = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:53 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] vault.root_token_id = **** {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:53 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] vault.ssl_ca_crt_file = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:53 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] vault.timeout = 60.0 {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:53 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] vault.token_file = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:53 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] vault.token_role = None {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:53 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] vault.use_ssl = False {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:53 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 15:16:53 devstack cinder-volume[86837]: DEBUG oslo_service.backend._eventlet.service [None req-eb422d5b-81da-4cbf-a43f-059ad035bb74 None None] ******************************************************************************** {{(pid=86837) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 06 15:16:53 devstack sudo[87144]: pam_unix(sudo:session): session closed for user root Nov 06 15:16:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-63fd2537-0ea0-472b-9688-04269c09f93c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.278s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:16:53 devstack cinder-volume[87132]: INFO cinder.volume.driver [None req-63fd2537-0ea0-472b-9688-04269c09f93c None None] Driver hasn't implemented _init_vendor_properties() Nov 06 15:16:53 devstack cinder-volume[87132]: DEBUG cinder.volume.driver [None req-63fd2537-0ea0-472b-9688-04269c09f93c None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.3763389587402, 'free_capacity_gb': 1773.3763389587402, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87132) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 06 15:16:53 devstack cinder-volume[87132]: DEBUG oslo_db.sqlalchemy.engines [None req-63fd2537-0ea0-472b-9688-04269c09f93c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87132) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 06 15:16:53 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writer thread running {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 06 15:16:53 devstack cinder-volume[87132]: DEBUG cinder.db.api [None req-63fd2537-0ea0-472b-9688-04269c09f93c None None] Building query based on filter {{(pid=87132) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Nov 06 15:16:53 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-63fd2537-0ea0-472b-9688-04269c09f93c None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87132) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Nov 06 15:16:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-63fd2537-0ea0-472b-9688-04269c09f93c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:16:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-63fd2537-0ea0-472b-9688-04269c09f93c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:16:53 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-63fd2537-0ea0-472b-9688-04269c09f93c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:16:53 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-63fd2537-0ea0-472b-9688-04269c09f93c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:16:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-63fd2537-0ea0-472b-9688-04269c09f93c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:16:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-63fd2537-0ea0-472b-9688-04269c09f93c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:16:53 devstack cinder-volume[87132]: INFO cinder.keymgr.migration [None req-1df2c1a4-e83c-4506-8a4f-ba4ef5cffca6 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 06 15:16:53 devstack sudo[87148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:16:53 devstack sudo[87148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:16:53 devstack sudo[87148]: pam_unix(sudo:session): session closed for user root Nov 06 15:16:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-63fd2537-0ea0-472b-9688-04269c09f93c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.239s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:16:53 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-63fd2537-0ea0-472b-9688-04269c09f93c None None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:16:53 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-63fd2537-0ea0-472b-9688-04269c09f93c None None] Driver initialization completed successfully. Nov 06 15:16:53 devstack cinder-volume[87132]: INFO cinder.manager [None req-63fd2537-0ea0-472b-9688-04269c09f93c None None] Initiating service 3 cleanup Nov 06 15:16:53 devstack cinder-volume[87132]: INFO cinder.manager [None req-63fd2537-0ea0-472b-9688-04269c09f93c None None] Service 3 cleanup completed. Nov 06 15:16:53 devstack cinder-volume[87132]: DEBUG cinder.service [None req-63fd2537-0ea0-472b-9688-04269c09f93c None None] Creating RPC server for service cinder-volume {{(pid=87132) start /opt/stack/cinder/cinder/service.py:231}} Nov 06 15:16:53 devstack cinder-volume[87132]: DEBUG cinder.service [None req-63fd2537-0ea0-472b-9688-04269c09f93c None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87132) start /opt/stack/cinder/cinder/service.py:237}} Nov 06 15:16:53 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-63fd2537-0ea0-472b-9688-04269c09f93c None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Nov 06 15:16:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-63fd2537-0ea0-472b-9688-04269c09f93c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:16:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-63fd2537-0ea0-472b-9688-04269c09f93c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:16:53 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-63fd2537-0ea0-472b-9688-04269c09f93c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:16:53 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-63fd2537-0ea0-472b-9688-04269c09f93c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:16:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-63fd2537-0ea0-472b-9688-04269c09f93c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:16:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-63fd2537-0ea0-472b-9688-04269c09f93c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:16:53 devstack sudo[87158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:16:53 devstack sudo[87158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:16:53 devstack sudo[87158]: pam_unix(sudo:session): session closed for user root Nov 06 15:16:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-63fd2537-0ea0-472b-9688-04269c09f93c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.238s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:16:53 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-63fd2537-0ea0-472b-9688-04269c09f93c None None] Driver post RPC initialization completed successfully. Nov 06 15:17:02 devstack cinder-volume[86837]: DEBUG dbcounter [-] [86837] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 15:17:03 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 15:17:03 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:SELECT=3 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 15:17:07 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Running periodic task VolumeManager._thread_info {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 15:17:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] thread count: 6 {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 15:17:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] thread info: [<_MainThread(MainThread, started 140011251929216)>, , , , , ] {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 06 15:18:08 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 15:18:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:18:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:18:08 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:18:08 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:18:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.059s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:18:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:18:08 devstack sudo[87914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:18:08 devstack sudo[87914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:18:09 devstack sudo[87914]: pam_unix(sudo:session): session closed for user root Nov 06 15:18:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 1.260s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:18:09 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:18:09 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Running periodic task VolumeManager._thread_info {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 15:18:09 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] thread count: 6 {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 15:18:09 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] thread info: [<_MainThread(MainThread, started 140011251929216)>, , , , , ] {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 06 15:18:09 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5df9555-2f57-4dd4-9803-e5c0462f14ba tempest-DeleteServersTestJSON-1200191192 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:18:09 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a5df9555-2f57-4dd4-9803-e5c0462f14ba tempest-DeleteServersTestJSON-1200191192 None] Flow 'volume_create_manager' (5aea1aaf-798b-4ac3-9171-c32d68a72a6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:18:09 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a5df9555-2f57-4dd4-9803-e5c0462f14ba tempest-DeleteServersTestJSON-1200191192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df69b697-c08e-4afa-91f3-025dcaf57056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:18:10 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a5df9555-2f57-4dd4-9803-e5c0462f14ba tempest-DeleteServersTestJSON-1200191192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df69b697-c08e-4afa-91f3-025dcaf57056) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:18:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-703144871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42262111-cb6c-4b50-b3d1-4a6e80bd13f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f81bd37788a94a77b35a4bb37da263f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:18:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:18:09Z,use_quota=True,user_id='e64047db66de4d629d4aa4fb39cf5d33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:18:10 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a5df9555-2f57-4dd4-9803-e5c0462f14ba tempest-DeleteServersTestJSON-1200191192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3916d2a8-1a0d-4fb4-8771-9ba491fc9c9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:18:10 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a5df9555-2f57-4dd4-9803-e5c0462f14ba tempest-DeleteServersTestJSON-1200191192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3916d2a8-1a0d-4fb4-8771-9ba491fc9c9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:18:10 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a5df9555-2f57-4dd4-9803-e5c0462f14ba tempest-DeleteServersTestJSON-1200191192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bade52c5-ccaf-4a91-b12e-fae866f22305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:18:10 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a5df9555-2f57-4dd4-9803-e5c0462f14ba tempest-DeleteServersTestJSON-1200191192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bade52c5-ccaf-4a91-b12e-fae866f22305) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42262111-cb6c-4b50-b3d1-4a6e80bd13f8', 'volume_name': 'volume-42262111-cb6c-4b50-b3d1-4a6e80bd13f8', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:18:10 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a5df9555-2f57-4dd4-9803-e5c0462f14ba tempest-DeleteServersTestJSON-1200191192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a12807ea-bd29-4bb5-bb34-78a21e9ae895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:18:10 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a5df9555-2f57-4dd4-9803-e5c0462f14ba tempest-DeleteServersTestJSON-1200191192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a12807ea-bd29-4bb5-bb34-78a21e9ae895) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:18:10 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a5df9555-2f57-4dd4-9803-e5c0462f14ba tempest-DeleteServersTestJSON-1200191192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b93d1b56-63cf-4f20-bc8f-dc724aae1a67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:18:10 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-a5df9555-2f57-4dd4-9803-e5c0462f14ba tempest-DeleteServersTestJSON-1200191192 None] Volume 42262111-cb6c-4b50-b3d1-4a6e80bd13f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42262111-cb6c-4b50-b3d1-4a6e80bd13f8', 'volume_size': 1} Nov 06 15:18:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a5df9555-2f57-4dd4-9803-e5c0462f14ba tempest-DeleteServersTestJSON-1200191192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:18:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a5df9555-2f57-4dd4-9803-e5c0462f14ba tempest-DeleteServersTestJSON-1200191192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:18:10 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-a5df9555-2f57-4dd4-9803-e5c0462f14ba tempest-DeleteServersTestJSON-1200191192 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:18:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-703144871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42262111-cb6c-4b50-b3d1-4a6e80bd13f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f81bd37788a94a77b35a4bb37da263f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:18:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:18:09Z,use_quota=True,user_id='e64047db66de4d629d4aa4fb39cf5d33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:18:10 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-a5df9555-2f57-4dd4-9803-e5c0462f14ba tempest-DeleteServersTestJSON-1200191192 None] Creating volume 42262111-cb6c-4b50-b3d1-4a6e80bd13f8 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:18:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a5df9555-2f57-4dd4-9803-e5c0462f14ba tempest-DeleteServersTestJSON-1200191192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:18:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a5df9555-2f57-4dd4-9803-e5c0462f14ba tempest-DeleteServersTestJSON-1200191192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:18:10 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-a5df9555-2f57-4dd4-9803-e5c0462f14ba tempest-DeleteServersTestJSON-1200191192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:18:10 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-a5df9555-2f57-4dd4-9803-e5c0462f14ba tempest-DeleteServersTestJSON-1200191192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:18:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a5df9555-2f57-4dd4-9803-e5c0462f14ba tempest-DeleteServersTestJSON-1200191192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:18:10 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-a5df9555-2f57-4dd4-9803-e5c0462f14ba tempest-DeleteServersTestJSON-1200191192 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:18:10 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-a5df9555-2f57-4dd4-9803-e5c0462f14ba tempest-DeleteServersTestJSON-1200191192 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:18:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a5df9555-2f57-4dd4-9803-e5c0462f14ba tempest-DeleteServersTestJSON-1200191192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-42262111-cb6c-4b50-b3d1-4a6e80bd13f8 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:18:10 devstack sudo[87973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-42262111-cb6c-4b50-b3d1-4a6e80bd13f8 1073741824 Nov 06 15:18:10 devstack sudo[87973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:18:11 devstack sudo[87973]: pam_unix(sudo:session): session closed for user root Nov 06 15:18:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a5df9555-2f57-4dd4-9803-e5c0462f14ba tempest-DeleteServersTestJSON-1200191192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-42262111-cb6c-4b50-b3d1-4a6e80bd13f8 1073741824" returned: 0 in 1.337s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:18:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a5df9555-2f57-4dd4-9803-e5c0462f14ba tempest-DeleteServersTestJSON-1200191192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-42262111-cb6c-4b50-b3d1-4a6e80bd13f8 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:18:11 devstack sudo[88306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-42262111-cb6c-4b50-b3d1-4a6e80bd13f8 Nov 06 15:18:11 devstack sudo[88306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:18:11 devstack sudo[88306]: pam_unix(sudo:session): session closed for user root Nov 06 15:18:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a5df9555-2f57-4dd4-9803-e5c0462f14ba tempest-DeleteServersTestJSON-1200191192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-42262111-cb6c-4b50-b3d1-4a6e80bd13f8" returned: 0 in 0.367s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:18:11 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-a5df9555-2f57-4dd4-9803-e5c0462f14ba tempest-DeleteServersTestJSON-1200191192 None] <== create_volume: return (1790ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:18:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a5df9555-2f57-4dd4-9803-e5c0462f14ba tempest-DeleteServersTestJSON-1200191192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.795s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:18:11 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a5df9555-2f57-4dd4-9803-e5c0462f14ba tempest-DeleteServersTestJSON-1200191192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b93d1b56-63cf-4f20-bc8f-dc724aae1a67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42262111-cb6c-4b50-b3d1-4a6e80bd13f8', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:18:11 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a5df9555-2f57-4dd4-9803-e5c0462f14ba tempest-DeleteServersTestJSON-1200191192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3488c46-71b3-4070-aa96-f4659628d866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:18:12 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-a5df9555-2f57-4dd4-9803-e5c0462f14ba tempest-DeleteServersTestJSON-1200191192 None] Volume volume-42262111-cb6c-4b50-b3d1-4a6e80bd13f8 (42262111-cb6c-4b50-b3d1-4a6e80bd13f8): created successfully Nov 06 15:18:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a5df9555-2f57-4dd4-9803-e5c0462f14ba tempest-DeleteServersTestJSON-1200191192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3488c46-71b3-4070-aa96-f4659628d866) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:18:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a5df9555-2f57-4dd4-9803-e5c0462f14ba tempest-DeleteServersTestJSON-1200191192 None] Flow 'volume_create_manager' (5aea1aaf-798b-4ac3-9171-c32d68a72a6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:18:12 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-a5df9555-2f57-4dd4-9803-e5c0462f14ba tempest-DeleteServersTestJSON-1200191192 None] Created volume successfully. Nov 06 15:18:20 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7cb4d0d-15d0-4170-9832-afb85f399cc0 tempest-VolumesAdminNegativeTest-1564408745 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:18:20 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a7cb4d0d-15d0-4170-9832-afb85f399cc0 tempest-VolumesAdminNegativeTest-1564408745 None] Flow 'volume_create_manager' (631b2667-cb8b-4131-9ad9-c7b2a57a1789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:18:20 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a7cb4d0d-15d0-4170-9832-afb85f399cc0 tempest-VolumesAdminNegativeTest-1564408745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d3bb355-9676-425f-ab3d-60d97d9ed3f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:18:20 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a7cb4d0d-15d0-4170-9832-afb85f399cc0 tempest-VolumesAdminNegativeTest-1564408745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d3bb355-9676-425f-ab3d-60d97d9ed3f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:18:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-414455953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b14f55f4-c206-4a8a-b7f0-ab44a9858846,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='421ac8dbbd66408baffa4f98c4381ed7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:18:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:18:20Z,use_quota=True,user_id='831b0990420346d99c2bc1158e24fa5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:18:20 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a7cb4d0d-15d0-4170-9832-afb85f399cc0 tempest-VolumesAdminNegativeTest-1564408745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef045ab0-1a7b-40b0-814c-892f2eb9d92e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:18:20 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a7cb4d0d-15d0-4170-9832-afb85f399cc0 tempest-VolumesAdminNegativeTest-1564408745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef045ab0-1a7b-40b0-814c-892f2eb9d92e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:18:20 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a7cb4d0d-15d0-4170-9832-afb85f399cc0 tempest-VolumesAdminNegativeTest-1564408745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fad28d6d-cbfe-404c-a5c1-efe88670b7a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:18:20 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a7cb4d0d-15d0-4170-9832-afb85f399cc0 tempest-VolumesAdminNegativeTest-1564408745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fad28d6d-cbfe-404c-a5c1-efe88670b7a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b14f55f4-c206-4a8a-b7f0-ab44a9858846', 'volume_name': 'volume-b14f55f4-c206-4a8a-b7f0-ab44a9858846', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:18:20 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a7cb4d0d-15d0-4170-9832-afb85f399cc0 tempest-VolumesAdminNegativeTest-1564408745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38401e83-3d69-452b-863b-45a5bfbccbc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:18:20 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a7cb4d0d-15d0-4170-9832-afb85f399cc0 tempest-VolumesAdminNegativeTest-1564408745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38401e83-3d69-452b-863b-45a5bfbccbc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:18:20 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a7cb4d0d-15d0-4170-9832-afb85f399cc0 tempest-VolumesAdminNegativeTest-1564408745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7c5eb94-bb56-4817-a1ae-22f365fbd777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:18:20 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-a7cb4d0d-15d0-4170-9832-afb85f399cc0 tempest-VolumesAdminNegativeTest-1564408745 None] Volume b14f55f4-c206-4a8a-b7f0-ab44a9858846: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b14f55f4-c206-4a8a-b7f0-ab44a9858846', 'volume_size': 1} Nov 06 15:18:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a7cb4d0d-15d0-4170-9832-afb85f399cc0 tempest-VolumesAdminNegativeTest-1564408745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:18:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a7cb4d0d-15d0-4170-9832-afb85f399cc0 tempest-VolumesAdminNegativeTest-1564408745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:18:20 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-a7cb4d0d-15d0-4170-9832-afb85f399cc0 tempest-VolumesAdminNegativeTest-1564408745 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:18:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-414455953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b14f55f4-c206-4a8a-b7f0-ab44a9858846,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='421ac8dbbd66408baffa4f98c4381ed7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:18:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:18:20Z,use_quota=True,user_id='831b0990420346d99c2bc1158e24fa5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:18:20 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-a7cb4d0d-15d0-4170-9832-afb85f399cc0 tempest-VolumesAdminNegativeTest-1564408745 None] Creating volume b14f55f4-c206-4a8a-b7f0-ab44a9858846 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:18:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a7cb4d0d-15d0-4170-9832-afb85f399cc0 tempest-VolumesAdminNegativeTest-1564408745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:18:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a7cb4d0d-15d0-4170-9832-afb85f399cc0 tempest-VolumesAdminNegativeTest-1564408745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:18:20 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-a7cb4d0d-15d0-4170-9832-afb85f399cc0 tempest-VolumesAdminNegativeTest-1564408745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:18:20 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-a7cb4d0d-15d0-4170-9832-afb85f399cc0 tempest-VolumesAdminNegativeTest-1564408745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:18:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a7cb4d0d-15d0-4170-9832-afb85f399cc0 tempest-VolumesAdminNegativeTest-1564408745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:18:20 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-a7cb4d0d-15d0-4170-9832-afb85f399cc0 tempest-VolumesAdminNegativeTest-1564408745 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:18:20 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-a7cb4d0d-15d0-4170-9832-afb85f399cc0 tempest-VolumesAdminNegativeTest-1564408745 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:18:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a7cb4d0d-15d0-4170-9832-afb85f399cc0 tempest-VolumesAdminNegativeTest-1564408745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b14f55f4-c206-4a8a-b7f0-ab44a9858846 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:18:20 devstack cinder-volume[87132]: WARNING py.warnings [req-4596b64d-a08c-4899-bd0b-bfbc600b760c req-afbed953-f7ce-45ce-b3ea-2ff852c21b15 tempest-DeleteServersTestJSON-1200191192 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Nov 06 15:18:20 devstack cinder-volume[87132]: .first() Nov 06 15:18:20 devstack cinder-volume[87132]: Nov 06 15:18:20 devstack sudo[88469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b14f55f4-c206-4a8a-b7f0-ab44a9858846 1073741824 Nov 06 15:18:20 devstack sudo[88469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:18:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-4596b64d-a08c-4899-bd0b-bfbc600b760c req-afbed953-f7ce-45ce-b3ea-2ff852c21b15 tempest-DeleteServersTestJSON-1200191192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:18:21 devstack sudo[88469]: pam_unix(sudo:session): session closed for user root Nov 06 15:18:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a7cb4d0d-15d0-4170-9832-afb85f399cc0 tempest-VolumesAdminNegativeTest-1564408745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b14f55f4-c206-4a8a-b7f0-ab44a9858846 1073741824" returned: 0 in 0.761s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:18:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a7cb4d0d-15d0-4170-9832-afb85f399cc0 tempest-VolumesAdminNegativeTest-1564408745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b14f55f4-c206-4a8a-b7f0-ab44a9858846 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:18:21 devstack sudo[88499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b14f55f4-c206-4a8a-b7f0-ab44a9858846 Nov 06 15:18:21 devstack sudo[88499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:18:21 devstack sudo[88499]: pam_unix(sudo:session): session closed for user root Nov 06 15:18:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a7cb4d0d-15d0-4170-9832-afb85f399cc0 tempest-VolumesAdminNegativeTest-1564408745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b14f55f4-c206-4a8a-b7f0-ab44a9858846" returned: 0 in 0.429s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:18:21 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-a7cb4d0d-15d0-4170-9832-afb85f399cc0 tempest-VolumesAdminNegativeTest-1564408745 None] <== create_volume: return (1310ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:18:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a7cb4d0d-15d0-4170-9832-afb85f399cc0 tempest-VolumesAdminNegativeTest-1564408745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.315s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:18:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-4596b64d-a08c-4899-bd0b-bfbc600b760c req-afbed953-f7ce-45ce-b3ea-2ff852c21b15 tempest-DeleteServersTestJSON-1200191192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.202s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:18:22 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a7cb4d0d-15d0-4170-9832-afb85f399cc0 tempest-VolumesAdminNegativeTest-1564408745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7c5eb94-bb56-4817-a1ae-22f365fbd777) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b14f55f4-c206-4a8a-b7f0-ab44a9858846', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:18:22 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a7cb4d0d-15d0-4170-9832-afb85f399cc0 tempest-VolumesAdminNegativeTest-1564408745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (359d7243-8219-4e7e-ab12-e98350b3ae5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:18:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-4596b64d-a08c-4899-bd0b-bfbc600b760c req-afbed953-f7ce-45ce-b3ea-2ff852c21b15 tempest-DeleteServersTestJSON-1200191192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.181s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:18:22 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-a7cb4d0d-15d0-4170-9832-afb85f399cc0 tempest-VolumesAdminNegativeTest-1564408745 None] Volume volume-b14f55f4-c206-4a8a-b7f0-ab44a9858846 (b14f55f4-c206-4a8a-b7f0-ab44a9858846): created successfully Nov 06 15:18:22 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a7cb4d0d-15d0-4170-9832-afb85f399cc0 tempest-VolumesAdminNegativeTest-1564408745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (359d7243-8219-4e7e-ab12-e98350b3ae5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:18:22 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a7cb4d0d-15d0-4170-9832-afb85f399cc0 tempest-VolumesAdminNegativeTest-1564408745 None] Flow 'volume_create_manager' (631b2667-cb8b-4131-9ad9-c7b2a57a1789) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:18:22 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-a7cb4d0d-15d0-4170-9832-afb85f399cc0 tempest-VolumesAdminNegativeTest-1564408745 None] Created volume successfully. Nov 06 15:18:22 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-4596b64d-a08c-4899-bd0b-bfbc600b760c req-afbed953-f7ce-45ce-b3ea-2ff852c21b15 tempest-DeleteServersTestJSON-1200191192 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b', 'name': 'volume-42262111-cb6c-4b50-b3d1-4a6e80bd13f8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cb131c0c-1b3b-43ae-9735-9288069b5b37', 'enforce_multipath': True} {{(pid=87132) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 15:18:22 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-4596b64d-a08c-4899-bd0b-bfbc600b760c req-afbed953-f7ce-45ce-b3ea-2ff852c21b15 tempest-DeleteServersTestJSON-1200191192 None] attachment_update completed successfully. Nov 06 15:18:24 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d2bb7978-70ff-43d3-8985-b7c961283358 tempest-VolumesAdminNegativeTest-1564408745 None] Acquiring lock "cinder-b14f55f4-c206-4a8a-b7f0-ab44a9858846-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:18:24 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d2bb7978-70ff-43d3-8985-b7c961283358 tempest-VolumesAdminNegativeTest-1564408745 None] Lock "cinder-b14f55f4-c206-4a8a-b7f0-ab44a9858846-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:18:24 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d2bb7978-70ff-43d3-8985-b7c961283358 tempest-VolumesAdminNegativeTest-1564408745 None] Acquiring lock "cinder-quobyte-b14f55f4-c206-4a8a-b7f0-ab44a9858846" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:18:24 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d2bb7978-70ff-43d3-8985-b7c961283358 tempest-VolumesAdminNegativeTest-1564408745 None] Lock "cinder-quobyte-b14f55f4-c206-4a8a-b7f0-ab44a9858846" acquired by "delete_volume" :: waited 0.034s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:18:24 devstack cinder-volume[87132]: INFO oslo.privsep.daemon [None req-d2bb7978-70ff-43d3-8985-b7c961283358 tempest-VolumesAdminNegativeTest-1564408745 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp0gbsxy8x/privsep.sock'] Nov 06 15:18:24 devstack sudo[88919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp0gbsxy8x/privsep.sock Nov 06 15:18:24 devstack sudo[88919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:18:26 devstack cinder-volume[87132]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Nov 06 15:18:26 devstack cinder-volume[87132]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 06 15:18:26 devstack cinder-volume[87132]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Nov 06 15:18:26 devstack cinder-volume[87132]: WARNING oslo.privsep.daemon [-] privsep log: Nov 06 15:18:26 devstack cinder-volume[87132]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Nov 06 15:18:26 devstack cinder-volume[87132]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Nov 06 15:18:26 devstack cinder-volume[87132]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 06 15:18:26 devstack cinder-volume[87132]: WARNING oslo.privsep.daemon [-] privsep log: Nov 06 15:18:26 devstack cinder-volume[87132]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Nov 06 15:18:26 devstack sudo[88919]: pam_unix(sudo:session): session closed for user root Nov 06 15:18:26 devstack cinder-volume[87132]: INFO oslo.privsep.daemon [None req-d2bb7978-70ff-43d3-8985-b7c961283358 tempest-VolumesAdminNegativeTest-1564408745 None] Spawned new privsep daemon via rootwrap Nov 06 15:18:26 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [None req-d2bb7978-70ff-43d3-8985-b7c961283358 tempest-VolumesAdminNegativeTest-1564408745 None] Accepted privsep connection to /tmp/tmp0gbsxy8x/privsep.sock {{(pid=87132) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Nov 06 15:18:26 devstack cinder-volume[87132]: INFO oslo.privsep.daemon [-] privsep daemon starting Nov 06 15:18:26 devstack cinder-volume[87132]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Nov 06 15:18:26 devstack cinder-volume[87132]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Nov 06 15:18:26 devstack cinder-volume[87132]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88924 Nov 06 15:18:26 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[e70f1e89-37fd-48bd-9099-8c05279145ce]: (2,) {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:18:26 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b9c4d29-f192-44f7-921e-a7d7100a2aca]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:18:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d2bb7978-70ff-43d3-8985-b7c961283358 tempest-VolumesAdminNegativeTest-1564408745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b14f55f4-c206-4a8a-b7f0-ab44a9858846 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:18:26 devstack sudo[88926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b14f55f4-c206-4a8a-b7f0-ab44a9858846 Nov 06 15:18:26 devstack sudo[88926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:18:27 devstack sudo[88926]: pam_unix(sudo:session): session closed for user root Nov 06 15:18:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d2bb7978-70ff-43d3-8985-b7c961283358 tempest-VolumesAdminNegativeTest-1564408745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b14f55f4-c206-4a8a-b7f0-ab44a9858846" returned: 0 in 1.044s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:18:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d2bb7978-70ff-43d3-8985-b7c961283358 tempest-VolumesAdminNegativeTest-1564408745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b14f55f4-c206-4a8a-b7f0-ab44a9858846 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:18:27 devstack sudo[88944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b14f55f4-c206-4a8a-b7f0-ab44a9858846 Nov 06 15:18:27 devstack sudo[88944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:18:28 devstack sudo[88944]: pam_unix(sudo:session): session closed for user root Nov 06 15:18:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d2bb7978-70ff-43d3-8985-b7c961283358 tempest-VolumesAdminNegativeTest-1564408745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b14f55f4-c206-4a8a-b7f0-ab44a9858846" returned: 0 in 0.734s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:18:28 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d2bb7978-70ff-43d3-8985-b7c961283358 tempest-VolumesAdminNegativeTest-1564408745 None] Lock "cinder-quobyte-b14f55f4-c206-4a8a-b7f0-ab44a9858846" released by "delete_volume" :: held 4.277s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:18:28 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-82f5407a-7595-4b1f-a70e-f6a9d4c452ae tempest-ServerRescueNegativeTestJSON-106907598 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:18:28 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-82f5407a-7595-4b1f-a70e-f6a9d4c452ae tempest-ServerRescueNegativeTestJSON-106907598 None] Flow 'volume_create_manager' (7929b5a7-8afa-4ce1-a24b-87a0a204f583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:18:28 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-82f5407a-7595-4b1f-a70e-f6a9d4c452ae tempest-ServerRescueNegativeTestJSON-106907598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (765ed1cd-cc9a-43f9-a84b-6f9a5cb675d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:18:28 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-82f5407a-7595-4b1f-a70e-f6a9d4c452ae tempest-ServerRescueNegativeTestJSON-106907598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (765ed1cd-cc9a-43f9-a84b-6f9a5cb675d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:18:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1492234138',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20a057fc-dfba-460f-9a39-b683ca7b0238,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14e64104d3564f35b21ac7cd36ea3cb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:18:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:18:28Z,use_quota=True,user_id='71fd4470503643a4971d6844abc1b446',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:18:28 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-82f5407a-7595-4b1f-a70e-f6a9d4c452ae tempest-ServerRescueNegativeTestJSON-106907598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (109d7b23-8f0f-4555-90a3-9ad3a6e882ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:18:28 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-82f5407a-7595-4b1f-a70e-f6a9d4c452ae tempest-ServerRescueNegativeTestJSON-106907598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (109d7b23-8f0f-4555-90a3-9ad3a6e882ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:18:28 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-82f5407a-7595-4b1f-a70e-f6a9d4c452ae tempest-ServerRescueNegativeTestJSON-106907598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a612bd2-0e07-486a-a5e4-341fb0789493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:18:28 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-82f5407a-7595-4b1f-a70e-f6a9d4c452ae tempest-ServerRescueNegativeTestJSON-106907598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a612bd2-0e07-486a-a5e4-341fb0789493) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20a057fc-dfba-460f-9a39-b683ca7b0238', 'volume_name': 'volume-20a057fc-dfba-460f-9a39-b683ca7b0238', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:18:28 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-82f5407a-7595-4b1f-a70e-f6a9d4c452ae tempest-ServerRescueNegativeTestJSON-106907598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85c569bf-8237-4d9d-b591-18bf96d0f351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:18:28 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-82f5407a-7595-4b1f-a70e-f6a9d4c452ae tempest-ServerRescueNegativeTestJSON-106907598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85c569bf-8237-4d9d-b591-18bf96d0f351) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:18:28 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-82f5407a-7595-4b1f-a70e-f6a9d4c452ae tempest-ServerRescueNegativeTestJSON-106907598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (496253e0-d092-42ba-952e-800d3e194b96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:18:28 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-82f5407a-7595-4b1f-a70e-f6a9d4c452ae tempest-ServerRescueNegativeTestJSON-106907598 None] Volume 20a057fc-dfba-460f-9a39-b683ca7b0238: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20a057fc-dfba-460f-9a39-b683ca7b0238', 'volume_size': 1} Nov 06 15:18:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-82f5407a-7595-4b1f-a70e-f6a9d4c452ae tempest-ServerRescueNegativeTestJSON-106907598 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:18:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-82f5407a-7595-4b1f-a70e-f6a9d4c452ae tempest-ServerRescueNegativeTestJSON-106907598 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:18:28 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-82f5407a-7595-4b1f-a70e-f6a9d4c452ae tempest-ServerRescueNegativeTestJSON-106907598 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:18:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1492234138',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20a057fc-dfba-460f-9a39-b683ca7b0238,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14e64104d3564f35b21ac7cd36ea3cb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:18:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:18:28Z,use_quota=True,user_id='71fd4470503643a4971d6844abc1b446',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:18:28 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-82f5407a-7595-4b1f-a70e-f6a9d4c452ae tempest-ServerRescueNegativeTestJSON-106907598 None] Creating volume 20a057fc-dfba-460f-9a39-b683ca7b0238 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:18:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-82f5407a-7595-4b1f-a70e-f6a9d4c452ae tempest-ServerRescueNegativeTestJSON-106907598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:18:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-82f5407a-7595-4b1f-a70e-f6a9d4c452ae tempest-ServerRescueNegativeTestJSON-106907598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:18:28 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-82f5407a-7595-4b1f-a70e-f6a9d4c452ae tempest-ServerRescueNegativeTestJSON-106907598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:18:28 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-82f5407a-7595-4b1f-a70e-f6a9d4c452ae tempest-ServerRescueNegativeTestJSON-106907598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:18:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-82f5407a-7595-4b1f-a70e-f6a9d4c452ae tempest-ServerRescueNegativeTestJSON-106907598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:18:28 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-82f5407a-7595-4b1f-a70e-f6a9d4c452ae tempest-ServerRescueNegativeTestJSON-106907598 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:18:28 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-82f5407a-7595-4b1f-a70e-f6a9d4c452ae tempest-ServerRescueNegativeTestJSON-106907598 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:18:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-82f5407a-7595-4b1f-a70e-f6a9d4c452ae tempest-ServerRescueNegativeTestJSON-106907598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-20a057fc-dfba-460f-9a39-b683ca7b0238 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:18:28 devstack sudo[88989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-20a057fc-dfba-460f-9a39-b683ca7b0238 1073741824 Nov 06 15:18:28 devstack sudo[88989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:18:28 devstack cinder-volume[87132]: WARNING cinder.quota [None req-d2bb7978-70ff-43d3-8985-b7c961283358 tempest-VolumesAdminNegativeTest-1564408745 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 06 15:18:28 devstack cinder-volume[87132]: WARNING cinder.quota [None req-d2bb7978-70ff-43d3-8985-b7c961283358 tempest-VolumesAdminNegativeTest-1564408745 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 06 15:18:28 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-d2bb7978-70ff-43d3-8985-b7c961283358 tempest-VolumesAdminNegativeTest-1564408745 None] Created reservations ['eb778d7f-471b-466d-953a-5fddfbb2b43c', 'b793f313-21b9-4ac9-80b1-6de9ae7afb30', '07e136cf-ada6-4176-ac3f-6a85bf46ddc5', '4e2fc6fa-9f5b-4753-9e38-faafeae2189f'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:18:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-d2bb7978-70ff-43d3-8985-b7c961283358 tempest-VolumesAdminNegativeTest-1564408745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:18:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-d2bb7978-70ff-43d3-8985-b7c961283358 tempest-VolumesAdminNegativeTest-1564408745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:18:29 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-d2bb7978-70ff-43d3-8985-b7c961283358 tempest-VolumesAdminNegativeTest-1564408745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:18:29 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-d2bb7978-70ff-43d3-8985-b7c961283358 tempest-VolumesAdminNegativeTest-1564408745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:18:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-d2bb7978-70ff-43d3-8985-b7c961283358 tempest-VolumesAdminNegativeTest-1564408745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:18:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d2bb7978-70ff-43d3-8985-b7c961283358 tempest-VolumesAdminNegativeTest-1564408745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:18:29 devstack sudo[88993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:18:29 devstack sudo[88993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:18:29 devstack sudo[88993]: pam_unix(sudo:session): session closed for user root Nov 06 15:18:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d2bb7978-70ff-43d3-8985-b7c961283358 tempest-VolumesAdminNegativeTest-1564408745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.374s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:18:29 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-d2bb7978-70ff-43d3-8985-b7c961283358 tempest-VolumesAdminNegativeTest-1564408745 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:18:29 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-d2bb7978-70ff-43d3-8985-b7c961283358 tempest-VolumesAdminNegativeTest-1564408745 None] Deleted volume successfully. Nov 06 15:18:29 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d2bb7978-70ff-43d3-8985-b7c961283358 tempest-VolumesAdminNegativeTest-1564408745 None] Lock "cinder-b14f55f4-c206-4a8a-b7f0-ab44a9858846-delete_volume" released by "delete_volume" :: held 5.655s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:18:29 devstack sudo[88989]: pam_unix(sudo:session): session closed for user root Nov 06 15:18:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-82f5407a-7595-4b1f-a70e-f6a9d4c452ae tempest-ServerRescueNegativeTestJSON-106907598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-20a057fc-dfba-460f-9a39-b683ca7b0238 1073741824" returned: 0 in 1.261s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:18:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-82f5407a-7595-4b1f-a70e-f6a9d4c452ae tempest-ServerRescueNegativeTestJSON-106907598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-20a057fc-dfba-460f-9a39-b683ca7b0238 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:18:30 devstack sudo[89001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-20a057fc-dfba-460f-9a39-b683ca7b0238 Nov 06 15:18:30 devstack sudo[89001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:18:30 devstack sudo[89001]: pam_unix(sudo:session): session closed for user root Nov 06 15:18:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-82f5407a-7595-4b1f-a70e-f6a9d4c452ae tempest-ServerRescueNegativeTestJSON-106907598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-20a057fc-dfba-460f-9a39-b683ca7b0238" returned: 0 in 0.862s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:18:30 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-82f5407a-7595-4b1f-a70e-f6a9d4c452ae tempest-ServerRescueNegativeTestJSON-106907598 None] <== create_volume: return (2215ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:18:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-82f5407a-7595-4b1f-a70e-f6a9d4c452ae tempest-ServerRescueNegativeTestJSON-106907598 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.223s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:18:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-82f5407a-7595-4b1f-a70e-f6a9d4c452ae tempest-ServerRescueNegativeTestJSON-106907598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (496253e0-d092-42ba-952e-800d3e194b96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20a057fc-dfba-460f-9a39-b683ca7b0238', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:18:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-82f5407a-7595-4b1f-a70e-f6a9d4c452ae tempest-ServerRescueNegativeTestJSON-106907598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (731bf425-0b6b-4314-8c03-2967cd664747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:18:31 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-82f5407a-7595-4b1f-a70e-f6a9d4c452ae tempest-ServerRescueNegativeTestJSON-106907598 None] Volume volume-20a057fc-dfba-460f-9a39-b683ca7b0238 (20a057fc-dfba-460f-9a39-b683ca7b0238): created successfully Nov 06 15:18:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-82f5407a-7595-4b1f-a70e-f6a9d4c452ae tempest-ServerRescueNegativeTestJSON-106907598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (731bf425-0b6b-4314-8c03-2967cd664747) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:18:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-82f5407a-7595-4b1f-a70e-f6a9d4c452ae tempest-ServerRescueNegativeTestJSON-106907598 None] Flow 'volume_create_manager' (7929b5a7-8afa-4ce1-a24b-87a0a204f583) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:18:31 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-81746257-6436-459e-a60c-a7a1a4714447 req-f732962f-13b1-4f9b-9b50-3b6ce22141f3 tempest-DeleteServersTestJSON-1200191192 None] Terminate volume connection completed successfully. Nov 06 15:18:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-81746257-6436-459e-a60c-a7a1a4714447 req-f732962f-13b1-4f9b-9b50-3b6ce22141f3 tempest-DeleteServersTestJSON-1200191192 None] Deleting attachment cb131c0c-1b3b-43ae-9735-9288069b5b37. {{(pid=87132) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 06 15:18:31 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-82f5407a-7595-4b1f-a70e-f6a9d4c452ae tempest-ServerRescueNegativeTestJSON-106907598 None] Created volume successfully. Nov 06 15:18:33 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-79618fc5-de17-4dd0-8bf9-ddec16c26478 tempest-DeleteServersTestJSON-1200191192 None] Acquiring lock "cinder-42262111-cb6c-4b50-b3d1-4a6e80bd13f8-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:18:33 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-79618fc5-de17-4dd0-8bf9-ddec16c26478 tempest-DeleteServersTestJSON-1200191192 None] Lock "cinder-42262111-cb6c-4b50-b3d1-4a6e80bd13f8-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:18:33 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-79618fc5-de17-4dd0-8bf9-ddec16c26478 tempest-DeleteServersTestJSON-1200191192 None] Acquiring lock "cinder-quobyte-42262111-cb6c-4b50-b3d1-4a6e80bd13f8" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:18:33 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-79618fc5-de17-4dd0-8bf9-ddec16c26478 tempest-DeleteServersTestJSON-1200191192 None] Lock "cinder-quobyte-42262111-cb6c-4b50-b3d1-4a6e80bd13f8" acquired by "delete_volume" :: waited 0.048s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:18:34 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ccd36b5-341a-4d0f-8154-f25a809c680d]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:18:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-79618fc5-de17-4dd0-8bf9-ddec16c26478 tempest-DeleteServersTestJSON-1200191192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-42262111-cb6c-4b50-b3d1-4a6e80bd13f8 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:18:34 devstack sudo[89034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-42262111-cb6c-4b50-b3d1-4a6e80bd13f8 Nov 06 15:18:34 devstack sudo[89034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:18:34 devstack sudo[89034]: pam_unix(sudo:session): session closed for user root Nov 06 15:18:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-79618fc5-de17-4dd0-8bf9-ddec16c26478 tempest-DeleteServersTestJSON-1200191192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-42262111-cb6c-4b50-b3d1-4a6e80bd13f8" returned: 0 in 0.706s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:18:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-79618fc5-de17-4dd0-8bf9-ddec16c26478 tempest-DeleteServersTestJSON-1200191192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-42262111-cb6c-4b50-b3d1-4a6e80bd13f8 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:18:34 devstack sudo[89048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-42262111-cb6c-4b50-b3d1-4a6e80bd13f8 Nov 06 15:18:34 devstack sudo[89048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:18:35 devstack sudo[89048]: pam_unix(sudo:session): session closed for user root Nov 06 15:18:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-79618fc5-de17-4dd0-8bf9-ddec16c26478 tempest-DeleteServersTestJSON-1200191192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-42262111-cb6c-4b50-b3d1-4a6e80bd13f8" returned: 0 in 0.356s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:18:35 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-79618fc5-de17-4dd0-8bf9-ddec16c26478 tempest-DeleteServersTestJSON-1200191192 None] Lock "cinder-quobyte-42262111-cb6c-4b50-b3d1-4a6e80bd13f8" released by "delete_volume" :: held 1.144s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:18:35 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-79618fc5-de17-4dd0-8bf9-ddec16c26478 tempest-DeleteServersTestJSON-1200191192 None] Created reservations ['28db0cdf-08cb-4fc4-9568-339cb54ba861', '3af28e28-69e2-4a7d-b1e6-f23e7cd00c6e', '0ac7dc46-d28b-4a09-8374-13311a6c46b9', '66485da3-da06-4cc7-90d8-d786f5a10c7f'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:18:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-79618fc5-de17-4dd0-8bf9-ddec16c26478 tempest-DeleteServersTestJSON-1200191192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:18:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-79618fc5-de17-4dd0-8bf9-ddec16c26478 tempest-DeleteServersTestJSON-1200191192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:18:35 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-79618fc5-de17-4dd0-8bf9-ddec16c26478 tempest-DeleteServersTestJSON-1200191192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:18:35 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-79618fc5-de17-4dd0-8bf9-ddec16c26478 tempest-DeleteServersTestJSON-1200191192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:18:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-79618fc5-de17-4dd0-8bf9-ddec16c26478 tempest-DeleteServersTestJSON-1200191192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:18:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-79618fc5-de17-4dd0-8bf9-ddec16c26478 tempest-DeleteServersTestJSON-1200191192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:18:35 devstack sudo[89055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:18:35 devstack sudo[89055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:18:35 devstack sudo[89055]: pam_unix(sudo:session): session closed for user root Nov 06 15:18:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-79618fc5-de17-4dd0-8bf9-ddec16c26478 tempest-DeleteServersTestJSON-1200191192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.412s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:18:35 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-79618fc5-de17-4dd0-8bf9-ddec16c26478 tempest-DeleteServersTestJSON-1200191192 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:18:35 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-79618fc5-de17-4dd0-8bf9-ddec16c26478 tempest-DeleteServersTestJSON-1200191192 None] Deleted volume successfully. Nov 06 15:18:35 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-79618fc5-de17-4dd0-8bf9-ddec16c26478 tempest-DeleteServersTestJSON-1200191192 None] Lock "cinder-42262111-cb6c-4b50-b3d1-4a6e80bd13f8-delete_volume" released by "delete_volume" :: held 1.999s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:18:45 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:SELECT=20,cinder:UPDATE=33,cinder:INSERT=8,cinder:DELETE=1 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 15:18:45 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:SELECT=27,cinder:UPDATE=20,cinder:DELETE=4,cinder:INSERT=3 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 15:18:59 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-9b661c83-db7a-4bd8-8a8f-8c33a51e8637 tempest-ServerRescueNegativeTestJSON-106907598 None] Acquiring lock "cinder-20a057fc-dfba-460f-9a39-b683ca7b0238-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:18:59 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-9b661c83-db7a-4bd8-8a8f-8c33a51e8637 tempest-ServerRescueNegativeTestJSON-106907598 None] Lock "cinder-20a057fc-dfba-460f-9a39-b683ca7b0238-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:18:59 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-9b661c83-db7a-4bd8-8a8f-8c33a51e8637 tempest-ServerRescueNegativeTestJSON-106907598 None] Acquiring lock "cinder-quobyte-20a057fc-dfba-460f-9a39-b683ca7b0238" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:18:59 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-9b661c83-db7a-4bd8-8a8f-8c33a51e8637 tempest-ServerRescueNegativeTestJSON-106907598 None] Lock "cinder-quobyte-20a057fc-dfba-460f-9a39-b683ca7b0238" acquired by "delete_volume" :: waited 0.050s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:18:59 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[9131ccab-e312-4db1-8a35-41f7f0665a97]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:18:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9b661c83-db7a-4bd8-8a8f-8c33a51e8637 tempest-ServerRescueNegativeTestJSON-106907598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-20a057fc-dfba-460f-9a39-b683ca7b0238 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:18:59 devstack sudo[89227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-20a057fc-dfba-460f-9a39-b683ca7b0238 Nov 06 15:18:59 devstack sudo[89227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:19:00 devstack sudo[89227]: pam_unix(sudo:session): session closed for user root Nov 06 15:19:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9b661c83-db7a-4bd8-8a8f-8c33a51e8637 tempest-ServerRescueNegativeTestJSON-106907598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-20a057fc-dfba-460f-9a39-b683ca7b0238" returned: 0 in 0.615s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:19:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9b661c83-db7a-4bd8-8a8f-8c33a51e8637 tempest-ServerRescueNegativeTestJSON-106907598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-20a057fc-dfba-460f-9a39-b683ca7b0238 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:19:00 devstack sudo[89232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-20a057fc-dfba-460f-9a39-b683ca7b0238 Nov 06 15:19:00 devstack sudo[89232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:19:00 devstack sudo[89232]: pam_unix(sudo:session): session closed for user root Nov 06 15:19:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9b661c83-db7a-4bd8-8a8f-8c33a51e8637 tempest-ServerRescueNegativeTestJSON-106907598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-20a057fc-dfba-460f-9a39-b683ca7b0238" returned: 0 in 0.330s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:19:00 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-9b661c83-db7a-4bd8-8a8f-8c33a51e8637 tempest-ServerRescueNegativeTestJSON-106907598 None] Lock "cinder-quobyte-20a057fc-dfba-460f-9a39-b683ca7b0238" released by "delete_volume" :: held 1.017s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:19:00 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-9b661c83-db7a-4bd8-8a8f-8c33a51e8637 tempest-ServerRescueNegativeTestJSON-106907598 None] Created reservations ['22ac2736-6e22-4ffb-a73a-6079fcf62fd1', '3f349a2e-5b35-4c81-ae9e-a3ed76056c7f', '914e0034-58c7-498a-b4af-c02ef1bdc81e', '233aa308-2d3b-4d3d-bad2-4b893a80816f'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:19:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9b661c83-db7a-4bd8-8a8f-8c33a51e8637 tempest-ServerRescueNegativeTestJSON-106907598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:19:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9b661c83-db7a-4bd8-8a8f-8c33a51e8637 tempest-ServerRescueNegativeTestJSON-106907598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:19:00 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-9b661c83-db7a-4bd8-8a8f-8c33a51e8637 tempest-ServerRescueNegativeTestJSON-106907598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:19:00 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-9b661c83-db7a-4bd8-8a8f-8c33a51e8637 tempest-ServerRescueNegativeTestJSON-106907598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:19:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9b661c83-db7a-4bd8-8a8f-8c33a51e8637 tempest-ServerRescueNegativeTestJSON-106907598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:19:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9b661c83-db7a-4bd8-8a8f-8c33a51e8637 tempest-ServerRescueNegativeTestJSON-106907598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:19:00 devstack sudo[89235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:19:00 devstack sudo[89235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:19:01 devstack sudo[89235]: pam_unix(sudo:session): session closed for user root Nov 06 15:19:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9b661c83-db7a-4bd8-8a8f-8c33a51e8637 tempest-ServerRescueNegativeTestJSON-106907598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.547s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:19:01 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-9b661c83-db7a-4bd8-8a8f-8c33a51e8637 tempest-ServerRescueNegativeTestJSON-106907598 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:19:01 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-9b661c83-db7a-4bd8-8a8f-8c33a51e8637 tempest-ServerRescueNegativeTestJSON-106907598 None] Deleted volume successfully. Nov 06 15:19:01 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-9b661c83-db7a-4bd8-8a8f-8c33a51e8637 tempest-ServerRescueNegativeTestJSON-106907598 None] Lock "cinder-20a057fc-dfba-460f-9a39-b683ca7b0238-delete_volume" released by "delete_volume" :: held 1.997s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:19:07 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [req-adfe8eb7-03f5-49f8-83b4-9502647f021c req-b6e19ee4-2d73-4ee5-9b5d-f5fa6301f8c7 tempest-VolumesSnapshotsTestJSON-1209959778 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:19:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-adfe8eb7-03f5-49f8-83b4-9502647f021c req-b6e19ee4-2d73-4ee5-9b5d-f5fa6301f8c7 tempest-VolumesSnapshotsTestJSON-1209959778 None] Flow 'volume_create_manager' (ca2b4201-ddfd-480a-8233-16a5d0a220b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:19:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-adfe8eb7-03f5-49f8-83b4-9502647f021c req-b6e19ee4-2d73-4ee5-9b5d-f5fa6301f8c7 tempest-VolumesSnapshotsTestJSON-1209959778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b42d2a19-b885-43d6-b6e5-69cba85b2f39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:19:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-adfe8eb7-03f5-49f8-83b4-9502647f021c req-b6e19ee4-2d73-4ee5-9b5d-f5fa6301f8c7 tempest-VolumesSnapshotsTestJSON-1209959778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b42d2a19-b885-43d6-b6e5-69cba85b2f39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:19:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-854368843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ed86550-2ed8-442b-b960-af3415217c33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='372664e98b9343fc83d34820cdcd1c54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:19:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:19:07Z,use_quota=True,user_id='fc3a5b4a51bc4efdb3acc40c48adada9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:19:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-adfe8eb7-03f5-49f8-83b4-9502647f021c req-b6e19ee4-2d73-4ee5-9b5d-f5fa6301f8c7 tempest-VolumesSnapshotsTestJSON-1209959778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f049720-149b-46bd-ac92-25d1f36f05fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:19:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-adfe8eb7-03f5-49f8-83b4-9502647f021c req-b6e19ee4-2d73-4ee5-9b5d-f5fa6301f8c7 tempest-VolumesSnapshotsTestJSON-1209959778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f049720-149b-46bd-ac92-25d1f36f05fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:19:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-adfe8eb7-03f5-49f8-83b4-9502647f021c req-b6e19ee4-2d73-4ee5-9b5d-f5fa6301f8c7 tempest-VolumesSnapshotsTestJSON-1209959778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3525e85b-5f31-4880-a500-84772f846402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:19:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-adfe8eb7-03f5-49f8-83b4-9502647f021c req-b6e19ee4-2d73-4ee5-9b5d-f5fa6301f8c7 tempest-VolumesSnapshotsTestJSON-1209959778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3525e85b-5f31-4880-a500-84772f846402) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ed86550-2ed8-442b-b960-af3415217c33', 'volume_name': 'volume-6ed86550-2ed8-442b-b960-af3415217c33', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:19:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-adfe8eb7-03f5-49f8-83b4-9502647f021c req-b6e19ee4-2d73-4ee5-9b5d-f5fa6301f8c7 tempest-VolumesSnapshotsTestJSON-1209959778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b097d1e-3df9-44e9-a2aa-7d5f66eb9516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:19:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-adfe8eb7-03f5-49f8-83b4-9502647f021c req-b6e19ee4-2d73-4ee5-9b5d-f5fa6301f8c7 tempest-VolumesSnapshotsTestJSON-1209959778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b097d1e-3df9-44e9-a2aa-7d5f66eb9516) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:19:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-adfe8eb7-03f5-49f8-83b4-9502647f021c req-b6e19ee4-2d73-4ee5-9b5d-f5fa6301f8c7 tempest-VolumesSnapshotsTestJSON-1209959778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39f7051c-60af-4ec3-ac5d-53eec538c076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:19:07 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [req-adfe8eb7-03f5-49f8-83b4-9502647f021c req-b6e19ee4-2d73-4ee5-9b5d-f5fa6301f8c7 tempest-VolumesSnapshotsTestJSON-1209959778 None] Volume 6ed86550-2ed8-442b-b960-af3415217c33: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ed86550-2ed8-442b-b960-af3415217c33', 'volume_size': 1} Nov 06 15:19:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-adfe8eb7-03f5-49f8-83b4-9502647f021c req-b6e19ee4-2d73-4ee5-9b5d-f5fa6301f8c7 tempest-VolumesSnapshotsTestJSON-1209959778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:19:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-adfe8eb7-03f5-49f8-83b4-9502647f021c req-b6e19ee4-2d73-4ee5-9b5d-f5fa6301f8c7 tempest-VolumesSnapshotsTestJSON-1209959778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:19:07 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [req-adfe8eb7-03f5-49f8-83b4-9502647f021c req-b6e19ee4-2d73-4ee5-9b5d-f5fa6301f8c7 tempest-VolumesSnapshotsTestJSON-1209959778 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:19:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-854368843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ed86550-2ed8-442b-b960-af3415217c33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='372664e98b9343fc83d34820cdcd1c54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:19:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:19:07Z,use_quota=True,user_id='fc3a5b4a51bc4efdb3acc40c48adada9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:19:07 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [req-adfe8eb7-03f5-49f8-83b4-9502647f021c req-b6e19ee4-2d73-4ee5-9b5d-f5fa6301f8c7 tempest-VolumesSnapshotsTestJSON-1209959778 None] Creating volume 6ed86550-2ed8-442b-b960-af3415217c33 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:19:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-adfe8eb7-03f5-49f8-83b4-9502647f021c req-b6e19ee4-2d73-4ee5-9b5d-f5fa6301f8c7 tempest-VolumesSnapshotsTestJSON-1209959778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:19:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-adfe8eb7-03f5-49f8-83b4-9502647f021c req-b6e19ee4-2d73-4ee5-9b5d-f5fa6301f8c7 tempest-VolumesSnapshotsTestJSON-1209959778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:19:07 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [req-adfe8eb7-03f5-49f8-83b4-9502647f021c req-b6e19ee4-2d73-4ee5-9b5d-f5fa6301f8c7 tempest-VolumesSnapshotsTestJSON-1209959778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:19:07 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [req-adfe8eb7-03f5-49f8-83b4-9502647f021c req-b6e19ee4-2d73-4ee5-9b5d-f5fa6301f8c7 tempest-VolumesSnapshotsTestJSON-1209959778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:19:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-adfe8eb7-03f5-49f8-83b4-9502647f021c req-b6e19ee4-2d73-4ee5-9b5d-f5fa6301f8c7 tempest-VolumesSnapshotsTestJSON-1209959778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:19:07 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [req-adfe8eb7-03f5-49f8-83b4-9502647f021c req-b6e19ee4-2d73-4ee5-9b5d-f5fa6301f8c7 tempest-VolumesSnapshotsTestJSON-1209959778 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:19:07 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [req-adfe8eb7-03f5-49f8-83b4-9502647f021c req-b6e19ee4-2d73-4ee5-9b5d-f5fa6301f8c7 tempest-VolumesSnapshotsTestJSON-1209959778 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:19:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-adfe8eb7-03f5-49f8-83b4-9502647f021c req-b6e19ee4-2d73-4ee5-9b5d-f5fa6301f8c7 tempest-VolumesSnapshotsTestJSON-1209959778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-6ed86550-2ed8-442b-b960-af3415217c33 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:19:07 devstack sudo[89294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-6ed86550-2ed8-442b-b960-af3415217c33 1073741824 Nov 06 15:19:07 devstack sudo[89294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:19:08 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 15:19:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:19:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:19:08 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:19:08 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:19:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:19:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:19:08 devstack sudo[89300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:19:08 devstack sudo[89300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:19:08 devstack sudo[89294]: pam_unix(sudo:session): session closed for user root Nov 06 15:19:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-adfe8eb7-03f5-49f8-83b4-9502647f021c req-b6e19ee4-2d73-4ee5-9b5d-f5fa6301f8c7 tempest-VolumesSnapshotsTestJSON-1209959778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-6ed86550-2ed8-442b-b960-af3415217c33 1073741824" returned: 0 in 0.605s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:19:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-adfe8eb7-03f5-49f8-83b4-9502647f021c req-b6e19ee4-2d73-4ee5-9b5d-f5fa6301f8c7 tempest-VolumesSnapshotsTestJSON-1209959778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-6ed86550-2ed8-442b-b960-af3415217c33 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:19:08 devstack sudo[89302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-6ed86550-2ed8-442b-b960-af3415217c33 Nov 06 15:19:08 devstack sudo[89302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:19:08 devstack sudo[89300]: pam_unix(sudo:session): session closed for user root Nov 06 15:19:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.392s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:19:08 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:19:08 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Running periodic task VolumeManager._thread_info {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 15:19:08 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] thread count: 8 {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 15:19:08 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] thread info: [<_MainThread(MainThread, started 140011251929216)>, , , , , , , ] {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 06 15:19:08 devstack sudo[89302]: pam_unix(sudo:session): session closed for user root Nov 06 15:19:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-adfe8eb7-03f5-49f8-83b4-9502647f021c req-b6e19ee4-2d73-4ee5-9b5d-f5fa6301f8c7 tempest-VolumesSnapshotsTestJSON-1209959778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-6ed86550-2ed8-442b-b960-af3415217c33" returned: 0 in 0.304s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:19:08 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [req-adfe8eb7-03f5-49f8-83b4-9502647f021c req-b6e19ee4-2d73-4ee5-9b5d-f5fa6301f8c7 tempest-VolumesSnapshotsTestJSON-1209959778 None] <== create_volume: return (988ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:19:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-adfe8eb7-03f5-49f8-83b4-9502647f021c req-b6e19ee4-2d73-4ee5-9b5d-f5fa6301f8c7 tempest-VolumesSnapshotsTestJSON-1209959778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.990s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:19:08 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-adfe8eb7-03f5-49f8-83b4-9502647f021c req-b6e19ee4-2d73-4ee5-9b5d-f5fa6301f8c7 tempest-VolumesSnapshotsTestJSON-1209959778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39f7051c-60af-4ec3-ac5d-53eec538c076) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ed86550-2ed8-442b-b960-af3415217c33', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:19:08 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-adfe8eb7-03f5-49f8-83b4-9502647f021c req-b6e19ee4-2d73-4ee5-9b5d-f5fa6301f8c7 tempest-VolumesSnapshotsTestJSON-1209959778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03cd49db-a0ba-4511-a728-97e0f08ea392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:19:08 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [req-adfe8eb7-03f5-49f8-83b4-9502647f021c req-b6e19ee4-2d73-4ee5-9b5d-f5fa6301f8c7 tempest-VolumesSnapshotsTestJSON-1209959778 None] Volume volume-6ed86550-2ed8-442b-b960-af3415217c33 (6ed86550-2ed8-442b-b960-af3415217c33): created successfully Nov 06 15:19:08 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-adfe8eb7-03f5-49f8-83b4-9502647f021c req-b6e19ee4-2d73-4ee5-9b5d-f5fa6301f8c7 tempest-VolumesSnapshotsTestJSON-1209959778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03cd49db-a0ba-4511-a728-97e0f08ea392) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:19:08 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-adfe8eb7-03f5-49f8-83b4-9502647f021c req-b6e19ee4-2d73-4ee5-9b5d-f5fa6301f8c7 tempest-VolumesSnapshotsTestJSON-1209959778 None] Flow 'volume_create_manager' (ca2b4201-ddfd-480a-8233-16a5d0a220b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:19:08 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-adfe8eb7-03f5-49f8-83b4-9502647f021c req-b6e19ee4-2d73-4ee5-9b5d-f5fa6301f8c7 tempest-VolumesSnapshotsTestJSON-1209959778 None] Created volume successfully. Nov 06 15:19:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-0cec64b7-4dc8-4c7b-ab16-c2dd35d4b918 req-300f86d3-4611-4ca0-8098-d16b83fdc5cd tempest-VolumesSnapshotsTestJSON-1209959778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:19:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-0cec64b7-4dc8-4c7b-ab16-c2dd35d4b918 req-300f86d3-4611-4ca0-8098-d16b83fdc5cd tempest-VolumesSnapshotsTestJSON-1209959778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:19:10 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [req-0cec64b7-4dc8-4c7b-ab16-c2dd35d4b918 req-300f86d3-4611-4ca0-8098-d16b83fdc5cd tempest-VolumesSnapshotsTestJSON-1209959778 None] Creating offline snapshot 0020764b-555e-4c8f-9d44-959350408fc0 of volume 6ed86550-2ed8-442b-b960-af3415217c33 {{(pid=87132) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 15:19:10 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[4560d1e1-f6f3-46b4-9d20-1496e1df40e0]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:19:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-0cec64b7-4dc8-4c7b-ab16-c2dd35d4b918 req-300f86d3-4611-4ca0-8098-d16b83fdc5cd tempest-VolumesSnapshotsTestJSON-1209959778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-6ed86550-2ed8-442b-b960-af3415217c33 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:19:10 devstack sudo[89308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-6ed86550-2ed8-442b-b960-af3415217c33 Nov 06 15:19:10 devstack sudo[89308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:19:10 devstack sudo[89308]: pam_unix(sudo:session): session closed for user root Nov 06 15:19:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-0cec64b7-4dc8-4c7b-ab16-c2dd35d4b918 req-300f86d3-4611-4ca0-8098-d16b83fdc5cd tempest-VolumesSnapshotsTestJSON-1209959778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-6ed86550-2ed8-442b-b960-af3415217c33" returned: 0 in 0.590s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:19:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-0cec64b7-4dc8-4c7b-ab16-c2dd35d4b918 req-300f86d3-4611-4ca0-8098-d16b83fdc5cd tempest-VolumesSnapshotsTestJSON-1209959778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-6ed86550-2ed8-442b-b960-af3415217c33,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-6ed86550-2ed8-442b-b960-af3415217c33.0020764b-555e-4c8f-9d44-959350408fc0 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:19:10 devstack sudo[89313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-6ed86550-2ed8-442b-b960-af3415217c33,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-6ed86550-2ed8-442b-b960-af3415217c33.0020764b-555e-4c8f-9d44-959350408fc0 1G Nov 06 15:19:10 devstack sudo[89313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:19:11 devstack sudo[89313]: pam_unix(sudo:session): session closed for user root Nov 06 15:19:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-0cec64b7-4dc8-4c7b-ab16-c2dd35d4b918 req-300f86d3-4611-4ca0-8098-d16b83fdc5cd tempest-VolumesSnapshotsTestJSON-1209959778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-6ed86550-2ed8-442b-b960-af3415217c33,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-6ed86550-2ed8-442b-b960-af3415217c33.0020764b-555e-4c8f-9d44-959350408fc0 1G" returned: 0 in 0.529s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:19:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-0cec64b7-4dc8-4c7b-ab16-c2dd35d4b918 req-300f86d3-4611-4ca0-8098-d16b83fdc5cd tempest-VolumesSnapshotsTestJSON-1209959778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ed86550-2ed8-442b-b960-af3415217c33 -F qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-6ed86550-2ed8-442b-b960-af3415217c33.0020764b-555e-4c8f-9d44-959350408fc0 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:19:11 devstack sudo[89319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ed86550-2ed8-442b-b960-af3415217c33 -F qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-6ed86550-2ed8-442b-b960-af3415217c33.0020764b-555e-4c8f-9d44-959350408fc0 Nov 06 15:19:11 devstack sudo[89319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:19:11 devstack sudo[89319]: pam_unix(sudo:session): session closed for user root Nov 06 15:19:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-0cec64b7-4dc8-4c7b-ab16-c2dd35d4b918 req-300f86d3-4611-4ca0-8098-d16b83fdc5cd tempest-VolumesSnapshotsTestJSON-1209959778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ed86550-2ed8-442b-b960-af3415217c33 -F qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-6ed86550-2ed8-442b-b960-af3415217c33.0020764b-555e-4c8f-9d44-959350408fc0" returned: 0 in 0.406s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:19:11 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [req-0cec64b7-4dc8-4c7b-ab16-c2dd35d4b918 req-300f86d3-4611-4ca0-8098-d16b83fdc5cd tempest-VolumesSnapshotsTestJSON-1209959778 None] /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-6ed86550-2ed8-442b-b960-af3415217c33.0020764b-555e-4c8f-9d44-959350408fc0 is being set with open permissions: ugo+rw Nov 06 15:19:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-0cec64b7-4dc8-4c7b-ab16-c2dd35d4b918 req-300f86d3-4611-4ca0-8098-d16b83fdc5cd tempest-VolumesSnapshotsTestJSON-1209959778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-6ed86550-2ed8-442b-b960-af3415217c33.0020764b-555e-4c8f-9d44-959350408fc0 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:19:11 devstack sudo[89324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-6ed86550-2ed8-442b-b960-af3415217c33.0020764b-555e-4c8f-9d44-959350408fc0 Nov 06 15:19:11 devstack sudo[89324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:19:12 devstack sudo[89324]: pam_unix(sudo:session): session closed for user root Nov 06 15:19:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-0cec64b7-4dc8-4c7b-ab16-c2dd35d4b918 req-300f86d3-4611-4ca0-8098-d16b83fdc5cd tempest-VolumesSnapshotsTestJSON-1209959778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-6ed86550-2ed8-442b-b960-af3415217c33.0020764b-555e-4c8f-9d44-959350408fc0" returned: 0 in 0.320s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:19:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-0cec64b7-4dc8-4c7b-ab16-c2dd35d4b918 req-300f86d3-4611-4ca0-8098-d16b83fdc5cd tempest-VolumesSnapshotsTestJSON-1209959778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-6ed86550-2ed8-442b-b960-af3415217c33.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:19:12 devstack sudo[89327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-6ed86550-2ed8-442b-b960-af3415217c33.info Nov 06 15:19:12 devstack sudo[89327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:19:12 devstack sudo[89327]: pam_unix(sudo:session): session closed for user root Nov 06 15:19:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-0cec64b7-4dc8-4c7b-ab16-c2dd35d4b918 req-300f86d3-4611-4ca0-8098-d16b83fdc5cd tempest-VolumesSnapshotsTestJSON-1209959778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-6ed86550-2ed8-442b-b960-af3415217c33.info" returned: 0 in 0.277s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:19:12 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [req-0cec64b7-4dc8-4c7b-ab16-c2dd35d4b918 req-300f86d3-4611-4ca0-8098-d16b83fdc5cd tempest-VolumesSnapshotsTestJSON-1209959778 None] /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-6ed86550-2ed8-442b-b960-af3415217c33.info is being set with open permissions: ugo+rw Nov 06 15:19:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-0cec64b7-4dc8-4c7b-ab16-c2dd35d4b918 req-300f86d3-4611-4ca0-8098-d16b83fdc5cd tempest-VolumesSnapshotsTestJSON-1209959778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-6ed86550-2ed8-442b-b960-af3415217c33.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:19:12 devstack sudo[89330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-6ed86550-2ed8-442b-b960-af3415217c33.info Nov 06 15:19:12 devstack sudo[89330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:19:12 devstack sudo[89330]: pam_unix(sudo:session): session closed for user root Nov 06 15:19:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-0cec64b7-4dc8-4c7b-ab16-c2dd35d4b918 req-300f86d3-4611-4ca0-8098-d16b83fdc5cd tempest-VolumesSnapshotsTestJSON-1209959778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-6ed86550-2ed8-442b-b960-af3415217c33.info" returned: 0 in 0.349s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:19:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-0cec64b7-4dc8-4c7b-ab16-c2dd35d4b918 req-300f86d3-4611-4ca0-8098-d16b83fdc5cd tempest-VolumesSnapshotsTestJSON-1209959778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.615s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:19:12 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-0cec64b7-4dc8-4c7b-ab16-c2dd35d4b918 req-300f86d3-4611-4ca0-8098-d16b83fdc5cd tempest-VolumesSnapshotsTestJSON-1209959778 None] Create snapshot completed successfully Nov 06 15:19:13 devstack cinder-volume[87132]: DEBUG cinder.coordination [req-f3f03c64-cd91-47c0-9cc0-6c725244a28f req-3481af0b-106e-4aef-8be4-17a8a13dbc27 tempest-VolumesSnapshotsTestJSON-1209959778 None] Acquiring lock "cinder-0020764b-555e-4c8f-9d44-959350408fc0-delete_snapshot" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:19:13 devstack cinder-volume[87132]: DEBUG cinder.coordination [req-f3f03c64-cd91-47c0-9cc0-6c725244a28f req-3481af0b-106e-4aef-8be4-17a8a13dbc27 tempest-VolumesSnapshotsTestJSON-1209959778 None] Lock "cinder-0020764b-555e-4c8f-9d44-959350408fc0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:19:13 devstack cinder-volume[87132]: DEBUG cinder.coordination [req-f3f03c64-cd91-47c0-9cc0-6c725244a28f req-3481af0b-106e-4aef-8be4-17a8a13dbc27 tempest-VolumesSnapshotsTestJSON-1209959778 None] Acquiring lock "cinder-quobyte-6ed86550-2ed8-442b-b960-af3415217c33" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:19:13 devstack cinder-volume[87132]: DEBUG cinder.coordination [req-f3f03c64-cd91-47c0-9cc0-6c725244a28f req-3481af0b-106e-4aef-8be4-17a8a13dbc27 tempest-VolumesSnapshotsTestJSON-1209959778 None] Lock "cinder-quobyte-6ed86550-2ed8-442b-b960-af3415217c33" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:19:13 devstack cinder-volume[87132]: DEBUG cinder.coordination [req-f3f03c64-cd91-47c0-9cc0-6c725244a28f req-3481af0b-106e-4aef-8be4-17a8a13dbc27 tempest-VolumesSnapshotsTestJSON-1209959778 None] Acquiring lock "cinder-quobyte-0020764b-555e-4c8f-9d44-959350408fc0" by "_delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:19:13 devstack cinder-volume[87132]: DEBUG cinder.coordination [req-f3f03c64-cd91-47c0-9cc0-6c725244a28f req-3481af0b-106e-4aef-8be4-17a8a13dbc27 tempest-VolumesSnapshotsTestJSON-1209959778 None] Lock "cinder-quobyte-0020764b-555e-4c8f-9d44-959350408fc0" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:19:13 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [req-f3f03c64-cd91-47c0-9cc0-6c725244a28f req-3481af0b-106e-4aef-8be4-17a8a13dbc27 tempest-VolumesSnapshotsTestJSON-1209959778 None] Deleting offline snapshot 0020764b-555e-4c8f-9d44-959350408fc0 of volume 6ed86550-2ed8-442b-b960-af3415217c33 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 15:19:13 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [req-f3f03c64-cd91-47c0-9cc0-6c725244a28f req-3481af0b-106e-4aef-8be4-17a8a13dbc27 tempest-VolumesSnapshotsTestJSON-1209959778 None] snapshot_file for this snap is: volume-6ed86550-2ed8-442b-b960-af3415217c33.0020764b-555e-4c8f-9d44-959350408fc0 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 15:19:13 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bd8e6fa-23ae-45bd-8250-91f2eb9b479e]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:19:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-f3f03c64-cd91-47c0-9cc0-6c725244a28f req-3481af0b-106e-4aef-8be4-17a8a13dbc27 tempest-VolumesSnapshotsTestJSON-1209959778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-6ed86550-2ed8-442b-b960-af3415217c33.0020764b-555e-4c8f-9d44-959350408fc0 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:19:13 devstack sudo[89333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-6ed86550-2ed8-442b-b960-af3415217c33.0020764b-555e-4c8f-9d44-959350408fc0 Nov 06 15:19:13 devstack sudo[89333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:19:13 devstack sudo[89333]: pam_unix(sudo:session): session closed for user root Nov 06 15:19:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-f3f03c64-cd91-47c0-9cc0-6c725244a28f req-3481af0b-106e-4aef-8be4-17a8a13dbc27 tempest-VolumesSnapshotsTestJSON-1209959778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-6ed86550-2ed8-442b-b960-af3415217c33.0020764b-555e-4c8f-9d44-959350408fc0" returned: 0 in 0.501s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:19:13 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [req-f3f03c64-cd91-47c0-9cc0-6c725244a28f req-3481af0b-106e-4aef-8be4-17a8a13dbc27 tempest-VolumesSnapshotsTestJSON-1209959778 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6ed86550-2ed8-442b-b960-af3415217c33(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 15:19:13 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[8202ce75-728b-4282-bc53-8dcf173e07c5]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:19:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-f3f03c64-cd91-47c0-9cc0-6c725244a28f req-3481af0b-106e-4aef-8be4-17a8a13dbc27 tempest-VolumesSnapshotsTestJSON-1209959778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-6ed86550-2ed8-442b-b960-af3415217c33 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:19:14 devstack sudo[89340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-6ed86550-2ed8-442b-b960-af3415217c33 Nov 06 15:19:14 devstack sudo[89340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:19:14 devstack sudo[89340]: pam_unix(sudo:session): session closed for user root Nov 06 15:19:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-f3f03c64-cd91-47c0-9cc0-6c725244a28f req-3481af0b-106e-4aef-8be4-17a8a13dbc27 tempest-VolumesSnapshotsTestJSON-1209959778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-6ed86550-2ed8-442b-b960-af3415217c33" returned: 0 in 0.462s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:19:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-f3f03c64-cd91-47c0-9cc0-6c725244a28f req-3481af0b-106e-4aef-8be4-17a8a13dbc27 tempest-VolumesSnapshotsTestJSON-1209959778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-6ed86550-2ed8-442b-b960-af3415217c33.0020764b-555e-4c8f-9d44-959350408fc0 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:19:14 devstack sudo[89345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-6ed86550-2ed8-442b-b960-af3415217c33.0020764b-555e-4c8f-9d44-959350408fc0 Nov 06 15:19:14 devstack sudo[89345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:19:14 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-814f1473-7f56-4268-bc9c-35f529c75d06 tempest-TaggedAttachmentsTest-362746116 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:19:14 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-814f1473-7f56-4268-bc9c-35f529c75d06 tempest-TaggedAttachmentsTest-362746116 None] Flow 'volume_create_manager' (178bd22f-a70e-4737-8414-e545d2cdce17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:19:14 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-814f1473-7f56-4268-bc9c-35f529c75d06 tempest-TaggedAttachmentsTest-362746116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa7a55e6-0226-4072-bda6-bf8c0d8e8880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:19:14 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-c0169b49-e794-4f66-b4a4-eec3d803468d tempest-GroupsV314Test-1406732119 None] Group tempest-GroupsV314Test-Group-153209919: creating Nov 06 15:19:14 devstack sudo[89345]: pam_unix(sudo:session): session closed for user root Nov 06 15:19:14 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-814f1473-7f56-4268-bc9c-35f529c75d06 tempest-TaggedAttachmentsTest-362746116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa7a55e6-0226-4072-bda6-bf8c0d8e8880) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:19:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1539729280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b8bbe11-cb71-4060-9b5a-d2a1c5edda5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='972ca398b1fd45918905651f7e08e9dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:19:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:19:15Z,use_quota=True,user_id='83fbb706db884173a78622d1512ed289',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:19:14 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-814f1473-7f56-4268-bc9c-35f529c75d06 tempest-TaggedAttachmentsTest-362746116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5905c6e0-e107-4b90-beba-ca3ce02b373a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:19:14 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-814f1473-7f56-4268-bc9c-35f529c75d06 tempest-TaggedAttachmentsTest-362746116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5905c6e0-e107-4b90-beba-ca3ce02b373a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:19:14 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-814f1473-7f56-4268-bc9c-35f529c75d06 tempest-TaggedAttachmentsTest-362746116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe9b4405-3ba3-4073-9ab9-5345194d952c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:19:14 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-814f1473-7f56-4268-bc9c-35f529c75d06 tempest-TaggedAttachmentsTest-362746116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe9b4405-3ba3-4073-9ab9-5345194d952c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b8bbe11-cb71-4060-9b5a-d2a1c5edda5f', 'volume_name': 'volume-5b8bbe11-cb71-4060-9b5a-d2a1c5edda5f', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:19:14 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-814f1473-7f56-4268-bc9c-35f529c75d06 tempest-TaggedAttachmentsTest-362746116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f36a7d04-e664-4e8a-9db5-6d1752457625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:19:14 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-814f1473-7f56-4268-bc9c-35f529c75d06 tempest-TaggedAttachmentsTest-362746116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f36a7d04-e664-4e8a-9db5-6d1752457625) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:19:14 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-814f1473-7f56-4268-bc9c-35f529c75d06 tempest-TaggedAttachmentsTest-362746116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (030fab7f-24e3-48aa-ac11-c7c4529c7abe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:19:14 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-814f1473-7f56-4268-bc9c-35f529c75d06 tempest-TaggedAttachmentsTest-362746116 None] Volume 5b8bbe11-cb71-4060-9b5a-d2a1c5edda5f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b8bbe11-cb71-4060-9b5a-d2a1c5edda5f', 'volume_size': 1} Nov 06 15:19:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-814f1473-7f56-4268-bc9c-35f529c75d06 tempest-TaggedAttachmentsTest-362746116 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:19:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-814f1473-7f56-4268-bc9c-35f529c75d06 tempest-TaggedAttachmentsTest-362746116 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:19:14 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-814f1473-7f56-4268-bc9c-35f529c75d06 tempest-TaggedAttachmentsTest-362746116 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:19:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1539729280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b8bbe11-cb71-4060-9b5a-d2a1c5edda5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='972ca398b1fd45918905651f7e08e9dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:19:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:19:15Z,use_quota=True,user_id='83fbb706db884173a78622d1512ed289',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:19:14 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-814f1473-7f56-4268-bc9c-35f529c75d06 tempest-TaggedAttachmentsTest-362746116 None] Creating volume 5b8bbe11-cb71-4060-9b5a-d2a1c5edda5f {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:19:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-814f1473-7f56-4268-bc9c-35f529c75d06 tempest-TaggedAttachmentsTest-362746116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:19:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-814f1473-7f56-4268-bc9c-35f529c75d06 tempest-TaggedAttachmentsTest-362746116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:19:14 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-814f1473-7f56-4268-bc9c-35f529c75d06 tempest-TaggedAttachmentsTest-362746116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:19:14 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-814f1473-7f56-4268-bc9c-35f529c75d06 tempest-TaggedAttachmentsTest-362746116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:19:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-814f1473-7f56-4268-bc9c-35f529c75d06 tempest-TaggedAttachmentsTest-362746116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:19:14 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-814f1473-7f56-4268-bc9c-35f529c75d06 tempest-TaggedAttachmentsTest-362746116 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:19:14 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-814f1473-7f56-4268-bc9c-35f529c75d06 tempest-TaggedAttachmentsTest-362746116 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:19:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-814f1473-7f56-4268-bc9c-35f529c75d06 tempest-TaggedAttachmentsTest-362746116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-5b8bbe11-cb71-4060-9b5a-d2a1c5edda5f 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:19:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-f3f03c64-cd91-47c0-9cc0-6c725244a28f req-3481af0b-106e-4aef-8be4-17a8a13dbc27 tempest-VolumesSnapshotsTestJSON-1209959778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-6ed86550-2ed8-442b-b960-af3415217c33.0020764b-555e-4c8f-9d44-959350408fc0" returned: 0 in 0.535s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:19:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-f3f03c64-cd91-47c0-9cc0-6c725244a28f req-3481af0b-106e-4aef-8be4-17a8a13dbc27 tempest-VolumesSnapshotsTestJSON-1209959778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-6ed86550-2ed8-442b-b960-af3415217c33.0020764b-555e-4c8f-9d44-959350408fc0 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:19:14 devstack sudo[89353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-5b8bbe11-cb71-4060-9b5a-d2a1c5edda5f 1073741824 Nov 06 15:19:14 devstack sudo[89353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:19:14 devstack sudo[89355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-6ed86550-2ed8-442b-b960-af3415217c33.0020764b-555e-4c8f-9d44-959350408fc0 Nov 06 15:19:14 devstack sudo[89355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:19:14 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-c0169b49-e794-4f66-b4a4-eec3d803468d tempest-GroupsV314Test-1406732119 None] Group tempest-GroupsV314Test-Group-153209919: created successfully Nov 06 15:19:14 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-c0169b49-e794-4f66-b4a4-eec3d803468d tempest-GroupsV314Test-1406732119 None] Create group completed successfully. Nov 06 15:19:15 devstack sudo[89355]: pam_unix(sudo:session): session closed for user root Nov 06 15:19:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-f3f03c64-cd91-47c0-9cc0-6c725244a28f req-3481af0b-106e-4aef-8be4-17a8a13dbc27 tempest-VolumesSnapshotsTestJSON-1209959778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-6ed86550-2ed8-442b-b960-af3415217c33.0020764b-555e-4c8f-9d44-959350408fc0" returned: 0 in 0.255s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:19:15 devstack cinder-volume[87132]: DEBUG cinder.coordination [req-f3f03c64-cd91-47c0-9cc0-6c725244a28f req-3481af0b-106e-4aef-8be4-17a8a13dbc27 tempest-VolumesSnapshotsTestJSON-1209959778 None] Lock "cinder-quobyte-0020764b-555e-4c8f-9d44-959350408fc0" released by "_delete_snapshot" :: held 1.909s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:19:15 devstack cinder-volume[87132]: DEBUG cinder.coordination [req-f3f03c64-cd91-47c0-9cc0-6c725244a28f req-3481af0b-106e-4aef-8be4-17a8a13dbc27 tempest-VolumesSnapshotsTestJSON-1209959778 None] Lock "cinder-quobyte-6ed86550-2ed8-442b-b960-af3415217c33" released by "delete_snapshot" :: held 1.946s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:19:15 devstack cinder-volume[87132]: WARNING cinder.quota [req-f3f03c64-cd91-47c0-9cc0-6c725244a28f req-3481af0b-106e-4aef-8be4-17a8a13dbc27 tempest-VolumesSnapshotsTestJSON-1209959778 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 06 15:19:15 devstack cinder-volume[87132]: DEBUG cinder.quota [req-f3f03c64-cd91-47c0-9cc0-6c725244a28f req-3481af0b-106e-4aef-8be4-17a8a13dbc27 tempest-VolumesSnapshotsTestJSON-1209959778 None] Created reservations ['ccaae506-bed9-4f79-ac29-eecb96c0499d', 'ccaa7d33-8989-48b0-abc4-d24856ed1d04', 'e18611d1-adae-47d0-9e23-778a82e2ec2c', 'dd87765c-6515-407e-b0d2-c95a4f73a5e5'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:19:15 devstack sudo[89353]: pam_unix(sudo:session): session closed for user root Nov 06 15:19:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-814f1473-7f56-4268-bc9c-35f529c75d06 tempest-TaggedAttachmentsTest-362746116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-5b8bbe11-cb71-4060-9b5a-d2a1c5edda5f 1073741824" returned: 0 in 0.442s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:19:15 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-f3f03c64-cd91-47c0-9cc0-6c725244a28f req-3481af0b-106e-4aef-8be4-17a8a13dbc27 tempest-VolumesSnapshotsTestJSON-1209959778 None] Delete snapshot completed successfully. Nov 06 15:19:15 devstack cinder-volume[87132]: DEBUG cinder.coordination [req-f3f03c64-cd91-47c0-9cc0-6c725244a28f req-3481af0b-106e-4aef-8be4-17a8a13dbc27 tempest-VolumesSnapshotsTestJSON-1209959778 None] Lock "cinder-0020764b-555e-4c8f-9d44-959350408fc0-delete_snapshot" released by "delete_snapshot" :: held 2.126s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:19:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-814f1473-7f56-4268-bc9c-35f529c75d06 tempest-TaggedAttachmentsTest-362746116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-5b8bbe11-cb71-4060-9b5a-d2a1c5edda5f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:19:15 devstack sudo[89364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-5b8bbe11-cb71-4060-9b5a-d2a1c5edda5f Nov 06 15:19:15 devstack sudo[89364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:19:15 devstack cinder-volume[87132]: DEBUG cinder.coordination [req-b724fb9c-908e-408a-ab87-8509842fc44a req-cbe61a17-0ac2-4620-87ae-1c9ebcc781b4 tempest-VolumesSnapshotsTestJSON-1209959778 None] Acquiring lock "cinder-6ed86550-2ed8-442b-b960-af3415217c33-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:19:15 devstack cinder-volume[87132]: DEBUG cinder.coordination [req-b724fb9c-908e-408a-ab87-8509842fc44a req-cbe61a17-0ac2-4620-87ae-1c9ebcc781b4 tempest-VolumesSnapshotsTestJSON-1209959778 None] Lock "cinder-6ed86550-2ed8-442b-b960-af3415217c33-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:19:15 devstack cinder-volume[87132]: DEBUG cinder.coordination [req-b724fb9c-908e-408a-ab87-8509842fc44a req-cbe61a17-0ac2-4620-87ae-1c9ebcc781b4 tempest-VolumesSnapshotsTestJSON-1209959778 None] Acquiring lock "cinder-quobyte-6ed86550-2ed8-442b-b960-af3415217c33" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:19:15 devstack sudo[89364]: pam_unix(sudo:session): session closed for user root Nov 06 15:19:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-814f1473-7f56-4268-bc9c-35f529c75d06 tempest-TaggedAttachmentsTest-362746116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-5b8bbe11-cb71-4060-9b5a-d2a1c5edda5f" returned: 0 in 0.279s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:19:15 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-814f1473-7f56-4268-bc9c-35f529c75d06 tempest-TaggedAttachmentsTest-362746116 None] <== create_volume: return (809ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:19:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-814f1473-7f56-4268-bc9c-35f529c75d06 tempest-TaggedAttachmentsTest-362746116 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.811s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:19:15 devstack cinder-volume[87132]: DEBUG cinder.coordination [req-b724fb9c-908e-408a-ab87-8509842fc44a req-cbe61a17-0ac2-4620-87ae-1c9ebcc781b4 tempest-VolumesSnapshotsTestJSON-1209959778 None] Lock "cinder-quobyte-6ed86550-2ed8-442b-b960-af3415217c33" acquired by "delete_volume" :: waited 0.021s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:19:15 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb49ae7c-6ba6-4378-98b7-eafe5321ee62]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:19:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-b724fb9c-908e-408a-ab87-8509842fc44a req-cbe61a17-0ac2-4620-87ae-1c9ebcc781b4 tempest-VolumesSnapshotsTestJSON-1209959778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-6ed86550-2ed8-442b-b960-af3415217c33 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:19:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-814f1473-7f56-4268-bc9c-35f529c75d06 tempest-TaggedAttachmentsTest-362746116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (030fab7f-24e3-48aa-ac11-c7c4529c7abe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b8bbe11-cb71-4060-9b5a-d2a1c5edda5f', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:19:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-814f1473-7f56-4268-bc9c-35f529c75d06 tempest-TaggedAttachmentsTest-362746116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ecd00be-71a2-4cd8-b29f-f2ed11bf4256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:19:15 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-814f1473-7f56-4268-bc9c-35f529c75d06 tempest-TaggedAttachmentsTest-362746116 None] Volume volume-5b8bbe11-cb71-4060-9b5a-d2a1c5edda5f (5b8bbe11-cb71-4060-9b5a-d2a1c5edda5f): created successfully Nov 06 15:19:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-814f1473-7f56-4268-bc9c-35f529c75d06 tempest-TaggedAttachmentsTest-362746116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ecd00be-71a2-4cd8-b29f-f2ed11bf4256) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:19:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-814f1473-7f56-4268-bc9c-35f529c75d06 tempest-TaggedAttachmentsTest-362746116 None] Flow 'volume_create_manager' (178bd22f-a70e-4737-8414-e545d2cdce17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:19:15 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-814f1473-7f56-4268-bc9c-35f529c75d06 tempest-TaggedAttachmentsTest-362746116 None] Created volume successfully. Nov 06 15:19:15 devstack sudo[89367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-6ed86550-2ed8-442b-b960-af3415217c33 Nov 06 15:19:15 devstack sudo[89367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:19:16 devstack sudo[89367]: pam_unix(sudo:session): session closed for user root Nov 06 15:19:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-b724fb9c-908e-408a-ab87-8509842fc44a req-cbe61a17-0ac2-4620-87ae-1c9ebcc781b4 tempest-VolumesSnapshotsTestJSON-1209959778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-6ed86550-2ed8-442b-b960-af3415217c33" returned: 0 in 0.425s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:19:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-b724fb9c-908e-408a-ab87-8509842fc44a req-cbe61a17-0ac2-4620-87ae-1c9ebcc781b4 tempest-VolumesSnapshotsTestJSON-1209959778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-6ed86550-2ed8-442b-b960-af3415217c33 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:19:16 devstack sudo[89372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-6ed86550-2ed8-442b-b960-af3415217c33 Nov 06 15:19:16 devstack sudo[89372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:19:16 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-9257c296-4b75-49d5-8767-74c83b0af7c6 tempest-GroupsV314Test-1406732119 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:19:16 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9257c296-4b75-49d5-8767-74c83b0af7c6 tempest-GroupsV314Test-1406732119 None] Flow 'volume_create_manager' (22b55bc9-29a3-4d12-b2c1-9da9234d721d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:19:16 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9257c296-4b75-49d5-8767-74c83b0af7c6 tempest-GroupsV314Test-1406732119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9031b5b-4017-4f82-a9be-8db94cb3c9cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:19:16 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9257c296-4b75-49d5-8767-74c83b0af7c6 tempest-GroupsV314Test-1406732119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9031b5b-4017-4f82-a9be-8db94cb3c9cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:19:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1437940196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ea7920cc-324e-4b5e-8b5d-45cdaacb380c,host='devstack@QuobyteHD#QuobyteHD',id=0630691d-2f3d-4f60-95b2-681c72bbb028,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9870b2d45154460a8edabad0c3134373',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:19:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:19:16Z,use_quota=True,user_id='65e323c38a2145f19a21ab9861bd3171',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81a7c298-cc45-4a49-b447-dec4e31eef6a),volume_type_id=81a7c298-cc45-4a49-b447-dec4e31eef6a)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:19:16 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9257c296-4b75-49d5-8767-74c83b0af7c6 tempest-GroupsV314Test-1406732119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd0f979d-ce7e-42c4-a71f-9573ec20010a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:19:16 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9257c296-4b75-49d5-8767-74c83b0af7c6 tempest-GroupsV314Test-1406732119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd0f979d-ce7e-42c4-a71f-9573ec20010a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:19:16 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9257c296-4b75-49d5-8767-74c83b0af7c6 tempest-GroupsV314Test-1406732119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d2eb765-b217-40c0-acf4-4433d61df2e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:19:16 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9257c296-4b75-49d5-8767-74c83b0af7c6 tempest-GroupsV314Test-1406732119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d2eb765-b217-40c0-acf4-4433d61df2e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0630691d-2f3d-4f60-95b2-681c72bbb028', 'volume_name': 'volume-0630691d-2f3d-4f60-95b2-681c72bbb028', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:19:16 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9257c296-4b75-49d5-8767-74c83b0af7c6 tempest-GroupsV314Test-1406732119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0615f1a-8668-4fce-9891-df3221c3dedc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:19:16 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9257c296-4b75-49d5-8767-74c83b0af7c6 tempest-GroupsV314Test-1406732119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0615f1a-8668-4fce-9891-df3221c3dedc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:19:16 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9257c296-4b75-49d5-8767-74c83b0af7c6 tempest-GroupsV314Test-1406732119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95280df9-579c-454e-b5eb-51ad6d5cd303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:19:16 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-9257c296-4b75-49d5-8767-74c83b0af7c6 tempest-GroupsV314Test-1406732119 None] Volume 0630691d-2f3d-4f60-95b2-681c72bbb028: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0630691d-2f3d-4f60-95b2-681c72bbb028', 'volume_size': 1} Nov 06 15:19:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9257c296-4b75-49d5-8767-74c83b0af7c6 tempest-GroupsV314Test-1406732119 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:19:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9257c296-4b75-49d5-8767-74c83b0af7c6 tempest-GroupsV314Test-1406732119 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:19:16 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-9257c296-4b75-49d5-8767-74c83b0af7c6 tempest-GroupsV314Test-1406732119 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=ea7920cc-324e-4b5e-8b5d-45cdaacb380c,created_at=2026-11-06T14:19:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1437940196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ea7920cc-324e-4b5e-8b5d-45cdaacb380c,host='devstack@QuobyteHD#QuobyteHD',id=0630691d-2f3d-4f60-95b2-681c72bbb028,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9870b2d45154460a8edabad0c3134373',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:19:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:19:16Z,use_quota=True,user_id='65e323c38a2145f19a21ab9861bd3171',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81a7c298-cc45-4a49-b447-dec4e31eef6a),volume_type_id=81a7c298-cc45-4a49-b447-dec4e31eef6a)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:19:16 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-9257c296-4b75-49d5-8767-74c83b0af7c6 tempest-GroupsV314Test-1406732119 None] Creating volume 0630691d-2f3d-4f60-95b2-681c72bbb028 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:19:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9257c296-4b75-49d5-8767-74c83b0af7c6 tempest-GroupsV314Test-1406732119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:19:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9257c296-4b75-49d5-8767-74c83b0af7c6 tempest-GroupsV314Test-1406732119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:19:16 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-9257c296-4b75-49d5-8767-74c83b0af7c6 tempest-GroupsV314Test-1406732119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:19:16 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-9257c296-4b75-49d5-8767-74c83b0af7c6 tempest-GroupsV314Test-1406732119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:19:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9257c296-4b75-49d5-8767-74c83b0af7c6 tempest-GroupsV314Test-1406732119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:19:16 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-9257c296-4b75-49d5-8767-74c83b0af7c6 tempest-GroupsV314Test-1406732119 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:19:16 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-9257c296-4b75-49d5-8767-74c83b0af7c6 tempest-GroupsV314Test-1406732119 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:19:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9257c296-4b75-49d5-8767-74c83b0af7c6 tempest-GroupsV314Test-1406732119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0630691d-2f3d-4f60-95b2-681c72bbb028 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:19:16 devstack sudo[89372]: pam_unix(sudo:session): session closed for user root Nov 06 15:19:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-b724fb9c-908e-408a-ab87-8509842fc44a req-cbe61a17-0ac2-4620-87ae-1c9ebcc781b4 tempest-VolumesSnapshotsTestJSON-1209959778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-6ed86550-2ed8-442b-b960-af3415217c33" returned: 0 in 0.285s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:19:16 devstack sudo[89375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0630691d-2f3d-4f60-95b2-681c72bbb028 1073741824 Nov 06 15:19:16 devstack sudo[89375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:19:16 devstack cinder-volume[87132]: DEBUG cinder.coordination [req-b724fb9c-908e-408a-ab87-8509842fc44a req-cbe61a17-0ac2-4620-87ae-1c9ebcc781b4 tempest-VolumesSnapshotsTestJSON-1209959778 None] Lock "cinder-quobyte-6ed86550-2ed8-442b-b960-af3415217c33" released by "delete_volume" :: held 0.922s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:19:16 devstack cinder-volume[87132]: DEBUG cinder.quota [req-b724fb9c-908e-408a-ab87-8509842fc44a req-cbe61a17-0ac2-4620-87ae-1c9ebcc781b4 tempest-VolumesSnapshotsTestJSON-1209959778 None] Created reservations ['5181d288-7100-423d-9cdb-f28f73a819a1', '02f69ce3-1e12-43d9-b93f-04b8062dde78', 'e613ec60-fb65-4876-905b-2c7ac3d39008', '1b6a2f18-f187-495d-b5e6-106ea08414a0'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:19:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-b724fb9c-908e-408a-ab87-8509842fc44a req-cbe61a17-0ac2-4620-87ae-1c9ebcc781b4 tempest-VolumesSnapshotsTestJSON-1209959778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:19:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-b724fb9c-908e-408a-ab87-8509842fc44a req-cbe61a17-0ac2-4620-87ae-1c9ebcc781b4 tempest-VolumesSnapshotsTestJSON-1209959778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:19:16 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [req-b724fb9c-908e-408a-ab87-8509842fc44a req-cbe61a17-0ac2-4620-87ae-1c9ebcc781b4 tempest-VolumesSnapshotsTestJSON-1209959778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:19:16 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [req-b724fb9c-908e-408a-ab87-8509842fc44a req-cbe61a17-0ac2-4620-87ae-1c9ebcc781b4 tempest-VolumesSnapshotsTestJSON-1209959778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:19:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-b724fb9c-908e-408a-ab87-8509842fc44a req-cbe61a17-0ac2-4620-87ae-1c9ebcc781b4 tempest-VolumesSnapshotsTestJSON-1209959778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:19:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-b724fb9c-908e-408a-ab87-8509842fc44a req-cbe61a17-0ac2-4620-87ae-1c9ebcc781b4 tempest-VolumesSnapshotsTestJSON-1209959778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:19:16 devstack sudo[89382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:19:16 devstack sudo[89382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:19:17 devstack sudo[89375]: pam_unix(sudo:session): session closed for user root Nov 06 15:19:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9257c296-4b75-49d5-8767-74c83b0af7c6 tempest-GroupsV314Test-1406732119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0630691d-2f3d-4f60-95b2-681c72bbb028 1073741824" returned: 0 in 0.701s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:19:17 devstack sudo[89382]: pam_unix(sudo:session): session closed for user root Nov 06 15:19:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-b724fb9c-908e-408a-ab87-8509842fc44a req-cbe61a17-0ac2-4620-87ae-1c9ebcc781b4 tempest-VolumesSnapshotsTestJSON-1209959778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.328s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:19:17 devstack cinder-volume[87132]: DEBUG cinder.manager [req-b724fb9c-908e-408a-ab87-8509842fc44a req-cbe61a17-0ac2-4620-87ae-1c9ebcc781b4 tempest-VolumesSnapshotsTestJSON-1209959778 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:19:17 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-b724fb9c-908e-408a-ab87-8509842fc44a req-cbe61a17-0ac2-4620-87ae-1c9ebcc781b4 tempest-VolumesSnapshotsTestJSON-1209959778 None] Deleted volume successfully. Nov 06 15:19:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9257c296-4b75-49d5-8767-74c83b0af7c6 tempest-GroupsV314Test-1406732119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0630691d-2f3d-4f60-95b2-681c72bbb028 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:19:17 devstack cinder-volume[87132]: DEBUG cinder.coordination [req-b724fb9c-908e-408a-ab87-8509842fc44a req-cbe61a17-0ac2-4620-87ae-1c9ebcc781b4 tempest-VolumesSnapshotsTestJSON-1209959778 None] Lock "cinder-6ed86550-2ed8-442b-b960-af3415217c33-delete_volume" released by "delete_volume" :: held 1.691s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:19:17 devstack sudo[89386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0630691d-2f3d-4f60-95b2-681c72bbb028 Nov 06 15:19:17 devstack sudo[89386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:19:17 devstack sudo[89386]: pam_unix(sudo:session): session closed for user root Nov 06 15:19:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9257c296-4b75-49d5-8767-74c83b0af7c6 tempest-GroupsV314Test-1406732119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0630691d-2f3d-4f60-95b2-681c72bbb028" returned: 0 in 0.281s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:19:17 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-9257c296-4b75-49d5-8767-74c83b0af7c6 tempest-GroupsV314Test-1406732119 None] <== create_volume: return (1045ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:19:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9257c296-4b75-49d5-8767-74c83b0af7c6 tempest-GroupsV314Test-1406732119 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.048s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:19:17 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9257c296-4b75-49d5-8767-74c83b0af7c6 tempest-GroupsV314Test-1406732119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95280df9-579c-454e-b5eb-51ad6d5cd303) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0630691d-2f3d-4f60-95b2-681c72bbb028', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:19:17 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9257c296-4b75-49d5-8767-74c83b0af7c6 tempest-GroupsV314Test-1406732119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d52bdc9-dfcc-40b3-9128-539c12ce232a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:19:17 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-9257c296-4b75-49d5-8767-74c83b0af7c6 tempest-GroupsV314Test-1406732119 None] Volume volume-0630691d-2f3d-4f60-95b2-681c72bbb028 (0630691d-2f3d-4f60-95b2-681c72bbb028): created successfully Nov 06 15:19:17 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9257c296-4b75-49d5-8767-74c83b0af7c6 tempest-GroupsV314Test-1406732119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d52bdc9-dfcc-40b3-9128-539c12ce232a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:19:17 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9257c296-4b75-49d5-8767-74c83b0af7c6 tempest-GroupsV314Test-1406732119 None] Flow 'volume_create_manager' (22b55bc9-29a3-4d12-b2c1-9da9234d721d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:19:17 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-9257c296-4b75-49d5-8767-74c83b0af7c6 tempest-GroupsV314Test-1406732119 None] Created volume successfully. Nov 06 15:19:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0439b0e4-3ceb-43ba-ac8c-3d9ebb8ee1f8 tempest-GroupsV314Test-1406732119 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:19:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0439b0e4-3ceb-43ba-ac8c-3d9ebb8ee1f8 tempest-GroupsV314Test-1406732119 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:19:18 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-0439b0e4-3ceb-43ba-ac8c-3d9ebb8ee1f8 tempest-GroupsV314Test-1406732119 None] Cloning volume 0630691d-2f3d-4f60-95b2-681c72bbb028 to volume 6844bdc2-d842-4102-b737-6e2eea23db76 Nov 06 15:19:18 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-0439b0e4-3ceb-43ba-ac8c-3d9ebb8ee1f8 tempest-GroupsV314Test-1406732119 None] Creating offline snapshot 22a9ebf1-2a2e-48e6-b6d7-b7a020918dec of volume 0630691d-2f3d-4f60-95b2-681c72bbb028 {{(pid=87132) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 15:19:18 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[163225fa-ff52-4cfb-8194-9b5785b0489d]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:19:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0439b0e4-3ceb-43ba-ac8c-3d9ebb8ee1f8 tempest-GroupsV314Test-1406732119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0630691d-2f3d-4f60-95b2-681c72bbb028 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:19:18 devstack sudo[89390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0630691d-2f3d-4f60-95b2-681c72bbb028 Nov 06 15:19:18 devstack sudo[89390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:19:19 devstack sudo[89390]: pam_unix(sudo:session): session closed for user root Nov 06 15:19:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0439b0e4-3ceb-43ba-ac8c-3d9ebb8ee1f8 tempest-GroupsV314Test-1406732119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0630691d-2f3d-4f60-95b2-681c72bbb028" returned: 0 in 0.487s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:19:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0439b0e4-3ceb-43ba-ac8c-3d9ebb8ee1f8 tempest-GroupsV314Test-1406732119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0630691d-2f3d-4f60-95b2-681c72bbb028,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0630691d-2f3d-4f60-95b2-681c72bbb028.22a9ebf1-2a2e-48e6-b6d7-b7a020918dec 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:19:19 devstack sudo[89395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0630691d-2f3d-4f60-95b2-681c72bbb028,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0630691d-2f3d-4f60-95b2-681c72bbb028.22a9ebf1-2a2e-48e6-b6d7-b7a020918dec 1G Nov 06 15:19:19 devstack sudo[89395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:19:19 devstack sudo[89395]: pam_unix(sudo:session): session closed for user root Nov 06 15:19:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0439b0e4-3ceb-43ba-ac8c-3d9ebb8ee1f8 tempest-GroupsV314Test-1406732119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0630691d-2f3d-4f60-95b2-681c72bbb028,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0630691d-2f3d-4f60-95b2-681c72bbb028.22a9ebf1-2a2e-48e6-b6d7-b7a020918dec 1G" returned: 0 in 0.582s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:19:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0439b0e4-3ceb-43ba-ac8c-3d9ebb8ee1f8 tempest-GroupsV314Test-1406732119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0630691d-2f3d-4f60-95b2-681c72bbb028 -F qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0630691d-2f3d-4f60-95b2-681c72bbb028.22a9ebf1-2a2e-48e6-b6d7-b7a020918dec {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:19:19 devstack sudo[89401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0630691d-2f3d-4f60-95b2-681c72bbb028 -F qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0630691d-2f3d-4f60-95b2-681c72bbb028.22a9ebf1-2a2e-48e6-b6d7-b7a020918dec Nov 06 15:19:19 devstack sudo[89401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:19:20 devstack sudo[89401]: pam_unix(sudo:session): session closed for user root Nov 06 15:19:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0439b0e4-3ceb-43ba-ac8c-3d9ebb8ee1f8 tempest-GroupsV314Test-1406732119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0630691d-2f3d-4f60-95b2-681c72bbb028 -F qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0630691d-2f3d-4f60-95b2-681c72bbb028.22a9ebf1-2a2e-48e6-b6d7-b7a020918dec" returned: 0 in 0.339s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:19:20 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-0439b0e4-3ceb-43ba-ac8c-3d9ebb8ee1f8 tempest-GroupsV314Test-1406732119 None] /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0630691d-2f3d-4f60-95b2-681c72bbb028.22a9ebf1-2a2e-48e6-b6d7-b7a020918dec is being set with open permissions: ugo+rw: NotImplementedError Nov 06 15:19:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0439b0e4-3ceb-43ba-ac8c-3d9ebb8ee1f8 tempest-GroupsV314Test-1406732119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0630691d-2f3d-4f60-95b2-681c72bbb028.22a9ebf1-2a2e-48e6-b6d7-b7a020918dec {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:19:20 devstack sudo[89407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0630691d-2f3d-4f60-95b2-681c72bbb028.22a9ebf1-2a2e-48e6-b6d7-b7a020918dec Nov 06 15:19:20 devstack sudo[89407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:19:20 devstack sudo[89407]: pam_unix(sudo:session): session closed for user root Nov 06 15:19:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0439b0e4-3ceb-43ba-ac8c-3d9ebb8ee1f8 tempest-GroupsV314Test-1406732119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0630691d-2f3d-4f60-95b2-681c72bbb028.22a9ebf1-2a2e-48e6-b6d7-b7a020918dec" returned: 0 in 0.291s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:19:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0439b0e4-3ceb-43ba-ac8c-3d9ebb8ee1f8 tempest-GroupsV314Test-1406732119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0630691d-2f3d-4f60-95b2-681c72bbb028.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:19:20 devstack sudo[89410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0630691d-2f3d-4f60-95b2-681c72bbb028.info Nov 06 15:19:20 devstack sudo[89410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:19:20 devstack sudo[89410]: pam_unix(sudo:session): session closed for user root Nov 06 15:19:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0439b0e4-3ceb-43ba-ac8c-3d9ebb8ee1f8 tempest-GroupsV314Test-1406732119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0630691d-2f3d-4f60-95b2-681c72bbb028.info" returned: 0 in 0.332s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:19:20 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-0439b0e4-3ceb-43ba-ac8c-3d9ebb8ee1f8 tempest-GroupsV314Test-1406732119 None] /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0630691d-2f3d-4f60-95b2-681c72bbb028.info is being set with open permissions: ugo+rw: NotImplementedError Nov 06 15:19:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0439b0e4-3ceb-43ba-ac8c-3d9ebb8ee1f8 tempest-GroupsV314Test-1406732119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0630691d-2f3d-4f60-95b2-681c72bbb028.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:19:20 devstack sudo[89413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0630691d-2f3d-4f60-95b2-681c72bbb028.info Nov 06 15:19:20 devstack sudo[89413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:19:21 devstack sudo[89413]: pam_unix(sudo:session): session closed for user root Nov 06 15:19:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0439b0e4-3ceb-43ba-ac8c-3d9ebb8ee1f8 tempest-GroupsV314Test-1406732119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0630691d-2f3d-4f60-95b2-681c72bbb028.info" returned: 0 in 0.317s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:19:21 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-0439b0e4-3ceb-43ba-ac8c-3d9ebb8ee1f8 tempest-GroupsV314Test-1406732119 None] Acquiring lock "cinder-quobyte-6844bdc2-d842-4102-b737-6e2eea23db76" by "_copy_volume_from_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:19:21 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-0439b0e4-3ceb-43ba-ac8c-3d9ebb8ee1f8 tempest-GroupsV314Test-1406732119 None] Lock "cinder-quobyte-6844bdc2-d842-4102-b737-6e2eea23db76" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:19:21 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0439b0e4-3ceb-43ba-ac8c-3d9ebb8ee1f8 tempest-GroupsV314Test-1406732119 None] snapshot: 22a9ebf1-2a2e-48e6-b6d7-b7a020918dec, volume: 6844bdc2-d842-4102-b737-6e2eea23db76, {{(pid=87132) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 06 15:19:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0439b0e4-3ceb-43ba-ac8c-3d9ebb8ee1f8 tempest-GroupsV314Test-1406732119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:19:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0439b0e4-3ceb-43ba-ac8c-3d9ebb8ee1f8 tempest-GroupsV314Test-1406732119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:19:21 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0439b0e4-3ceb-43ba-ac8c-3d9ebb8ee1f8 tempest-GroupsV314Test-1406732119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:19:21 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0439b0e4-3ceb-43ba-ac8c-3d9ebb8ee1f8 tempest-GroupsV314Test-1406732119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:19:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0439b0e4-3ceb-43ba-ac8c-3d9ebb8ee1f8 tempest-GroupsV314Test-1406732119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:19:21 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ed35921-e11a-4df4-8c53-e182a30c2e5b]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:19:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0439b0e4-3ceb-43ba-ac8c-3d9ebb8ee1f8 tempest-GroupsV314Test-1406732119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0630691d-2f3d-4f60-95b2-681c72bbb028.22a9ebf1-2a2e-48e6-b6d7-b7a020918dec {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:19:21 devstack sudo[89416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0630691d-2f3d-4f60-95b2-681c72bbb028.22a9ebf1-2a2e-48e6-b6d7-b7a020918dec Nov 06 15:19:21 devstack sudo[89416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:19:21 devstack sudo[89416]: pam_unix(sudo:session): session closed for user root Nov 06 15:19:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0439b0e4-3ceb-43ba-ac8c-3d9ebb8ee1f8 tempest-GroupsV314Test-1406732119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0630691d-2f3d-4f60-95b2-681c72bbb028.22a9ebf1-2a2e-48e6-b6d7-b7a020918dec" returned: 0 in 0.629s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:19:21 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-0439b0e4-3ceb-43ba-ac8c-3d9ebb8ee1f8 tempest-GroupsV314Test-1406732119 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0630691d-2f3d-4f60-95b2-681c72bbb028(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 15:19:21 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[f562c9d8-0759-430d-8920-0a991c56ca17]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:19:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0439b0e4-3ceb-43ba-ac8c-3d9ebb8ee1f8 tempest-GroupsV314Test-1406732119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0630691d-2f3d-4f60-95b2-681c72bbb028 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:19:22 devstack sudo[89425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0630691d-2f3d-4f60-95b2-681c72bbb028 Nov 06 15:19:22 devstack sudo[89425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:19:22 devstack sudo[89425]: pam_unix(sudo:session): session closed for user root Nov 06 15:19:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0439b0e4-3ceb-43ba-ac8c-3d9ebb8ee1f8 tempest-GroupsV314Test-1406732119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0630691d-2f3d-4f60-95b2-681c72bbb028" returned: 0 in 0.576s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:19:22 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0439b0e4-3ceb-43ba-ac8c-3d9ebb8ee1f8 tempest-GroupsV314Test-1406732119 None] will copy from snapshot at /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0630691d-2f3d-4f60-95b2-681c72bbb028 {{(pid=87132) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 06 15:19:22 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0439b0e4-3ceb-43ba-ac8c-3d9ebb8ee1f8 tempest-GroupsV314Test-1406732119 None] Creating direct copy from snapshot {{(pid=87132) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 06 15:19:22 devstack cinder-volume[87132]: DEBUG cinder.utils [None req-0439b0e4-3ceb-43ba-ac8c-3d9ebb8ee1f8 tempest-GroupsV314Test-1406732119 None] Path /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-6844bdc2-d842-4102-b737-6e2eea23db76 not found in is_blk_device check {{(pid=87132) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 06 15:19:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0439b0e4-3ceb-43ba-ac8c-3d9ebb8ee1f8 tempest-GroupsV314Test-1406732119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0630691d-2f3d-4f60-95b2-681c72bbb028 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-6844bdc2-d842-4102-b737-6e2eea23db76 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:19:22 devstack sudo[89433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0630691d-2f3d-4f60-95b2-681c72bbb028 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-6844bdc2-d842-4102-b737-6e2eea23db76 Nov 06 15:19:22 devstack sudo[89433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:19:24 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [req-ba80e4a3-54df-4996-90f8-4470b7882cda req-315cea8b-0d35-4d4b-8466-1026dda35c0a tempest-VolumesGetTestJSON-2146517358 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:19:24 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-ba80e4a3-54df-4996-90f8-4470b7882cda req-315cea8b-0d35-4d4b-8466-1026dda35c0a tempest-VolumesGetTestJSON-2146517358 None] Flow 'volume_create_manager' (1cf27185-e4ae-41a3-a526-438a5abafffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:19:24 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-ba80e4a3-54df-4996-90f8-4470b7882cda req-315cea8b-0d35-4d4b-8466-1026dda35c0a tempest-VolumesGetTestJSON-2146517358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04509dd8-5c81-4874-a3c2-184fe4fc1d92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:19:24 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-ba80e4a3-54df-4996-90f8-4470b7882cda req-315cea8b-0d35-4d4b-8466-1026dda35c0a tempest-VolumesGetTestJSON-2146517358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04509dd8-5c81-4874-a3c2-184fe4fc1d92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:19:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-2023793068',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=722eb807-f02b-4e50-b9f6-aa9f9119f50b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0cb59e8ab8f84d86a28db080d5850341',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:19:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:19:25Z,use_quota=True,user_id='b25621a8121d4d238773e91b2dd21b1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:19:24 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-ba80e4a3-54df-4996-90f8-4470b7882cda req-315cea8b-0d35-4d4b-8466-1026dda35c0a tempest-VolumesGetTestJSON-2146517358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c29b0a0b-2b70-4b21-884d-49b2e6de7955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:19:24 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-ba80e4a3-54df-4996-90f8-4470b7882cda req-315cea8b-0d35-4d4b-8466-1026dda35c0a tempest-VolumesGetTestJSON-2146517358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c29b0a0b-2b70-4b21-884d-49b2e6de7955) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:19:24 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-ba80e4a3-54df-4996-90f8-4470b7882cda req-315cea8b-0d35-4d4b-8466-1026dda35c0a tempest-VolumesGetTestJSON-2146517358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3ce9fb6-69b2-4de0-97ee-a4633cf1fd5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:19:24 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-ba80e4a3-54df-4996-90f8-4470b7882cda req-315cea8b-0d35-4d4b-8466-1026dda35c0a tempest-VolumesGetTestJSON-2146517358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3ce9fb6-69b2-4de0-97ee-a4633cf1fd5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '722eb807-f02b-4e50-b9f6-aa9f9119f50b', 'volume_name': 'volume-722eb807-f02b-4e50-b9f6-aa9f9119f50b', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:19:24 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-ba80e4a3-54df-4996-90f8-4470b7882cda req-315cea8b-0d35-4d4b-8466-1026dda35c0a tempest-VolumesGetTestJSON-2146517358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57e838ec-7f91-4364-bdf9-5adab2438368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:19:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-ba80e4a3-54df-4996-90f8-4470b7882cda req-315cea8b-0d35-4d4b-8466-1026dda35c0a tempest-VolumesGetTestJSON-2146517358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57e838ec-7f91-4364-bdf9-5adab2438368) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:19:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-ba80e4a3-54df-4996-90f8-4470b7882cda req-315cea8b-0d35-4d4b-8466-1026dda35c0a tempest-VolumesGetTestJSON-2146517358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3257d04-3ace-4905-a2f0-2fa5ceb3fc71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:19:25 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [req-ba80e4a3-54df-4996-90f8-4470b7882cda req-315cea8b-0d35-4d4b-8466-1026dda35c0a tempest-VolumesGetTestJSON-2146517358 None] Volume 722eb807-f02b-4e50-b9f6-aa9f9119f50b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-722eb807-f02b-4e50-b9f6-aa9f9119f50b', 'volume_size': 1} Nov 06 15:19:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-ba80e4a3-54df-4996-90f8-4470b7882cda req-315cea8b-0d35-4d4b-8466-1026dda35c0a tempest-VolumesGetTestJSON-2146517358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:19:32 devstack sudo[89433]: pam_unix(sudo:session): session closed for user root Nov 06 15:19:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0439b0e4-3ceb-43ba-ac8c-3d9ebb8ee1f8 tempest-GroupsV314Test-1406732119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0630691d-2f3d-4f60-95b2-681c72bbb028 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-6844bdc2-d842-4102-b737-6e2eea23db76" returned: 0 in 9.926s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:19:32 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-0439b0e4-3ceb-43ba-ac8c-3d9ebb8ee1f8 tempest-GroupsV314Test-1406732119 None] Image conversion details: src /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0630691d-2f3d-4f60-95b2-681c72bbb028, size 1024.00 MB, duration 9.93 sec, destination /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-6844bdc2-d842-4102-b737-6e2eea23db76 {{(pid=87132) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 06 15:19:32 devstack cinder-volume[87132]: INFO cinder.image.image_utils [None req-0439b0e4-3ceb-43ba-ac8c-3d9ebb8ee1f8 tempest-GroupsV314Test-1406732119 None] Converted 1024.00 MB image at 103.15 MB/s Nov 06 15:19:32 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-0439b0e4-3ceb-43ba-ac8c-3d9ebb8ee1f8 tempest-GroupsV314Test-1406732119 None] /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-6844bdc2-d842-4102-b737-6e2eea23db76 is being set with open permissions: ugo+rw: NotImplementedError Nov 06 15:19:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0439b0e4-3ceb-43ba-ac8c-3d9ebb8ee1f8 tempest-GroupsV314Test-1406732119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-6844bdc2-d842-4102-b737-6e2eea23db76 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:19:32 devstack sudo[89531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-6844bdc2-d842-4102-b737-6e2eea23db76 Nov 06 15:19:32 devstack sudo[89531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:19:32 devstack sudo[89531]: pam_unix(sudo:session): session closed for user root Nov 06 15:19:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0439b0e4-3ceb-43ba-ac8c-3d9ebb8ee1f8 tempest-GroupsV314Test-1406732119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-6844bdc2-d842-4102-b737-6e2eea23db76" returned: 0 in 0.332s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:19:32 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-0439b0e4-3ceb-43ba-ac8c-3d9ebb8ee1f8 tempest-GroupsV314Test-1406732119 None] Lock "cinder-quobyte-6844bdc2-d842-4102-b737-6e2eea23db76" released by "_copy_volume_from_snapshot" :: held 11.587s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:19:32 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-0439b0e4-3ceb-43ba-ac8c-3d9ebb8ee1f8 tempest-GroupsV314Test-1406732119 None] Acquiring lock "cinder-quobyte-22a9ebf1-2a2e-48e6-b6d7-b7a020918dec" by "_delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:19:32 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-0439b0e4-3ceb-43ba-ac8c-3d9ebb8ee1f8 tempest-GroupsV314Test-1406732119 None] Lock "cinder-quobyte-22a9ebf1-2a2e-48e6-b6d7-b7a020918dec" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:19:32 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-0439b0e4-3ceb-43ba-ac8c-3d9ebb8ee1f8 tempest-GroupsV314Test-1406732119 None] Deleting offline snapshot 22a9ebf1-2a2e-48e6-b6d7-b7a020918dec of volume 0630691d-2f3d-4f60-95b2-681c72bbb028 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 15:19:32 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-0439b0e4-3ceb-43ba-ac8c-3d9ebb8ee1f8 tempest-GroupsV314Test-1406732119 None] snapshot_file for this snap is: volume-0630691d-2f3d-4f60-95b2-681c72bbb028.22a9ebf1-2a2e-48e6-b6d7-b7a020918dec {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 15:19:32 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fcf45b1-bd9c-4172-aedd-ac172ddb332f]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:19:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0439b0e4-3ceb-43ba-ac8c-3d9ebb8ee1f8 tempest-GroupsV314Test-1406732119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0630691d-2f3d-4f60-95b2-681c72bbb028.22a9ebf1-2a2e-48e6-b6d7-b7a020918dec {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:19:33 devstack sudo[89553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0630691d-2f3d-4f60-95b2-681c72bbb028.22a9ebf1-2a2e-48e6-b6d7-b7a020918dec Nov 06 15:19:33 devstack sudo[89553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:19:33 devstack sudo[89553]: pam_unix(sudo:session): session closed for user root Nov 06 15:19:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0439b0e4-3ceb-43ba-ac8c-3d9ebb8ee1f8 tempest-GroupsV314Test-1406732119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0630691d-2f3d-4f60-95b2-681c72bbb028.22a9ebf1-2a2e-48e6-b6d7-b7a020918dec" returned: 0 in 0.613s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:19:33 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-0439b0e4-3ceb-43ba-ac8c-3d9ebb8ee1f8 tempest-GroupsV314Test-1406732119 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0630691d-2f3d-4f60-95b2-681c72bbb028(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 15:19:33 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[83514943-04c8-4e4b-9de9-a8e43670bd51]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:19:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0439b0e4-3ceb-43ba-ac8c-3d9ebb8ee1f8 tempest-GroupsV314Test-1406732119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0630691d-2f3d-4f60-95b2-681c72bbb028 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:19:33 devstack sudo[89559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0630691d-2f3d-4f60-95b2-681c72bbb028 Nov 06 15:19:33 devstack sudo[89559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:19:34 devstack sudo[89559]: pam_unix(sudo:session): session closed for user root Nov 06 15:19:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0439b0e4-3ceb-43ba-ac8c-3d9ebb8ee1f8 tempest-GroupsV314Test-1406732119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0630691d-2f3d-4f60-95b2-681c72bbb028" returned: 0 in 1.038s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:19:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0439b0e4-3ceb-43ba-ac8c-3d9ebb8ee1f8 tempest-GroupsV314Test-1406732119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0630691d-2f3d-4f60-95b2-681c72bbb028.22a9ebf1-2a2e-48e6-b6d7-b7a020918dec {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:19:34 devstack sudo[89568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0630691d-2f3d-4f60-95b2-681c72bbb028.22a9ebf1-2a2e-48e6-b6d7-b7a020918dec Nov 06 15:19:34 devstack sudo[89568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:19:34 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:SELECT=36,cinder:INSERT=11,cinder:UPDATE=34,cinder:DELETE=3 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 15:19:35 devstack sudo[89568]: pam_unix(sudo:session): session closed for user root Nov 06 15:19:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0439b0e4-3ceb-43ba-ac8c-3d9ebb8ee1f8 tempest-GroupsV314Test-1406732119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0630691d-2f3d-4f60-95b2-681c72bbb028.22a9ebf1-2a2e-48e6-b6d7-b7a020918dec" returned: 0 in 0.474s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:19:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0439b0e4-3ceb-43ba-ac8c-3d9ebb8ee1f8 tempest-GroupsV314Test-1406732119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0630691d-2f3d-4f60-95b2-681c72bbb028.22a9ebf1-2a2e-48e6-b6d7-b7a020918dec {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:19:35 devstack sudo[89574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0630691d-2f3d-4f60-95b2-681c72bbb028.22a9ebf1-2a2e-48e6-b6d7-b7a020918dec Nov 06 15:19:35 devstack sudo[89574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:19:35 devstack sudo[89574]: pam_unix(sudo:session): session closed for user root Nov 06 15:19:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0439b0e4-3ceb-43ba-ac8c-3d9ebb8ee1f8 tempest-GroupsV314Test-1406732119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0630691d-2f3d-4f60-95b2-681c72bbb028.22a9ebf1-2a2e-48e6-b6d7-b7a020918dec" returned: 0 in 0.334s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:19:35 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-0439b0e4-3ceb-43ba-ac8c-3d9ebb8ee1f8 tempest-GroupsV314Test-1406732119 None] Lock "cinder-quobyte-22a9ebf1-2a2e-48e6-b6d7-b7a020918dec" released by "_delete_snapshot" :: held 2.681s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:19:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0439b0e4-3ceb-43ba-ac8c-3d9ebb8ee1f8 tempest-GroupsV314Test-1406732119 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.916s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:19:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-ba80e4a3-54df-4996-90f8-4470b7882cda req-315cea8b-0d35-4d4b-8466-1026dda35c0a tempest-VolumesGetTestJSON-2146517358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.522s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:19:35 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [req-ba80e4a3-54df-4996-90f8-4470b7882cda req-315cea8b-0d35-4d4b-8466-1026dda35c0a tempest-VolumesGetTestJSON-2146517358 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:19:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-2023793068',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=722eb807-f02b-4e50-b9f6-aa9f9119f50b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0cb59e8ab8f84d86a28db080d5850341',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:19:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:19:25Z,use_quota=True,user_id='b25621a8121d4d238773e91b2dd21b1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:19:35 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [req-ba80e4a3-54df-4996-90f8-4470b7882cda req-315cea8b-0d35-4d4b-8466-1026dda35c0a tempest-VolumesGetTestJSON-2146517358 None] Creating volume 722eb807-f02b-4e50-b9f6-aa9f9119f50b {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:19:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-ba80e4a3-54df-4996-90f8-4470b7882cda req-315cea8b-0d35-4d4b-8466-1026dda35c0a tempest-VolumesGetTestJSON-2146517358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:19:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-ba80e4a3-54df-4996-90f8-4470b7882cda req-315cea8b-0d35-4d4b-8466-1026dda35c0a tempest-VolumesGetTestJSON-2146517358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:19:35 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [req-ba80e4a3-54df-4996-90f8-4470b7882cda req-315cea8b-0d35-4d4b-8466-1026dda35c0a tempest-VolumesGetTestJSON-2146517358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:19:35 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [req-ba80e4a3-54df-4996-90f8-4470b7882cda req-315cea8b-0d35-4d4b-8466-1026dda35c0a tempest-VolumesGetTestJSON-2146517358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:19:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-ba80e4a3-54df-4996-90f8-4470b7882cda req-315cea8b-0d35-4d4b-8466-1026dda35c0a tempest-VolumesGetTestJSON-2146517358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:19:35 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [req-ba80e4a3-54df-4996-90f8-4470b7882cda req-315cea8b-0d35-4d4b-8466-1026dda35c0a tempest-VolumesGetTestJSON-2146517358 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:19:35 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [req-ba80e4a3-54df-4996-90f8-4470b7882cda req-315cea8b-0d35-4d4b-8466-1026dda35c0a tempest-VolumesGetTestJSON-2146517358 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:19:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-ba80e4a3-54df-4996-90f8-4470b7882cda req-315cea8b-0d35-4d4b-8466-1026dda35c0a tempest-VolumesGetTestJSON-2146517358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-722eb807-f02b-4e50-b9f6-aa9f9119f50b 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:19:35 devstack sudo[89577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-722eb807-f02b-4e50-b9f6-aa9f9119f50b 1073741824 Nov 06 15:19:35 devstack sudo[89577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:19:35 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-0439b0e4-3ceb-43ba-ac8c-3d9ebb8ee1f8 tempest-GroupsV314Test-1406732119 None] Create group from source-group-ea7920cc-324e-4b5e-8b5d-45cdaacb380c completed successfully. Nov 06 15:19:36 devstack sudo[89577]: pam_unix(sudo:session): session closed for user root Nov 06 15:19:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-ba80e4a3-54df-4996-90f8-4470b7882cda req-315cea8b-0d35-4d4b-8466-1026dda35c0a tempest-VolumesGetTestJSON-2146517358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-722eb807-f02b-4e50-b9f6-aa9f9119f50b 1073741824" returned: 0 in 0.809s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:19:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-ba80e4a3-54df-4996-90f8-4470b7882cda req-315cea8b-0d35-4d4b-8466-1026dda35c0a tempest-VolumesGetTestJSON-2146517358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-722eb807-f02b-4e50-b9f6-aa9f9119f50b {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:19:36 devstack sudo[89582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-722eb807-f02b-4e50-b9f6-aa9f9119f50b Nov 06 15:19:36 devstack sudo[89582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:19:36 devstack sudo[89582]: pam_unix(sudo:session): session closed for user root Nov 06 15:19:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-ba80e4a3-54df-4996-90f8-4470b7882cda req-315cea8b-0d35-4d4b-8466-1026dda35c0a tempest-VolumesGetTestJSON-2146517358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-722eb807-f02b-4e50-b9f6-aa9f9119f50b" returned: 0 in 0.380s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:19:36 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [req-ba80e4a3-54df-4996-90f8-4470b7882cda req-315cea8b-0d35-4d4b-8466-1026dda35c0a tempest-VolumesGetTestJSON-2146517358 None] <== create_volume: return (1260ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:19:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-ba80e4a3-54df-4996-90f8-4470b7882cda req-315cea8b-0d35-4d4b-8466-1026dda35c0a tempest-VolumesGetTestJSON-2146517358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.268s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:19:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-ba80e4a3-54df-4996-90f8-4470b7882cda req-315cea8b-0d35-4d4b-8466-1026dda35c0a tempest-VolumesGetTestJSON-2146517358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3257d04-3ace-4905-a2f0-2fa5ceb3fc71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-722eb807-f02b-4e50-b9f6-aa9f9119f50b', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:19:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-ba80e4a3-54df-4996-90f8-4470b7882cda req-315cea8b-0d35-4d4b-8466-1026dda35c0a tempest-VolumesGetTestJSON-2146517358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba380f30-e4b8-4440-8cc2-34f0d767f519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:19:36 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [req-ba80e4a3-54df-4996-90f8-4470b7882cda req-315cea8b-0d35-4d4b-8466-1026dda35c0a tempest-VolumesGetTestJSON-2146517358 None] Volume volume-722eb807-f02b-4e50-b9f6-aa9f9119f50b (722eb807-f02b-4e50-b9f6-aa9f9119f50b): created successfully Nov 06 15:19:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-ba80e4a3-54df-4996-90f8-4470b7882cda req-315cea8b-0d35-4d4b-8466-1026dda35c0a tempest-VolumesGetTestJSON-2146517358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba380f30-e4b8-4440-8cc2-34f0d767f519) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:19:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-ba80e4a3-54df-4996-90f8-4470b7882cda req-315cea8b-0d35-4d4b-8466-1026dda35c0a tempest-VolumesGetTestJSON-2146517358 None] Flow 'volume_create_manager' (1cf27185-e4ae-41a3-a526-438a5abafffd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:19:36 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-ba80e4a3-54df-4996-90f8-4470b7882cda req-315cea8b-0d35-4d4b-8466-1026dda35c0a tempest-VolumesGetTestJSON-2146517358 None] Created volume successfully. Nov 06 15:19:37 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-870653c6-c7ba-41c9-b290-0f0be259fff4 tempest-GroupsV314Test-1406732119 None] Acquiring lock "cinder-quobyte-6844bdc2-d842-4102-b737-6e2eea23db76" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:19:37 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-870653c6-c7ba-41c9-b290-0f0be259fff4 tempest-GroupsV314Test-1406732119 None] Lock "cinder-quobyte-6844bdc2-d842-4102-b737-6e2eea23db76" acquired by "delete_volume" :: waited 0.042s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:19:37 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[99b45aac-3075-40a6-ad01-8aeb316d37a4]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:19:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-870653c6-c7ba-41c9-b290-0f0be259fff4 tempest-GroupsV314Test-1406732119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-6844bdc2-d842-4102-b737-6e2eea23db76 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:19:38 devstack sudo[89587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-6844bdc2-d842-4102-b737-6e2eea23db76 Nov 06 15:19:38 devstack sudo[89587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:19:38 devstack cinder-volume[87132]: DEBUG cinder.coordination [req-af90f26c-58eb-47c7-8841-9478775f0204 req-6a722779-bf7f-4b91-83f8-b6df46f79c06 tempest-VolumesGetTestJSON-2146517358 None] Acquiring lock "cinder-722eb807-f02b-4e50-b9f6-aa9f9119f50b-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:19:38 devstack cinder-volume[87132]: DEBUG cinder.coordination [req-af90f26c-58eb-47c7-8841-9478775f0204 req-6a722779-bf7f-4b91-83f8-b6df46f79c06 tempest-VolumesGetTestJSON-2146517358 None] Lock "cinder-722eb807-f02b-4e50-b9f6-aa9f9119f50b-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:19:38 devstack cinder-volume[87132]: DEBUG cinder.coordination [req-af90f26c-58eb-47c7-8841-9478775f0204 req-6a722779-bf7f-4b91-83f8-b6df46f79c06 tempest-VolumesGetTestJSON-2146517358 None] Acquiring lock "cinder-quobyte-722eb807-f02b-4e50-b9f6-aa9f9119f50b" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:19:38 devstack cinder-volume[87132]: DEBUG cinder.coordination [req-af90f26c-58eb-47c7-8841-9478775f0204 req-6a722779-bf7f-4b91-83f8-b6df46f79c06 tempest-VolumesGetTestJSON-2146517358 None] Lock "cinder-quobyte-722eb807-f02b-4e50-b9f6-aa9f9119f50b" acquired by "delete_volume" :: waited 0.028s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:19:38 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ec9b7aa-bc9e-4b9a-b5b2-6c53b8b1c056]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:19:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-af90f26c-58eb-47c7-8841-9478775f0204 req-6a722779-bf7f-4b91-83f8-b6df46f79c06 tempest-VolumesGetTestJSON-2146517358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-722eb807-f02b-4e50-b9f6-aa9f9119f50b {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:19:38 devstack sudo[89587]: pam_unix(sudo:session): session closed for user root Nov 06 15:19:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-870653c6-c7ba-41c9-b290-0f0be259fff4 tempest-GroupsV314Test-1406732119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-6844bdc2-d842-4102-b737-6e2eea23db76" returned: 0 in 0.725s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:19:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-870653c6-c7ba-41c9-b290-0f0be259fff4 tempest-GroupsV314Test-1406732119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-6844bdc2-d842-4102-b737-6e2eea23db76 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:19:38 devstack sudo[89593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-6844bdc2-d842-4102-b737-6e2eea23db76 Nov 06 15:19:38 devstack sudo[89593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:19:38 devstack sudo[89592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-722eb807-f02b-4e50-b9f6-aa9f9119f50b Nov 06 15:19:38 devstack sudo[89592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:19:38 devstack sudo[89593]: pam_unix(sudo:session): session closed for user root Nov 06 15:19:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-870653c6-c7ba-41c9-b290-0f0be259fff4 tempest-GroupsV314Test-1406732119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-6844bdc2-d842-4102-b737-6e2eea23db76" returned: 0 in 0.498s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:19:39 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-870653c6-c7ba-41c9-b290-0f0be259fff4 tempest-GroupsV314Test-1406732119 None] Lock "cinder-quobyte-6844bdc2-d842-4102-b737-6e2eea23db76" released by "delete_volume" :: held 1.345s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:19:39 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-870653c6-c7ba-41c9-b290-0f0be259fff4 tempest-GroupsV314Test-1406732119 None] Created reservations ['e3db6b60-81fe-4783-9984-f997b9055e75'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:19:39 devstack sudo[89592]: pam_unix(sudo:session): session closed for user root Nov 06 15:19:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-af90f26c-58eb-47c7-8841-9478775f0204 req-6a722779-bf7f-4b91-83f8-b6df46f79c06 tempest-VolumesGetTestJSON-2146517358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-722eb807-f02b-4e50-b9f6-aa9f9119f50b" returned: 0 in 0.760s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:19:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-af90f26c-58eb-47c7-8841-9478775f0204 req-6a722779-bf7f-4b91-83f8-b6df46f79c06 tempest-VolumesGetTestJSON-2146517358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-722eb807-f02b-4e50-b9f6-aa9f9119f50b {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:19:39 devstack sudo[89601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-722eb807-f02b-4e50-b9f6-aa9f9119f50b Nov 06 15:19:39 devstack sudo[89601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:19:39 devstack cinder-volume[87132]: WARNING cinder.quota [None req-870653c6-c7ba-41c9-b290-0f0be259fff4 tempest-GroupsV314Test-1406732119 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-710637766 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-710637766, it is now deprecated. Please use the default quota class for default quota. Nov 06 15:19:39 devstack cinder-volume[87132]: WARNING cinder.quota [None req-870653c6-c7ba-41c9-b290-0f0be259fff4 tempest-GroupsV314Test-1406732119 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-710637766 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-710637766, it is now deprecated. Please use the default quota class for default quota. Nov 06 15:19:39 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-870653c6-c7ba-41c9-b290-0f0be259fff4 tempest-GroupsV314Test-1406732119 None] Created reservations ['c9394c81-ea47-4157-b59c-c2995e1e4ea1', 'be1f22ab-5483-4b4f-9884-13ce9a4fecc4', '9c8ebe64-7d8e-4a53-afcf-988a2d02869a', 'db35b5d0-3e65-42f1-abf8-35f2845559c6'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:19:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-870653c6-c7ba-41c9-b290-0f0be259fff4 tempest-GroupsV314Test-1406732119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:19:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-870653c6-c7ba-41c9-b290-0f0be259fff4 tempest-GroupsV314Test-1406732119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:19:39 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-870653c6-c7ba-41c9-b290-0f0be259fff4 tempest-GroupsV314Test-1406732119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:19:39 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-870653c6-c7ba-41c9-b290-0f0be259fff4 tempest-GroupsV314Test-1406732119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:19:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-870653c6-c7ba-41c9-b290-0f0be259fff4 tempest-GroupsV314Test-1406732119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:19:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-870653c6-c7ba-41c9-b290-0f0be259fff4 tempest-GroupsV314Test-1406732119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:19:39 devstack sudo[89604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:19:39 devstack sudo[89604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:19:39 devstack sudo[89601]: pam_unix(sudo:session): session closed for user root Nov 06 15:19:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-af90f26c-58eb-47c7-8841-9478775f0204 req-6a722779-bf7f-4b91-83f8-b6df46f79c06 tempest-VolumesGetTestJSON-2146517358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-722eb807-f02b-4e50-b9f6-aa9f9119f50b" returned: 0 in 0.574s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:19:39 devstack cinder-volume[87132]: DEBUG cinder.coordination [req-af90f26c-58eb-47c7-8841-9478775f0204 req-6a722779-bf7f-4b91-83f8-b6df46f79c06 tempest-VolumesGetTestJSON-2146517358 None] Lock "cinder-quobyte-722eb807-f02b-4e50-b9f6-aa9f9119f50b" released by "delete_volume" :: held 1.418s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:19:39 devstack cinder-volume[87132]: DEBUG cinder.quota [req-af90f26c-58eb-47c7-8841-9478775f0204 req-6a722779-bf7f-4b91-83f8-b6df46f79c06 tempest-VolumesGetTestJSON-2146517358 None] Created reservations ['fe9fed1c-6535-4962-99dc-7e3f39f63c8a', '4d2893c1-3ef1-4467-a019-0ed0f4d49054', '862d45b9-8584-4e8b-a204-1822484bd00b', '3ef0bd26-9580-449a-af47-e712fea1b6e9'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:19:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-af90f26c-58eb-47c7-8841-9478775f0204 req-6a722779-bf7f-4b91-83f8-b6df46f79c06 tempest-VolumesGetTestJSON-2146517358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:19:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-af90f26c-58eb-47c7-8841-9478775f0204 req-6a722779-bf7f-4b91-83f8-b6df46f79c06 tempest-VolumesGetTestJSON-2146517358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:19:39 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [req-af90f26c-58eb-47c7-8841-9478775f0204 req-6a722779-bf7f-4b91-83f8-b6df46f79c06 tempest-VolumesGetTestJSON-2146517358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:19:40 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [req-af90f26c-58eb-47c7-8841-9478775f0204 req-6a722779-bf7f-4b91-83f8-b6df46f79c06 tempest-VolumesGetTestJSON-2146517358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:19:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-af90f26c-58eb-47c7-8841-9478775f0204 req-6a722779-bf7f-4b91-83f8-b6df46f79c06 tempest-VolumesGetTestJSON-2146517358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:19:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-af90f26c-58eb-47c7-8841-9478775f0204 req-6a722779-bf7f-4b91-83f8-b6df46f79c06 tempest-VolumesGetTestJSON-2146517358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:19:40 devstack sudo[89608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:19:40 devstack sudo[89608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:19:40 devstack sudo[89604]: pam_unix(sudo:session): session closed for user root Nov 06 15:19:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-870653c6-c7ba-41c9-b290-0f0be259fff4 tempest-GroupsV314Test-1406732119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.488s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:19:40 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-870653c6-c7ba-41c9-b290-0f0be259fff4 tempest-GroupsV314Test-1406732119 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:19:40 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-870653c6-c7ba-41c9-b290-0f0be259fff4 tempest-GroupsV314Test-1406732119 None] Delete group completed successfully. Nov 06 15:19:40 devstack sudo[89608]: pam_unix(sudo:session): session closed for user root Nov 06 15:19:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-af90f26c-58eb-47c7-8841-9478775f0204 req-6a722779-bf7f-4b91-83f8-b6df46f79c06 tempest-VolumesGetTestJSON-2146517358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.322s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:19:40 devstack cinder-volume[87132]: DEBUG cinder.manager [req-af90f26c-58eb-47c7-8841-9478775f0204 req-6a722779-bf7f-4b91-83f8-b6df46f79c06 tempest-VolumesGetTestJSON-2146517358 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:19:40 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-af90f26c-58eb-47c7-8841-9478775f0204 req-6a722779-bf7f-4b91-83f8-b6df46f79c06 tempest-VolumesGetTestJSON-2146517358 None] Deleted volume successfully. Nov 06 15:19:40 devstack cinder-volume[87132]: DEBUG cinder.coordination [req-af90f26c-58eb-47c7-8841-9478775f0204 req-6a722779-bf7f-4b91-83f8-b6df46f79c06 tempest-VolumesGetTestJSON-2146517358 None] Lock "cinder-722eb807-f02b-4e50-b9f6-aa9f9119f50b-delete_volume" released by "delete_volume" :: held 2.103s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:19:40 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e13db2cb-3c38-40b3-b834-5babbca919f9 tempest-GroupsV314Test-1406732119 None] Acquiring lock "cinder-quobyte-0630691d-2f3d-4f60-95b2-681c72bbb028" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:19:40 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e13db2cb-3c38-40b3-b834-5babbca919f9 tempest-GroupsV314Test-1406732119 None] Lock "cinder-quobyte-0630691d-2f3d-4f60-95b2-681c72bbb028" acquired by "delete_volume" :: waited 0.046s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:19:41 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[130a552a-2c9e-43fa-9e83-83b2dec05648]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:19:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e13db2cb-3c38-40b3-b834-5babbca919f9 tempest-GroupsV314Test-1406732119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0630691d-2f3d-4f60-95b2-681c72bbb028 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:19:41 devstack sudo[89613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0630691d-2f3d-4f60-95b2-681c72bbb028 Nov 06 15:19:41 devstack sudo[89613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:19:41 devstack sudo[89613]: pam_unix(sudo:session): session closed for user root Nov 06 15:19:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e13db2cb-3c38-40b3-b834-5babbca919f9 tempest-GroupsV314Test-1406732119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0630691d-2f3d-4f60-95b2-681c72bbb028" returned: 0 in 0.447s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:19:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e13db2cb-3c38-40b3-b834-5babbca919f9 tempest-GroupsV314Test-1406732119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0630691d-2f3d-4f60-95b2-681c72bbb028 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:19:41 devstack sudo[89618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0630691d-2f3d-4f60-95b2-681c72bbb028 Nov 06 15:19:41 devstack sudo[89618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:19:41 devstack sudo[89618]: pam_unix(sudo:session): session closed for user root Nov 06 15:19:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e13db2cb-3c38-40b3-b834-5babbca919f9 tempest-GroupsV314Test-1406732119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0630691d-2f3d-4f60-95b2-681c72bbb028" returned: 0 in 0.370s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:19:41 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e13db2cb-3c38-40b3-b834-5babbca919f9 tempest-GroupsV314Test-1406732119 None] Lock "cinder-quobyte-0630691d-2f3d-4f60-95b2-681c72bbb028" released by "delete_volume" :: held 0.967s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:19:42 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-e13db2cb-3c38-40b3-b834-5babbca919f9 tempest-GroupsV314Test-1406732119 None] Created reservations ['bfa65bb0-a500-4164-ac24-2ed23d6e176b'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:19:42 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-e13db2cb-3c38-40b3-b834-5babbca919f9 tempest-GroupsV314Test-1406732119 None] Created reservations ['7a9ed408-324c-4ac6-98ef-c69d0082470f', 'a6f6a105-d8dd-47b7-b326-36f6f95a4b57', 'd30183a6-78d4-42c3-a93c-a8abf66a047c', '09bb0d46-0845-419d-93c6-cd4fd9831446'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:19:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e13db2cb-3c38-40b3-b834-5babbca919f9 tempest-GroupsV314Test-1406732119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:19:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e13db2cb-3c38-40b3-b834-5babbca919f9 tempest-GroupsV314Test-1406732119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:19:42 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e13db2cb-3c38-40b3-b834-5babbca919f9 tempest-GroupsV314Test-1406732119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:19:42 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e13db2cb-3c38-40b3-b834-5babbca919f9 tempest-GroupsV314Test-1406732119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:19:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e13db2cb-3c38-40b3-b834-5babbca919f9 tempest-GroupsV314Test-1406732119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:19:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e13db2cb-3c38-40b3-b834-5babbca919f9 tempest-GroupsV314Test-1406732119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:19:42 devstack sudo[89624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:19:42 devstack sudo[89624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:19:42 devstack sudo[89624]: pam_unix(sudo:session): session closed for user root Nov 06 15:19:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e13db2cb-3c38-40b3-b834-5babbca919f9 tempest-GroupsV314Test-1406732119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.310s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:19:42 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-e13db2cb-3c38-40b3-b834-5babbca919f9 tempest-GroupsV314Test-1406732119 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:19:42 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-e13db2cb-3c38-40b3-b834-5babbca919f9 tempest-GroupsV314Test-1406732119 None] Delete group completed successfully. Nov 06 15:19:47 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:SELECT=52,cinder:UPDATE=69,cinder:INSERT=18,cinder:DELETE=4 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 15:19:47 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-743beaa8-6efc-4ff5-b1b6-36d628957201 tempest-VolumesTestJSON-176401190 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:19:47 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-743beaa8-6efc-4ff5-b1b6-36d628957201 tempest-VolumesTestJSON-176401190 None] Flow 'volume_create_manager' (dbe103e6-9bc5-48f0-aa11-bc88265b0941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:19:47 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-743beaa8-6efc-4ff5-b1b6-36d628957201 tempest-VolumesTestJSON-176401190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d2eb120-531b-4956-bbea-fa308e6c7da6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:19:47 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-743beaa8-6efc-4ff5-b1b6-36d628957201 tempest-VolumesTestJSON-176401190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d2eb120-531b-4956-bbea-fa308e6c7da6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:19:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-619136970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a67cbabf-e2ac-42bf-90eb-08908f04736e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d617865bd21044d6b5f9e49e7e7db756',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:19:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:19:47Z,use_quota=True,user_id='b4d69dccf5c34578a089b3dda10f757f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:19:47 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-743beaa8-6efc-4ff5-b1b6-36d628957201 tempest-VolumesTestJSON-176401190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d996c60-07a6-41cc-b3ae-923a2885dce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:19:47 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-743beaa8-6efc-4ff5-b1b6-36d628957201 tempest-VolumesTestJSON-176401190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d996c60-07a6-41cc-b3ae-923a2885dce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:19:47 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-743beaa8-6efc-4ff5-b1b6-36d628957201 tempest-VolumesTestJSON-176401190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d95e62c-8ff5-4abb-bb24-6a5dda506be3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:19:47 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-743beaa8-6efc-4ff5-b1b6-36d628957201 tempest-VolumesTestJSON-176401190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d95e62c-8ff5-4abb-bb24-6a5dda506be3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a67cbabf-e2ac-42bf-90eb-08908f04736e', 'volume_name': 'volume-a67cbabf-e2ac-42bf-90eb-08908f04736e', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:19:47 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-743beaa8-6efc-4ff5-b1b6-36d628957201 tempest-VolumesTestJSON-176401190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db9a95ac-e093-49c6-992c-67b4c1d38404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:19:47 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-743beaa8-6efc-4ff5-b1b6-36d628957201 tempest-VolumesTestJSON-176401190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db9a95ac-e093-49c6-992c-67b4c1d38404) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:19:47 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-743beaa8-6efc-4ff5-b1b6-36d628957201 tempest-VolumesTestJSON-176401190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8210609-9e7e-4b4f-8c46-f65d76ed9785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:19:47 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-743beaa8-6efc-4ff5-b1b6-36d628957201 tempest-VolumesTestJSON-176401190 None] Volume a67cbabf-e2ac-42bf-90eb-08908f04736e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a67cbabf-e2ac-42bf-90eb-08908f04736e', 'volume_size': 1} Nov 06 15:19:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-743beaa8-6efc-4ff5-b1b6-36d628957201 tempest-VolumesTestJSON-176401190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:19:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-743beaa8-6efc-4ff5-b1b6-36d628957201 tempest-VolumesTestJSON-176401190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:19:47 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-743beaa8-6efc-4ff5-b1b6-36d628957201 tempest-VolumesTestJSON-176401190 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:19:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-619136970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a67cbabf-e2ac-42bf-90eb-08908f04736e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d617865bd21044d6b5f9e49e7e7db756',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:19:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:19:47Z,use_quota=True,user_id='b4d69dccf5c34578a089b3dda10f757f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:19:47 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-743beaa8-6efc-4ff5-b1b6-36d628957201 tempest-VolumesTestJSON-176401190 None] Creating volume a67cbabf-e2ac-42bf-90eb-08908f04736e {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:19:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-743beaa8-6efc-4ff5-b1b6-36d628957201 tempest-VolumesTestJSON-176401190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:19:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-743beaa8-6efc-4ff5-b1b6-36d628957201 tempest-VolumesTestJSON-176401190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:19:47 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-743beaa8-6efc-4ff5-b1b6-36d628957201 tempest-VolumesTestJSON-176401190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:19:47 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-743beaa8-6efc-4ff5-b1b6-36d628957201 tempest-VolumesTestJSON-176401190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:19:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-743beaa8-6efc-4ff5-b1b6-36d628957201 tempest-VolumesTestJSON-176401190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:19:47 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-743beaa8-6efc-4ff5-b1b6-36d628957201 tempest-VolumesTestJSON-176401190 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:19:47 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-743beaa8-6efc-4ff5-b1b6-36d628957201 tempest-VolumesTestJSON-176401190 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:19:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-743beaa8-6efc-4ff5-b1b6-36d628957201 tempest-VolumesTestJSON-176401190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a67cbabf-e2ac-42bf-90eb-08908f04736e 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:19:47 devstack sudo[89704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a67cbabf-e2ac-42bf-90eb-08908f04736e 1073741824 Nov 06 15:19:47 devstack sudo[89704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:19:48 devstack sudo[89704]: pam_unix(sudo:session): session closed for user root Nov 06 15:19:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-743beaa8-6efc-4ff5-b1b6-36d628957201 tempest-VolumesTestJSON-176401190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a67cbabf-e2ac-42bf-90eb-08908f04736e 1073741824" returned: 0 in 0.721s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:19:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-743beaa8-6efc-4ff5-b1b6-36d628957201 tempest-VolumesTestJSON-176401190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a67cbabf-e2ac-42bf-90eb-08908f04736e {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:19:48 devstack sudo[89749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a67cbabf-e2ac-42bf-90eb-08908f04736e Nov 06 15:19:48 devstack sudo[89749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:19:48 devstack sudo[89749]: pam_unix(sudo:session): session closed for user root Nov 06 15:19:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-743beaa8-6efc-4ff5-b1b6-36d628957201 tempest-VolumesTestJSON-176401190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a67cbabf-e2ac-42bf-90eb-08908f04736e" returned: 0 in 0.422s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:19:48 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-743beaa8-6efc-4ff5-b1b6-36d628957201 tempest-VolumesTestJSON-176401190 None] <== create_volume: return (1256ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:19:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-743beaa8-6efc-4ff5-b1b6-36d628957201 tempest-VolumesTestJSON-176401190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.260s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:19:48 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-743beaa8-6efc-4ff5-b1b6-36d628957201 tempest-VolumesTestJSON-176401190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8210609-9e7e-4b4f-8c46-f65d76ed9785) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a67cbabf-e2ac-42bf-90eb-08908f04736e', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:19:48 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-743beaa8-6efc-4ff5-b1b6-36d628957201 tempest-VolumesTestJSON-176401190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d2c75bf-7012-49ed-bcc6-28745093a94a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:19:48 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-743beaa8-6efc-4ff5-b1b6-36d628957201 tempest-VolumesTestJSON-176401190 None] Volume volume-a67cbabf-e2ac-42bf-90eb-08908f04736e (a67cbabf-e2ac-42bf-90eb-08908f04736e): created successfully Nov 06 15:19:48 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-743beaa8-6efc-4ff5-b1b6-36d628957201 tempest-VolumesTestJSON-176401190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d2c75bf-7012-49ed-bcc6-28745093a94a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:19:48 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-743beaa8-6efc-4ff5-b1b6-36d628957201 tempest-VolumesTestJSON-176401190 None] Flow 'volume_create_manager' (dbe103e6-9bc5-48f0-aa11-bc88265b0941) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:19:48 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-743beaa8-6efc-4ff5-b1b6-36d628957201 tempest-VolumesTestJSON-176401190 None] Created volume successfully. Nov 06 15:19:50 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-156d795e-9794-48c1-ae59-fad9a4611916 tempest-VolumesTestJSON-176401190 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:19:50 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-156d795e-9794-48c1-ae59-fad9a4611916 tempest-VolumesTestJSON-176401190 None] Flow 'volume_create_manager' (e2ac6ca1-ab11-48af-9f38-fe5d41ed1fd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:19:50 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-156d795e-9794-48c1-ae59-fad9a4611916 tempest-VolumesTestJSON-176401190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fbd33af-6b7e-4d26-9581-a598845155eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:19:50 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-156d795e-9794-48c1-ae59-fad9a4611916 tempest-VolumesTestJSON-176401190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fbd33af-6b7e-4d26-9581-a598845155eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:19:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1399299884',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81603169-4048-4f18-852e-b9badb31498c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d617865bd21044d6b5f9e49e7e7db756',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:19:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:19:51Z,use_quota=True,user_id='b4d69dccf5c34578a089b3dda10f757f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:19:50 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-156d795e-9794-48c1-ae59-fad9a4611916 tempest-VolumesTestJSON-176401190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e26e5a80-b00a-4b48-863c-b25790fd2f25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:19:50 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-156d795e-9794-48c1-ae59-fad9a4611916 tempest-VolumesTestJSON-176401190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e26e5a80-b00a-4b48-863c-b25790fd2f25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:19:50 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-156d795e-9794-48c1-ae59-fad9a4611916 tempest-VolumesTestJSON-176401190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29714198-6d50-44c2-87c9-2e655abb7a7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:19:50 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-156d795e-9794-48c1-ae59-fad9a4611916 tempest-VolumesTestJSON-176401190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29714198-6d50-44c2-87c9-2e655abb7a7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81603169-4048-4f18-852e-b9badb31498c', 'volume_name': 'volume-81603169-4048-4f18-852e-b9badb31498c', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:19:50 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-156d795e-9794-48c1-ae59-fad9a4611916 tempest-VolumesTestJSON-176401190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb59c347-7236-4651-95a0-2bb15c9416ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:19:50 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-156d795e-9794-48c1-ae59-fad9a4611916 tempest-VolumesTestJSON-176401190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb59c347-7236-4651-95a0-2bb15c9416ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:19:50 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-156d795e-9794-48c1-ae59-fad9a4611916 tempest-VolumesTestJSON-176401190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63e6b275-e106-404a-a2e1-ba60f5f380d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:19:50 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-156d795e-9794-48c1-ae59-fad9a4611916 tempest-VolumesTestJSON-176401190 None] Volume 81603169-4048-4f18-852e-b9badb31498c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81603169-4048-4f18-852e-b9badb31498c', 'volume_size': 1} Nov 06 15:19:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-156d795e-9794-48c1-ae59-fad9a4611916 tempest-VolumesTestJSON-176401190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:19:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-156d795e-9794-48c1-ae59-fad9a4611916 tempest-VolumesTestJSON-176401190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:19:50 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-156d795e-9794-48c1-ae59-fad9a4611916 tempest-VolumesTestJSON-176401190 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:19:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1399299884',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81603169-4048-4f18-852e-b9badb31498c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d617865bd21044d6b5f9e49e7e7db756',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:19:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:19:51Z,use_quota=True,user_id='b4d69dccf5c34578a089b3dda10f757f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:19:50 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-156d795e-9794-48c1-ae59-fad9a4611916 tempest-VolumesTestJSON-176401190 None] Creating volume 81603169-4048-4f18-852e-b9badb31498c {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:19:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-156d795e-9794-48c1-ae59-fad9a4611916 tempest-VolumesTestJSON-176401190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:19:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-156d795e-9794-48c1-ae59-fad9a4611916 tempest-VolumesTestJSON-176401190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:19:50 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-156d795e-9794-48c1-ae59-fad9a4611916 tempest-VolumesTestJSON-176401190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:19:50 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-156d795e-9794-48c1-ae59-fad9a4611916 tempest-VolumesTestJSON-176401190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:19:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-156d795e-9794-48c1-ae59-fad9a4611916 tempest-VolumesTestJSON-176401190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:19:50 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-156d795e-9794-48c1-ae59-fad9a4611916 tempest-VolumesTestJSON-176401190 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:19:50 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-156d795e-9794-48c1-ae59-fad9a4611916 tempest-VolumesTestJSON-176401190 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:19:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-156d795e-9794-48c1-ae59-fad9a4611916 tempest-VolumesTestJSON-176401190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-81603169-4048-4f18-852e-b9badb31498c 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:19:50 devstack sudo[89785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-81603169-4048-4f18-852e-b9badb31498c 1073741824 Nov 06 15:19:50 devstack sudo[89785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:19:51 devstack sudo[89785]: pam_unix(sudo:session): session closed for user root Nov 06 15:19:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-156d795e-9794-48c1-ae59-fad9a4611916 tempest-VolumesTestJSON-176401190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-81603169-4048-4f18-852e-b9badb31498c 1073741824" returned: 0 in 0.561s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:19:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-156d795e-9794-48c1-ae59-fad9a4611916 tempest-VolumesTestJSON-176401190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-81603169-4048-4f18-852e-b9badb31498c {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:19:51 devstack sudo[89791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-81603169-4048-4f18-852e-b9badb31498c Nov 06 15:19:51 devstack sudo[89791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:19:51 devstack sudo[89791]: pam_unix(sudo:session): session closed for user root Nov 06 15:19:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-156d795e-9794-48c1-ae59-fad9a4611916 tempest-VolumesTestJSON-176401190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-81603169-4048-4f18-852e-b9badb31498c" returned: 0 in 0.332s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:19:51 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-156d795e-9794-48c1-ae59-fad9a4611916 tempest-VolumesTestJSON-176401190 None] <== create_volume: return (938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:19:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-156d795e-9794-48c1-ae59-fad9a4611916 tempest-VolumesTestJSON-176401190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.942s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:19:51 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-156d795e-9794-48c1-ae59-fad9a4611916 tempest-VolumesTestJSON-176401190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63e6b275-e106-404a-a2e1-ba60f5f380d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81603169-4048-4f18-852e-b9badb31498c', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:19:51 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-156d795e-9794-48c1-ae59-fad9a4611916 tempest-VolumesTestJSON-176401190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6736e709-f153-49e1-a59e-8d675732e014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:19:51 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-156d795e-9794-48c1-ae59-fad9a4611916 tempest-VolumesTestJSON-176401190 None] Volume volume-81603169-4048-4f18-852e-b9badb31498c (81603169-4048-4f18-852e-b9badb31498c): created successfully Nov 06 15:19:51 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-156d795e-9794-48c1-ae59-fad9a4611916 tempest-VolumesTestJSON-176401190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6736e709-f153-49e1-a59e-8d675732e014) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:19:51 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-156d795e-9794-48c1-ae59-fad9a4611916 tempest-VolumesTestJSON-176401190 None] Flow 'volume_create_manager' (e2ac6ca1-ab11-48af-9f38-fe5d41ed1fd7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:19:51 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-156d795e-9794-48c1-ae59-fad9a4611916 tempest-VolumesTestJSON-176401190 None] Created volume successfully. Nov 06 15:19:53 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-aabf12af-51dc-4a1d-bcae-db17a7d48cab tempest-GroupsV320Test-1691554340 None] Group tempest-GroupsV320Test-Group-940462817: creating Nov 06 15:19:53 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-2317fc0a-d4ac-4268-9003-baeddee17936 tempest-VolumesTestJSON-176401190 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:19:53 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2317fc0a-d4ac-4268-9003-baeddee17936 tempest-VolumesTestJSON-176401190 None] Flow 'volume_create_manager' (72f7d47c-d0e7-400c-9c32-e4e6eb3412fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:19:53 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2317fc0a-d4ac-4268-9003-baeddee17936 tempest-VolumesTestJSON-176401190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4698bd4d-839b-4a5c-b439-2b5afd212ac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:19:53 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2317fc0a-d4ac-4268-9003-baeddee17936 tempest-VolumesTestJSON-176401190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4698bd4d-839b-4a5c-b439-2b5afd212ac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:19:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1526617936',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e673f0c6-d04c-4b69-9019-fc2663fcdcbf,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d617865bd21044d6b5f9e49e7e7db756',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:19:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:19:54Z,use_quota=True,user_id='b4d69dccf5c34578a089b3dda10f757f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:19:53 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2317fc0a-d4ac-4268-9003-baeddee17936 tempest-VolumesTestJSON-176401190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d67d8295-6357-47ae-b4ff-058971e364d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:19:53 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2317fc0a-d4ac-4268-9003-baeddee17936 tempest-VolumesTestJSON-176401190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d67d8295-6357-47ae-b4ff-058971e364d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:19:53 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2317fc0a-d4ac-4268-9003-baeddee17936 tempest-VolumesTestJSON-176401190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af5a1722-be4b-4240-8f68-5b11a048db4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:19:53 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2317fc0a-d4ac-4268-9003-baeddee17936 tempest-VolumesTestJSON-176401190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af5a1722-be4b-4240-8f68-5b11a048db4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e673f0c6-d04c-4b69-9019-fc2663fcdcbf', 'volume_name': 'volume-e673f0c6-d04c-4b69-9019-fc2663fcdcbf', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:19:53 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2317fc0a-d4ac-4268-9003-baeddee17936 tempest-VolumesTestJSON-176401190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31f75151-941f-4333-8542-cc1d5d518c7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:19:53 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2317fc0a-d4ac-4268-9003-baeddee17936 tempest-VolumesTestJSON-176401190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31f75151-941f-4333-8542-cc1d5d518c7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:19:53 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2317fc0a-d4ac-4268-9003-baeddee17936 tempest-VolumesTestJSON-176401190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee2f637c-5209-43fc-8cb2-9ae4a21d154d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:19:53 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-2317fc0a-d4ac-4268-9003-baeddee17936 tempest-VolumesTestJSON-176401190 None] Volume e673f0c6-d04c-4b69-9019-fc2663fcdcbf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e673f0c6-d04c-4b69-9019-fc2663fcdcbf', 'volume_size': 1} Nov 06 15:19:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-2317fc0a-d4ac-4268-9003-baeddee17936 tempest-VolumesTestJSON-176401190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:19:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-2317fc0a-d4ac-4268-9003-baeddee17936 tempest-VolumesTestJSON-176401190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:19:53 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-2317fc0a-d4ac-4268-9003-baeddee17936 tempest-VolumesTestJSON-176401190 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:19:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1526617936',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e673f0c6-d04c-4b69-9019-fc2663fcdcbf,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d617865bd21044d6b5f9e49e7e7db756',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:19:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:19:54Z,use_quota=True,user_id='b4d69dccf5c34578a089b3dda10f757f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:19:53 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-2317fc0a-d4ac-4268-9003-baeddee17936 tempest-VolumesTestJSON-176401190 None] Creating volume e673f0c6-d04c-4b69-9019-fc2663fcdcbf {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:19:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-2317fc0a-d4ac-4268-9003-baeddee17936 tempest-VolumesTestJSON-176401190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:19:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-2317fc0a-d4ac-4268-9003-baeddee17936 tempest-VolumesTestJSON-176401190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:19:53 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-2317fc0a-d4ac-4268-9003-baeddee17936 tempest-VolumesTestJSON-176401190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:19:53 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-2317fc0a-d4ac-4268-9003-baeddee17936 tempest-VolumesTestJSON-176401190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:19:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-2317fc0a-d4ac-4268-9003-baeddee17936 tempest-VolumesTestJSON-176401190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:19:53 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-2317fc0a-d4ac-4268-9003-baeddee17936 tempest-VolumesTestJSON-176401190 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:19:53 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-2317fc0a-d4ac-4268-9003-baeddee17936 tempest-VolumesTestJSON-176401190 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:19:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2317fc0a-d4ac-4268-9003-baeddee17936 tempest-VolumesTestJSON-176401190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-e673f0c6-d04c-4b69-9019-fc2663fcdcbf 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:19:53 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-aabf12af-51dc-4a1d-bcae-db17a7d48cab tempest-GroupsV320Test-1691554340 None] Group tempest-GroupsV320Test-Group-940462817: created successfully Nov 06 15:19:54 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-aabf12af-51dc-4a1d-bcae-db17a7d48cab tempest-GroupsV320Test-1691554340 None] Create group completed successfully. Nov 06 15:19:54 devstack sudo[89818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-e673f0c6-d04c-4b69-9019-fc2663fcdcbf 1073741824 Nov 06 15:19:54 devstack sudo[89818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:19:54 devstack sudo[89818]: pam_unix(sudo:session): session closed for user root Nov 06 15:19:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2317fc0a-d4ac-4268-9003-baeddee17936 tempest-VolumesTestJSON-176401190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-e673f0c6-d04c-4b69-9019-fc2663fcdcbf 1073741824" returned: 0 in 0.615s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:19:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2317fc0a-d4ac-4268-9003-baeddee17936 tempest-VolumesTestJSON-176401190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-e673f0c6-d04c-4b69-9019-fc2663fcdcbf {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:19:54 devstack sudo[89825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-e673f0c6-d04c-4b69-9019-fc2663fcdcbf Nov 06 15:19:54 devstack sudo[89825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:19:54 devstack sudo[89825]: pam_unix(sudo:session): session closed for user root Nov 06 15:19:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2317fc0a-d4ac-4268-9003-baeddee17936 tempest-VolumesTestJSON-176401190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-e673f0c6-d04c-4b69-9019-fc2663fcdcbf" returned: 0 in 0.309s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:19:54 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-2317fc0a-d4ac-4268-9003-baeddee17936 tempest-VolumesTestJSON-176401190 None] <== create_volume: return (1010ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:19:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-2317fc0a-d4ac-4268-9003-baeddee17936 tempest-VolumesTestJSON-176401190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.012s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:19:54 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2317fc0a-d4ac-4268-9003-baeddee17936 tempest-VolumesTestJSON-176401190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee2f637c-5209-43fc-8cb2-9ae4a21d154d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e673f0c6-d04c-4b69-9019-fc2663fcdcbf', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:19:54 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2317fc0a-d4ac-4268-9003-baeddee17936 tempest-VolumesTestJSON-176401190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bca9fc08-b57e-47a4-87be-0ee8c3093bb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:19:55 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-2317fc0a-d4ac-4268-9003-baeddee17936 tempest-VolumesTestJSON-176401190 None] Volume volume-e673f0c6-d04c-4b69-9019-fc2663fcdcbf (e673f0c6-d04c-4b69-9019-fc2663fcdcbf): created successfully Nov 06 15:19:55 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2317fc0a-d4ac-4268-9003-baeddee17936 tempest-VolumesTestJSON-176401190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bca9fc08-b57e-47a4-87be-0ee8c3093bb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:19:55 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2317fc0a-d4ac-4268-9003-baeddee17936 tempest-VolumesTestJSON-176401190 None] Flow 'volume_create_manager' (72f7d47c-d0e7-400c-9c32-e4e6eb3412fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:19:55 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-2317fc0a-d4ac-4268-9003-baeddee17936 tempest-VolumesTestJSON-176401190 None] Created volume successfully. Nov 06 15:19:55 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-1b28a712-0f7b-4e9a-a593-49f538bb95dc tempest-GroupsV320Test-1691554340 None] Created reservations ['0c6ab184-52df-46be-9930-9b9e3816b979'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:19:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1b28a712-0f7b-4e9a-a593-49f538bb95dc tempest-GroupsV320Test-1691554340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:19:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1b28a712-0f7b-4e9a-a593-49f538bb95dc tempest-GroupsV320Test-1691554340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:19:55 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1b28a712-0f7b-4e9a-a593-49f538bb95dc tempest-GroupsV320Test-1691554340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:19:55 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1b28a712-0f7b-4e9a-a593-49f538bb95dc tempest-GroupsV320Test-1691554340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:19:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1b28a712-0f7b-4e9a-a593-49f538bb95dc tempest-GroupsV320Test-1691554340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:19:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1b28a712-0f7b-4e9a-a593-49f538bb95dc tempest-GroupsV320Test-1691554340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:19:55 devstack sudo[89828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:19:55 devstack sudo[89828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:19:55 devstack sudo[89828]: pam_unix(sudo:session): session closed for user root Nov 06 15:19:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1b28a712-0f7b-4e9a-a593-49f538bb95dc tempest-GroupsV320Test-1691554340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.254s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:19:55 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-1b28a712-0f7b-4e9a-a593-49f538bb95dc tempest-GroupsV320Test-1691554340 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:19:55 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-1b28a712-0f7b-4e9a-a593-49f538bb95dc tempest-GroupsV320Test-1691554340 None] Delete group completed successfully. Nov 06 15:19:56 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-1c964b4e-b024-41b2-8642-1083e3492105 tempest-VolumesTestJSON-176401190 None] Acquiring lock "cinder-e673f0c6-d04c-4b69-9019-fc2663fcdcbf-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:19:56 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-1c964b4e-b024-41b2-8642-1083e3492105 tempest-VolumesTestJSON-176401190 None] Lock "cinder-e673f0c6-d04c-4b69-9019-fc2663fcdcbf-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:19:56 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-1c964b4e-b024-41b2-8642-1083e3492105 tempest-VolumesTestJSON-176401190 None] Acquiring lock "cinder-quobyte-e673f0c6-d04c-4b69-9019-fc2663fcdcbf" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:19:56 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-1c964b4e-b024-41b2-8642-1083e3492105 tempest-VolumesTestJSON-176401190 None] Lock "cinder-quobyte-e673f0c6-d04c-4b69-9019-fc2663fcdcbf" acquired by "delete_volume" :: waited 0.020s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:19:56 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[a760b68d-43b7-4e24-90a9-f3e7261e2f8c]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:19:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1c964b4e-b024-41b2-8642-1083e3492105 tempest-VolumesTestJSON-176401190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-e673f0c6-d04c-4b69-9019-fc2663fcdcbf {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:19:57 devstack sudo[89837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-e673f0c6-d04c-4b69-9019-fc2663fcdcbf Nov 06 15:19:57 devstack sudo[89837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:19:57 devstack sudo[89837]: pam_unix(sudo:session): session closed for user root Nov 06 15:19:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1c964b4e-b024-41b2-8642-1083e3492105 tempest-VolumesTestJSON-176401190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-e673f0c6-d04c-4b69-9019-fc2663fcdcbf" returned: 0 in 0.381s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:19:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1c964b4e-b024-41b2-8642-1083e3492105 tempest-VolumesTestJSON-176401190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-e673f0c6-d04c-4b69-9019-fc2663fcdcbf {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:19:57 devstack sudo[89842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-e673f0c6-d04c-4b69-9019-fc2663fcdcbf Nov 06 15:19:57 devstack sudo[89842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:19:57 devstack sudo[89842]: pam_unix(sudo:session): session closed for user root Nov 06 15:19:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1c964b4e-b024-41b2-8642-1083e3492105 tempest-VolumesTestJSON-176401190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-e673f0c6-d04c-4b69-9019-fc2663fcdcbf" returned: 0 in 0.267s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:19:57 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-1c964b4e-b024-41b2-8642-1083e3492105 tempest-VolumesTestJSON-176401190 None] Lock "cinder-quobyte-e673f0c6-d04c-4b69-9019-fc2663fcdcbf" released by "delete_volume" :: held 0.701s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:19:57 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-1c964b4e-b024-41b2-8642-1083e3492105 tempest-VolumesTestJSON-176401190 None] Created reservations ['b5abc770-f543-4262-9e28-1a4d929e0607', '706cf23a-179a-4ef9-9738-8b8b8c71c5b8', '870b0ef9-6473-4a6f-a9a7-0efa163ba468', 'bb652261-4229-47a4-9599-d1749f512906'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:19:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1c964b4e-b024-41b2-8642-1083e3492105 tempest-VolumesTestJSON-176401190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:19:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1c964b4e-b024-41b2-8642-1083e3492105 tempest-VolumesTestJSON-176401190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:19:57 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1c964b4e-b024-41b2-8642-1083e3492105 tempest-VolumesTestJSON-176401190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:19:57 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1c964b4e-b024-41b2-8642-1083e3492105 tempest-VolumesTestJSON-176401190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:19:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1c964b4e-b024-41b2-8642-1083e3492105 tempest-VolumesTestJSON-176401190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:19:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1c964b4e-b024-41b2-8642-1083e3492105 tempest-VolumesTestJSON-176401190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:19:57 devstack sudo[89845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:19:57 devstack sudo[89845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:19:57 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-fd89da99-47c9-41ce-b6b3-8ccf11727672 tempest-VolumesTestJSON-176401190 None] Acquiring lock "cinder-81603169-4048-4f18-852e-b9badb31498c-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:19:58 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-fd89da99-47c9-41ce-b6b3-8ccf11727672 tempest-VolumesTestJSON-176401190 None] Lock "cinder-81603169-4048-4f18-852e-b9badb31498c-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:19:58 devstack sudo[89845]: pam_unix(sudo:session): session closed for user root Nov 06 15:19:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1c964b4e-b024-41b2-8642-1083e3492105 tempest-VolumesTestJSON-176401190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.364s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:19:58 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-1c964b4e-b024-41b2-8642-1083e3492105 tempest-VolumesTestJSON-176401190 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:19:58 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-1c964b4e-b024-41b2-8642-1083e3492105 tempest-VolumesTestJSON-176401190 None] Deleted volume successfully. Nov 06 15:19:58 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-fd89da99-47c9-41ce-b6b3-8ccf11727672 tempest-VolumesTestJSON-176401190 None] Acquiring lock "cinder-quobyte-81603169-4048-4f18-852e-b9badb31498c" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:19:58 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-1c964b4e-b024-41b2-8642-1083e3492105 tempest-VolumesTestJSON-176401190 None] Lock "cinder-e673f0c6-d04c-4b69-9019-fc2663fcdcbf-delete_volume" released by "delete_volume" :: held 1.330s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:19:58 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-fd89da99-47c9-41ce-b6b3-8ccf11727672 tempest-VolumesTestJSON-176401190 None] Lock "cinder-quobyte-81603169-4048-4f18-852e-b9badb31498c" acquired by "delete_volume" :: waited 0.024s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:19:58 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[469bab51-37ed-4fe5-b61d-a6813ba3d077]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:19:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-fd89da99-47c9-41ce-b6b3-8ccf11727672 tempest-VolumesTestJSON-176401190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-81603169-4048-4f18-852e-b9badb31498c {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:19:58 devstack sudo[89848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-81603169-4048-4f18-852e-b9badb31498c Nov 06 15:19:58 devstack sudo[89848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:19:58 devstack sudo[89848]: pam_unix(sudo:session): session closed for user root Nov 06 15:19:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-fd89da99-47c9-41ce-b6b3-8ccf11727672 tempest-VolumesTestJSON-176401190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-81603169-4048-4f18-852e-b9badb31498c" returned: 0 in 0.414s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:19:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-fd89da99-47c9-41ce-b6b3-8ccf11727672 tempest-VolumesTestJSON-176401190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-81603169-4048-4f18-852e-b9badb31498c {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:19:58 devstack sudo[89853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-81603169-4048-4f18-852e-b9badb31498c Nov 06 15:19:58 devstack sudo[89853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:19:58 devstack sudo[89853]: pam_unix(sudo:session): session closed for user root Nov 06 15:19:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-fd89da99-47c9-41ce-b6b3-8ccf11727672 tempest-VolumesTestJSON-176401190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-81603169-4048-4f18-852e-b9badb31498c" returned: 0 in 0.297s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:19:58 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-fd89da99-47c9-41ce-b6b3-8ccf11727672 tempest-VolumesTestJSON-176401190 None] Lock "cinder-quobyte-81603169-4048-4f18-852e-b9badb31498c" released by "delete_volume" :: held 0.770s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:19:58 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-fd89da99-47c9-41ce-b6b3-8ccf11727672 tempest-VolumesTestJSON-176401190 None] Created reservations ['71a53b4e-8990-466a-9f72-fd2334928456', '053134d1-9e73-40e3-a1f5-7b3d1f38c5a9', 'f335bfdc-1598-4684-afbc-7276d89ba258', '23e1d098-d29a-4dd4-8721-57135af31d1a'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:19:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-fd89da99-47c9-41ce-b6b3-8ccf11727672 tempest-VolumesTestJSON-176401190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:19:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-fd89da99-47c9-41ce-b6b3-8ccf11727672 tempest-VolumesTestJSON-176401190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:19:59 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-fd89da99-47c9-41ce-b6b3-8ccf11727672 tempest-VolumesTestJSON-176401190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:19:59 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-fd89da99-47c9-41ce-b6b3-8ccf11727672 tempest-VolumesTestJSON-176401190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:19:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-fd89da99-47c9-41ce-b6b3-8ccf11727672 tempest-VolumesTestJSON-176401190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:19:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-fd89da99-47c9-41ce-b6b3-8ccf11727672 tempest-VolumesTestJSON-176401190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:19:59 devstack sudo[89856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:19:59 devstack sudo[89856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:19:59 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-87c3e41e-607c-439d-8fe1-80dba8f175ad tempest-VolumesTestJSON-176401190 None] Acquiring lock "cinder-a67cbabf-e2ac-42bf-90eb-08908f04736e-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:19:59 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-87c3e41e-607c-439d-8fe1-80dba8f175ad tempest-VolumesTestJSON-176401190 None] Lock "cinder-a67cbabf-e2ac-42bf-90eb-08908f04736e-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:19:59 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-87c3e41e-607c-439d-8fe1-80dba8f175ad tempest-VolumesTestJSON-176401190 None] Acquiring lock "cinder-quobyte-a67cbabf-e2ac-42bf-90eb-08908f04736e" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:19:59 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-87c3e41e-607c-439d-8fe1-80dba8f175ad tempest-VolumesTestJSON-176401190 None] Lock "cinder-quobyte-a67cbabf-e2ac-42bf-90eb-08908f04736e" acquired by "delete_volume" :: waited 0.022s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:19:59 devstack sudo[89856]: pam_unix(sudo:session): session closed for user root Nov 06 15:19:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-fd89da99-47c9-41ce-b6b3-8ccf11727672 tempest-VolumesTestJSON-176401190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.345s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:19:59 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-fd89da99-47c9-41ce-b6b3-8ccf11727672 tempest-VolumesTestJSON-176401190 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:19:59 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-fd89da99-47c9-41ce-b6b3-8ccf11727672 tempest-VolumesTestJSON-176401190 None] Deleted volume successfully. Nov 06 15:19:59 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[70522977-b351-438c-b2ab-b9380b1ea210]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:19:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-87c3e41e-607c-439d-8fe1-80dba8f175ad tempest-VolumesTestJSON-176401190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a67cbabf-e2ac-42bf-90eb-08908f04736e {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:19:59 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-fd89da99-47c9-41ce-b6b3-8ccf11727672 tempest-VolumesTestJSON-176401190 None] Lock "cinder-81603169-4048-4f18-852e-b9badb31498c-delete_volume" released by "delete_volume" :: held 1.461s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:19:59 devstack sudo[89861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a67cbabf-e2ac-42bf-90eb-08908f04736e Nov 06 15:19:59 devstack sudo[89861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:19:59 devstack sudo[89861]: pam_unix(sudo:session): session closed for user root Nov 06 15:19:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-87c3e41e-607c-439d-8fe1-80dba8f175ad tempest-VolumesTestJSON-176401190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a67cbabf-e2ac-42bf-90eb-08908f04736e" returned: 0 in 0.586s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:20:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-87c3e41e-607c-439d-8fe1-80dba8f175ad tempest-VolumesTestJSON-176401190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a67cbabf-e2ac-42bf-90eb-08908f04736e {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:20:00 devstack sudo[89867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a67cbabf-e2ac-42bf-90eb-08908f04736e Nov 06 15:20:00 devstack sudo[89867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:20:00 devstack sudo[89867]: pam_unix(sudo:session): session closed for user root Nov 06 15:20:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-87c3e41e-607c-439d-8fe1-80dba8f175ad tempest-VolumesTestJSON-176401190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a67cbabf-e2ac-42bf-90eb-08908f04736e" returned: 0 in 0.357s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:20:00 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-87c3e41e-607c-439d-8fe1-80dba8f175ad tempest-VolumesTestJSON-176401190 None] Lock "cinder-quobyte-a67cbabf-e2ac-42bf-90eb-08908f04736e" released by "delete_volume" :: held 1.033s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:20:00 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-87c3e41e-607c-439d-8fe1-80dba8f175ad tempest-VolumesTestJSON-176401190 None] Created reservations ['a377111f-cc2f-4f00-9814-56fe64aba6c8', '89d84a80-f55e-4594-aa72-d213b3d1c225', '1cf3b753-bac1-4f50-a97c-e78f714b4b46', '015ecac7-f21f-4130-aeee-f878ffb723af'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:20:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-87c3e41e-607c-439d-8fe1-80dba8f175ad tempest-VolumesTestJSON-176401190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:20:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-87c3e41e-607c-439d-8fe1-80dba8f175ad tempest-VolumesTestJSON-176401190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:20:00 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-87c3e41e-607c-439d-8fe1-80dba8f175ad tempest-VolumesTestJSON-176401190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:20:00 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-87c3e41e-607c-439d-8fe1-80dba8f175ad tempest-VolumesTestJSON-176401190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:20:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-87c3e41e-607c-439d-8fe1-80dba8f175ad tempest-VolumesTestJSON-176401190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:20:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-87c3e41e-607c-439d-8fe1-80dba8f175ad tempest-VolumesTestJSON-176401190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:20:00 devstack sudo[89876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:20:00 devstack sudo[89876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:20:00 devstack sudo[89876]: pam_unix(sudo:session): session closed for user root Nov 06 15:20:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-87c3e41e-607c-439d-8fe1-80dba8f175ad tempest-VolumesTestJSON-176401190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.336s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:20:00 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-87c3e41e-607c-439d-8fe1-80dba8f175ad tempest-VolumesTestJSON-176401190 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:20:00 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-87c3e41e-607c-439d-8fe1-80dba8f175ad tempest-VolumesTestJSON-176401190 None] Deleted volume successfully. Nov 06 15:20:00 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-87c3e41e-607c-439d-8fe1-80dba8f175ad tempest-VolumesTestJSON-176401190 None] Lock "cinder-a67cbabf-e2ac-42bf-90eb-08908f04736e-delete_volume" released by "delete_volume" :: held 1.716s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:20:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-ee84a540-69dd-4957-aaa4-ec5aa67f4576 req-b5dec61f-9411-4c4d-8a1a-898e42cf83fe tempest-TaggedAttachmentsTest-362746116 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:20:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-ee84a540-69dd-4957-aaa4-ec5aa67f4576 req-b5dec61f-9411-4c4d-8a1a-898e42cf83fe tempest-TaggedAttachmentsTest-362746116 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:20:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-ee84a540-69dd-4957-aaa4-ec5aa67f4576 req-b5dec61f-9411-4c4d-8a1a-898e42cf83fe tempest-TaggedAttachmentsTest-362746116 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:20:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-ee84a540-69dd-4957-aaa4-ec5aa67f4576 req-b5dec61f-9411-4c4d-8a1a-898e42cf83fe tempest-TaggedAttachmentsTest-362746116 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b', 'name': 'volume-5b8bbe11-cb71-4060-9b5a-d2a1c5edda5f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3d5c5574-1aa5-4e7b-b82d-4e0c7f3df8e7', 'enforce_multipath': True} {{(pid=87132) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 15:20:06 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-ee84a540-69dd-4957-aaa4-ec5aa67f4576 req-b5dec61f-9411-4c4d-8a1a-898e42cf83fe tempest-TaggedAttachmentsTest-362746116 None] attachment_update completed successfully. Nov 06 15:20:07 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-c1640374-b2d9-41ea-bed8-d489b6f4bcb3 tempest-GroupSnapshotsV319Test-2086602119 None] Group tempest-GroupSnapshotsV319Test-Group-286949212: creating Nov 06 15:20:08 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 15:20:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:20:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:20:08 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:20:08 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:20:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:20:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:20:08 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-c1640374-b2d9-41ea-bed8-d489b6f4bcb3 tempest-GroupSnapshotsV319Test-2086602119 None] Group tempest-GroupSnapshotsV319Test-Group-286949212: created successfully Nov 06 15:20:08 devstack sudo[90382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:20:08 devstack sudo[90382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:20:08 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-c1640374-b2d9-41ea-bed8-d489b6f4bcb3 tempest-GroupSnapshotsV319Test-2086602119 None] Create group completed successfully. Nov 06 15:20:08 devstack sudo[90382]: pam_unix(sudo:session): session closed for user root Nov 06 15:20:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.256s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:20:08 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:20:09 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-56d68807-0a0f-41a1-a92e-3805b9b5cb40 tempest-GroupSnapshotsV319Test-2086602119 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:20:09 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-56d68807-0a0f-41a1-a92e-3805b9b5cb40 tempest-GroupSnapshotsV319Test-2086602119 None] Flow 'volume_create_manager' (2ec295c0-8fb8-4caa-bd75-bfc92f4ad364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:20:09 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-56d68807-0a0f-41a1-a92e-3805b9b5cb40 tempest-GroupSnapshotsV319Test-2086602119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad12dce8-212b-41a7-b5b9-867074a5255b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:20:09 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-56d68807-0a0f-41a1-a92e-3805b9b5cb40 tempest-GroupSnapshotsV319Test-2086602119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad12dce8-212b-41a7-b5b9-867074a5255b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:20:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1309038121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5d587128-e044-41ac-8ccc-0a6e467ac794,host='devstack@QuobyteHD#QuobyteHD',id=7d86b7e6-76e2-47ff-8360-f3640fe46b96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0012be1999640a4a4c6add623a8f983',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:20:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:20:10Z,use_quota=True,user_id='22c46582dbeb490aa654269bd276646d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b015938e-5fc3-47f4-b013-e88e075fe96d),volume_type_id=b015938e-5fc3-47f4-b013-e88e075fe96d)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:20:09 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-56d68807-0a0f-41a1-a92e-3805b9b5cb40 tempest-GroupSnapshotsV319Test-2086602119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1dcf8ea3-7ba9-4a62-96eb-a413d3004832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:20:09 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-56d68807-0a0f-41a1-a92e-3805b9b5cb40 tempest-GroupSnapshotsV319Test-2086602119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1dcf8ea3-7ba9-4a62-96eb-a413d3004832) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:20:09 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-56d68807-0a0f-41a1-a92e-3805b9b5cb40 tempest-GroupSnapshotsV319Test-2086602119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa1fc50f-a7e3-4329-a096-807bf26806e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:20:09 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-56d68807-0a0f-41a1-a92e-3805b9b5cb40 tempest-GroupSnapshotsV319Test-2086602119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa1fc50f-a7e3-4329-a096-807bf26806e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d86b7e6-76e2-47ff-8360-f3640fe46b96', 'volume_name': 'volume-7d86b7e6-76e2-47ff-8360-f3640fe46b96', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:20:09 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-56d68807-0a0f-41a1-a92e-3805b9b5cb40 tempest-GroupSnapshotsV319Test-2086602119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (405ec5b3-c1b0-43e0-b393-7c340161e273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:20:09 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-56d68807-0a0f-41a1-a92e-3805b9b5cb40 tempest-GroupSnapshotsV319Test-2086602119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (405ec5b3-c1b0-43e0-b393-7c340161e273) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:20:09 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-56d68807-0a0f-41a1-a92e-3805b9b5cb40 tempest-GroupSnapshotsV319Test-2086602119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e046953-896f-454f-b601-da11df1e7f77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:20:09 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-56d68807-0a0f-41a1-a92e-3805b9b5cb40 tempest-GroupSnapshotsV319Test-2086602119 None] Volume 7d86b7e6-76e2-47ff-8360-f3640fe46b96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d86b7e6-76e2-47ff-8360-f3640fe46b96', 'volume_size': 1} Nov 06 15:20:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-56d68807-0a0f-41a1-a92e-3805b9b5cb40 tempest-GroupSnapshotsV319Test-2086602119 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:20:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-56d68807-0a0f-41a1-a92e-3805b9b5cb40 tempest-GroupSnapshotsV319Test-2086602119 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:20:09 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-56d68807-0a0f-41a1-a92e-3805b9b5cb40 tempest-GroupSnapshotsV319Test-2086602119 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=5d587128-e044-41ac-8ccc-0a6e467ac794,created_at=2026-11-06T14:20:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1309038121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5d587128-e044-41ac-8ccc-0a6e467ac794,host='devstack@QuobyteHD#QuobyteHD',id=7d86b7e6-76e2-47ff-8360-f3640fe46b96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0012be1999640a4a4c6add623a8f983',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:20:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:20:10Z,use_quota=True,user_id='22c46582dbeb490aa654269bd276646d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b015938e-5fc3-47f4-b013-e88e075fe96d),volume_type_id=b015938e-5fc3-47f4-b013-e88e075fe96d)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:20:09 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-56d68807-0a0f-41a1-a92e-3805b9b5cb40 tempest-GroupSnapshotsV319Test-2086602119 None] Creating volume 7d86b7e6-76e2-47ff-8360-f3640fe46b96 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:20:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-56d68807-0a0f-41a1-a92e-3805b9b5cb40 tempest-GroupSnapshotsV319Test-2086602119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:20:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-56d68807-0a0f-41a1-a92e-3805b9b5cb40 tempest-GroupSnapshotsV319Test-2086602119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:20:09 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-56d68807-0a0f-41a1-a92e-3805b9b5cb40 tempest-GroupSnapshotsV319Test-2086602119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:20:09 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-56d68807-0a0f-41a1-a92e-3805b9b5cb40 tempest-GroupSnapshotsV319Test-2086602119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:20:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-56d68807-0a0f-41a1-a92e-3805b9b5cb40 tempest-GroupSnapshotsV319Test-2086602119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:20:09 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-56d68807-0a0f-41a1-a92e-3805b9b5cb40 tempest-GroupSnapshotsV319Test-2086602119 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:20:09 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-56d68807-0a0f-41a1-a92e-3805b9b5cb40 tempest-GroupSnapshotsV319Test-2086602119 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:20:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-56d68807-0a0f-41a1-a92e-3805b9b5cb40 tempest-GroupSnapshotsV319Test-2086602119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-7d86b7e6-76e2-47ff-8360-f3640fe46b96 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:20:09 devstack sudo[90417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-7d86b7e6-76e2-47ff-8360-f3640fe46b96 1073741824 Nov 06 15:20:09 devstack sudo[90417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:20:09 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-d56228f0-4f20-487b-9cb9-a827b475d7f8 req-bed226e5-79d8-491d-bbb7-e851214e137c tempest-TaggedAttachmentsTest-362746116 None] Terminate volume connection completed successfully. Nov 06 15:20:09 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-d56228f0-4f20-487b-9cb9-a827b475d7f8 req-bed226e5-79d8-491d-bbb7-e851214e137c tempest-TaggedAttachmentsTest-362746116 None] Deleting attachment 3d5c5574-1aa5-4e7b-b82d-4e0c7f3df8e7. {{(pid=87132) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 06 15:20:10 devstack sudo[90417]: pam_unix(sudo:session): session closed for user root Nov 06 15:20:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-56d68807-0a0f-41a1-a92e-3805b9b5cb40 tempest-GroupSnapshotsV319Test-2086602119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-7d86b7e6-76e2-47ff-8360-f3640fe46b96 1073741824" returned: 0 in 0.569s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:20:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-56d68807-0a0f-41a1-a92e-3805b9b5cb40 tempest-GroupSnapshotsV319Test-2086602119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-7d86b7e6-76e2-47ff-8360-f3640fe46b96 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:20:10 devstack sudo[90423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-7d86b7e6-76e2-47ff-8360-f3640fe46b96 Nov 06 15:20:10 devstack sudo[90423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:20:10 devstack sudo[90423]: pam_unix(sudo:session): session closed for user root Nov 06 15:20:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-56d68807-0a0f-41a1-a92e-3805b9b5cb40 tempest-GroupSnapshotsV319Test-2086602119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-7d86b7e6-76e2-47ff-8360-f3640fe46b96" returned: 0 in 0.389s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:20:10 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-56d68807-0a0f-41a1-a92e-3805b9b5cb40 tempest-GroupSnapshotsV319Test-2086602119 None] <== create_volume: return (1017ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:20:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-56d68807-0a0f-41a1-a92e-3805b9b5cb40 tempest-GroupSnapshotsV319Test-2086602119 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.021s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:20:10 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-56d68807-0a0f-41a1-a92e-3805b9b5cb40 tempest-GroupSnapshotsV319Test-2086602119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e046953-896f-454f-b601-da11df1e7f77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d86b7e6-76e2-47ff-8360-f3640fe46b96', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:20:10 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-56d68807-0a0f-41a1-a92e-3805b9b5cb40 tempest-GroupSnapshotsV319Test-2086602119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f21cd701-0da5-4510-ba72-a61f848c0837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:20:10 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-56d68807-0a0f-41a1-a92e-3805b9b5cb40 tempest-GroupSnapshotsV319Test-2086602119 None] Volume volume-7d86b7e6-76e2-47ff-8360-f3640fe46b96 (7d86b7e6-76e2-47ff-8360-f3640fe46b96): created successfully Nov 06 15:20:10 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-56d68807-0a0f-41a1-a92e-3805b9b5cb40 tempest-GroupSnapshotsV319Test-2086602119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f21cd701-0da5-4510-ba72-a61f848c0837) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:20:10 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-56d68807-0a0f-41a1-a92e-3805b9b5cb40 tempest-GroupSnapshotsV319Test-2086602119 None] Flow 'volume_create_manager' (2ec295c0-8fb8-4caa-bd75-bfc92f4ad364) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:20:10 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-56d68807-0a0f-41a1-a92e-3805b9b5cb40 tempest-GroupSnapshotsV319Test-2086602119 None] Created volume successfully. Nov 06 15:20:11 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a72328d-5535-4d9a-82ef-9e4d4aeba972 tempest-VolumeQuotasNegativeTestJSON-1217674680 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:20:11 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3a72328d-5535-4d9a-82ef-9e4d4aeba972 tempest-VolumeQuotasNegativeTestJSON-1217674680 None] Flow 'volume_create_manager' (d03f98a0-cbf9-4359-ad2d-5c2af8243566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:20:11 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3a72328d-5535-4d9a-82ef-9e4d4aeba972 tempest-VolumeQuotasNegativeTestJSON-1217674680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (842837fa-db0f-4659-9567-d2ca5d5bdf62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:20:11 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3a72328d-5535-4d9a-82ef-9e4d4aeba972 tempest-VolumeQuotasNegativeTestJSON-1217674680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (842837fa-db0f-4659-9567-d2ca5d5bdf62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:20:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-837532807',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64adf173-e5b0-40e3-970d-a48903561407,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47ba12c0f9ba48cc8b52a06a232b679f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:20:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:20:11Z,use_quota=True,user_id='68a841ced5b345acb6ef35ff143c759e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:20:11 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3a72328d-5535-4d9a-82ef-9e4d4aeba972 tempest-VolumeQuotasNegativeTestJSON-1217674680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1db6de60-8ea7-4c2c-91f9-cc32f9d14c20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:20:11 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3a72328d-5535-4d9a-82ef-9e4d4aeba972 tempest-VolumeQuotasNegativeTestJSON-1217674680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1db6de60-8ea7-4c2c-91f9-cc32f9d14c20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:20:11 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3a72328d-5535-4d9a-82ef-9e4d4aeba972 tempest-VolumeQuotasNegativeTestJSON-1217674680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35af6718-b141-4b9f-94c4-30fb5ef84de8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:20:11 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3a72328d-5535-4d9a-82ef-9e4d4aeba972 tempest-VolumeQuotasNegativeTestJSON-1217674680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35af6718-b141-4b9f-94c4-30fb5ef84de8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64adf173-e5b0-40e3-970d-a48903561407', 'volume_name': 'volume-64adf173-e5b0-40e3-970d-a48903561407', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:20:11 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3a72328d-5535-4d9a-82ef-9e4d4aeba972 tempest-VolumeQuotasNegativeTestJSON-1217674680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73b41398-3949-468b-b872-5579258bec11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:20:11 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3a72328d-5535-4d9a-82ef-9e4d4aeba972 tempest-VolumeQuotasNegativeTestJSON-1217674680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73b41398-3949-468b-b872-5579258bec11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:20:11 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3a72328d-5535-4d9a-82ef-9e4d4aeba972 tempest-VolumeQuotasNegativeTestJSON-1217674680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a467ec1-2254-4f4d-a2d1-3bf0abc9b7e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:20:11 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-3a72328d-5535-4d9a-82ef-9e4d4aeba972 tempest-VolumeQuotasNegativeTestJSON-1217674680 None] Volume 64adf173-e5b0-40e3-970d-a48903561407: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64adf173-e5b0-40e3-970d-a48903561407', 'volume_size': 1} Nov 06 15:20:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3a72328d-5535-4d9a-82ef-9e4d4aeba972 tempest-VolumeQuotasNegativeTestJSON-1217674680 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:20:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3a72328d-5535-4d9a-82ef-9e4d4aeba972 tempest-VolumeQuotasNegativeTestJSON-1217674680 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:20:11 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3a72328d-5535-4d9a-82ef-9e4d4aeba972 tempest-VolumeQuotasNegativeTestJSON-1217674680 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:20:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-837532807',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64adf173-e5b0-40e3-970d-a48903561407,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47ba12c0f9ba48cc8b52a06a232b679f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:20:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:20:11Z,use_quota=True,user_id='68a841ced5b345acb6ef35ff143c759e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:20:11 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-3a72328d-5535-4d9a-82ef-9e4d4aeba972 tempest-VolumeQuotasNegativeTestJSON-1217674680 None] Creating volume 64adf173-e5b0-40e3-970d-a48903561407 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:20:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3a72328d-5535-4d9a-82ef-9e4d4aeba972 tempest-VolumeQuotasNegativeTestJSON-1217674680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:20:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3a72328d-5535-4d9a-82ef-9e4d4aeba972 tempest-VolumeQuotasNegativeTestJSON-1217674680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:20:11 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3a72328d-5535-4d9a-82ef-9e4d4aeba972 tempest-VolumeQuotasNegativeTestJSON-1217674680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:20:11 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3a72328d-5535-4d9a-82ef-9e4d4aeba972 tempest-VolumeQuotasNegativeTestJSON-1217674680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:20:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3a72328d-5535-4d9a-82ef-9e4d4aeba972 tempest-VolumeQuotasNegativeTestJSON-1217674680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:20:11 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3a72328d-5535-4d9a-82ef-9e4d4aeba972 tempest-VolumeQuotasNegativeTestJSON-1217674680 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:20:11 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-3a72328d-5535-4d9a-82ef-9e4d4aeba972 tempest-VolumeQuotasNegativeTestJSON-1217674680 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:20:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3a72328d-5535-4d9a-82ef-9e4d4aeba972 tempest-VolumeQuotasNegativeTestJSON-1217674680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-64adf173-e5b0-40e3-970d-a48903561407 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:20:11 devstack sudo[90439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-64adf173-e5b0-40e3-970d-a48903561407 1073741824 Nov 06 15:20:11 devstack sudo[90439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:20:11 devstack sudo[90439]: pam_unix(sudo:session): session closed for user root Nov 06 15:20:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3a72328d-5535-4d9a-82ef-9e4d4aeba972 tempest-VolumeQuotasNegativeTestJSON-1217674680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-64adf173-e5b0-40e3-970d-a48903561407 1073741824" returned: 0 in 0.512s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:20:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3a72328d-5535-4d9a-82ef-9e4d4aeba972 tempest-VolumeQuotasNegativeTestJSON-1217674680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-64adf173-e5b0-40e3-970d-a48903561407 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:20:11 devstack sudo[90452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-64adf173-e5b0-40e3-970d-a48903561407 Nov 06 15:20:11 devstack sudo[90452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:20:12 devstack sudo[90452]: pam_unix(sudo:session): session closed for user root Nov 06 15:20:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3a72328d-5535-4d9a-82ef-9e4d4aeba972 tempest-VolumeQuotasNegativeTestJSON-1217674680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-64adf173-e5b0-40e3-970d-a48903561407" returned: 0 in 0.334s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:20:12 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3a72328d-5535-4d9a-82ef-9e4d4aeba972 tempest-VolumeQuotasNegativeTestJSON-1217674680 None] <== create_volume: return (906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:20:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3a72328d-5535-4d9a-82ef-9e4d4aeba972 tempest-VolumeQuotasNegativeTestJSON-1217674680 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.908s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:20:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3a72328d-5535-4d9a-82ef-9e4d4aeba972 tempest-VolumeQuotasNegativeTestJSON-1217674680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a467ec1-2254-4f4d-a2d1-3bf0abc9b7e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64adf173-e5b0-40e3-970d-a48903561407', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:20:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3a72328d-5535-4d9a-82ef-9e4d4aeba972 tempest-VolumeQuotasNegativeTestJSON-1217674680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e97f489-824b-4c69-a1bb-fc627da86a2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:20:12 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-3a72328d-5535-4d9a-82ef-9e4d4aeba972 tempest-VolumeQuotasNegativeTestJSON-1217674680 None] Volume volume-64adf173-e5b0-40e3-970d-a48903561407 (64adf173-e5b0-40e3-970d-a48903561407): created successfully Nov 06 15:20:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3a72328d-5535-4d9a-82ef-9e4d4aeba972 tempest-VolumeQuotasNegativeTestJSON-1217674680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e97f489-824b-4c69-a1bb-fc627da86a2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:20:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3a72328d-5535-4d9a-82ef-9e4d4aeba972 tempest-VolumeQuotasNegativeTestJSON-1217674680 None] Flow 'volume_create_manager' (d03f98a0-cbf9-4359-ad2d-5c2af8243566) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:20:12 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-3a72328d-5535-4d9a-82ef-9e4d4aeba972 tempest-VolumeQuotasNegativeTestJSON-1217674680 None] Created volume successfully. Nov 06 15:20:12 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-ec314af8-acc9-405c-a05d-6eb81d1d07d3 tempest-GroupSnapshotsV319Test-2086602119 None] GroupSnapshot c65f7ec8-b981-4a64-b7c6-0a8e71dc0eb2: creating. Nov 06 15:20:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ec314af8-acc9-405c-a05d-6eb81d1d07d3 tempest-GroupSnapshotsV319Test-2086602119 None] Group snapshot c65f7ec8-b981-4a64-b7c6-0a8e71dc0eb2: creating. {{(pid=87132) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 06 15:20:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ec314af8-acc9-405c-a05d-6eb81d1d07d3 tempest-GroupSnapshotsV319Test-2086602119 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:20:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ec314af8-acc9-405c-a05d-6eb81d1d07d3 tempest-GroupSnapshotsV319Test-2086602119 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:20:12 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-ec314af8-acc9-405c-a05d-6eb81d1d07d3 tempest-GroupSnapshotsV319Test-2086602119 None] Creating offline snapshot 1e6954d5-3ac8-438d-b964-a861c97b2510 of volume 7d86b7e6-76e2-47ff-8360-f3640fe46b96 {{(pid=87132) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 15:20:12 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab9ecdde-ee09-46c5-8ffe-b28a74b31717]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:20:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ec314af8-acc9-405c-a05d-6eb81d1d07d3 tempest-GroupSnapshotsV319Test-2086602119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-7d86b7e6-76e2-47ff-8360-f3640fe46b96 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:20:12 devstack sudo[90456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-7d86b7e6-76e2-47ff-8360-f3640fe46b96 Nov 06 15:20:12 devstack sudo[90456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:20:13 devstack sudo[90456]: pam_unix(sudo:session): session closed for user root Nov 06 15:20:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ec314af8-acc9-405c-a05d-6eb81d1d07d3 tempest-GroupSnapshotsV319Test-2086602119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-7d86b7e6-76e2-47ff-8360-f3640fe46b96" returned: 0 in 0.362s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:20:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ec314af8-acc9-405c-a05d-6eb81d1d07d3 tempest-GroupSnapshotsV319Test-2086602119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-7d86b7e6-76e2-47ff-8360-f3640fe46b96,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-7d86b7e6-76e2-47ff-8360-f3640fe46b96.1e6954d5-3ac8-438d-b964-a861c97b2510 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:20:13 devstack sudo[90461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-7d86b7e6-76e2-47ff-8360-f3640fe46b96,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-7d86b7e6-76e2-47ff-8360-f3640fe46b96.1e6954d5-3ac8-438d-b964-a861c97b2510 1G Nov 06 15:20:13 devstack sudo[90461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:20:13 devstack sudo[90461]: pam_unix(sudo:session): session closed for user root Nov 06 15:20:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ec314af8-acc9-405c-a05d-6eb81d1d07d3 tempest-GroupSnapshotsV319Test-2086602119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-7d86b7e6-76e2-47ff-8360-f3640fe46b96,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-7d86b7e6-76e2-47ff-8360-f3640fe46b96.1e6954d5-3ac8-438d-b964-a861c97b2510 1G" returned: 0 in 0.504s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:20:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ec314af8-acc9-405c-a05d-6eb81d1d07d3 tempest-GroupSnapshotsV319Test-2086602119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d86b7e6-76e2-47ff-8360-f3640fe46b96 -F qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-7d86b7e6-76e2-47ff-8360-f3640fe46b96.1e6954d5-3ac8-438d-b964-a861c97b2510 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:20:13 devstack sudo[90470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d86b7e6-76e2-47ff-8360-f3640fe46b96 -F qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-7d86b7e6-76e2-47ff-8360-f3640fe46b96.1e6954d5-3ac8-438d-b964-a861c97b2510 Nov 06 15:20:13 devstack sudo[90470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:20:13 devstack sudo[90470]: pam_unix(sudo:session): session closed for user root Nov 06 15:20:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ec314af8-acc9-405c-a05d-6eb81d1d07d3 tempest-GroupSnapshotsV319Test-2086602119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d86b7e6-76e2-47ff-8360-f3640fe46b96 -F qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-7d86b7e6-76e2-47ff-8360-f3640fe46b96.1e6954d5-3ac8-438d-b964-a861c97b2510" returned: 0 in 0.368s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:20:13 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-ec314af8-acc9-405c-a05d-6eb81d1d07d3 tempest-GroupSnapshotsV319Test-2086602119 None] /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-7d86b7e6-76e2-47ff-8360-f3640fe46b96.1e6954d5-3ac8-438d-b964-a861c97b2510 is being set with open permissions: ugo+rw: NotImplementedError Nov 06 15:20:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ec314af8-acc9-405c-a05d-6eb81d1d07d3 tempest-GroupSnapshotsV319Test-2086602119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-7d86b7e6-76e2-47ff-8360-f3640fe46b96.1e6954d5-3ac8-438d-b964-a861c97b2510 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:20:13 devstack sudo[90475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-7d86b7e6-76e2-47ff-8360-f3640fe46b96.1e6954d5-3ac8-438d-b964-a861c97b2510 Nov 06 15:20:13 devstack sudo[90475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:20:14 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-8784793f-2f60-4ea8-9856-1a59cf540679 tempest-AttachVolumeShelveTestJSON-437798152 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:20:14 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8784793f-2f60-4ea8-9856-1a59cf540679 tempest-AttachVolumeShelveTestJSON-437798152 None] Flow 'volume_create_manager' (b102d815-bfba-4936-88ba-b10294c32baa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:20:14 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8784793f-2f60-4ea8-9856-1a59cf540679 tempest-AttachVolumeShelveTestJSON-437798152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99031006-d49b-4722-b37f-2c3a6b06d1a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:20:14 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8784793f-2f60-4ea8-9856-1a59cf540679 tempest-AttachVolumeShelveTestJSON-437798152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99031006-d49b-4722-b37f-2c3a6b06d1a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:20:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1699645130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8d6e758-dad1-463d-933d-8862c527bca7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3722bf9ea61415e94a5682a922dd0ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:20:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:20:14Z,use_quota=True,user_id='66cc1164c7904239891e9205d9486e90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:20:14 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8784793f-2f60-4ea8-9856-1a59cf540679 tempest-AttachVolumeShelveTestJSON-437798152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2da5518-b54c-4986-bfeb-86aabdffc00b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:20:14 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8784793f-2f60-4ea8-9856-1a59cf540679 tempest-AttachVolumeShelveTestJSON-437798152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2da5518-b54c-4986-bfeb-86aabdffc00b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:20:14 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8784793f-2f60-4ea8-9856-1a59cf540679 tempest-AttachVolumeShelveTestJSON-437798152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a63aa21e-cd58-4d3b-95ad-5f285f6b34ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:20:14 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8784793f-2f60-4ea8-9856-1a59cf540679 tempest-AttachVolumeShelveTestJSON-437798152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a63aa21e-cd58-4d3b-95ad-5f285f6b34ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8d6e758-dad1-463d-933d-8862c527bca7', 'volume_name': 'volume-b8d6e758-dad1-463d-933d-8862c527bca7', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:20:14 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8784793f-2f60-4ea8-9856-1a59cf540679 tempest-AttachVolumeShelveTestJSON-437798152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1a77ab9-b59e-42ca-9ba6-64f649de4db1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:20:14 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8784793f-2f60-4ea8-9856-1a59cf540679 tempest-AttachVolumeShelveTestJSON-437798152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1a77ab9-b59e-42ca-9ba6-64f649de4db1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:20:14 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8784793f-2f60-4ea8-9856-1a59cf540679 tempest-AttachVolumeShelveTestJSON-437798152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9068a5b9-990c-48f8-86c8-0d6d5ff83289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:20:14 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-8784793f-2f60-4ea8-9856-1a59cf540679 tempest-AttachVolumeShelveTestJSON-437798152 None] Volume b8d6e758-dad1-463d-933d-8862c527bca7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8d6e758-dad1-463d-933d-8862c527bca7', 'volume_size': 1} Nov 06 15:20:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8784793f-2f60-4ea8-9856-1a59cf540679 tempest-AttachVolumeShelveTestJSON-437798152 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:20:14 devstack sudo[90475]: pam_unix(sudo:session): session closed for user root Nov 06 15:20:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ec314af8-acc9-405c-a05d-6eb81d1d07d3 tempest-GroupSnapshotsV319Test-2086602119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-7d86b7e6-76e2-47ff-8360-f3640fe46b96.1e6954d5-3ac8-438d-b964-a861c97b2510" returned: 0 in 0.297s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:20:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ec314af8-acc9-405c-a05d-6eb81d1d07d3 tempest-GroupSnapshotsV319Test-2086602119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-7d86b7e6-76e2-47ff-8360-f3640fe46b96.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:20:14 devstack sudo[90479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-7d86b7e6-76e2-47ff-8360-f3640fe46b96.info Nov 06 15:20:14 devstack sudo[90479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:20:14 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-de6723d0-d05c-4a6f-83ae-4f9f3724ed58 tempest-VolumeQuotasNegativeTestJSON-1217674680 None] Acquiring lock "cinder-64adf173-e5b0-40e3-970d-a48903561407-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:20:14 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-de6723d0-d05c-4a6f-83ae-4f9f3724ed58 tempest-VolumeQuotasNegativeTestJSON-1217674680 None] Lock "cinder-64adf173-e5b0-40e3-970d-a48903561407-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:20:14 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-de6723d0-d05c-4a6f-83ae-4f9f3724ed58 tempest-VolumeQuotasNegativeTestJSON-1217674680 None] Acquiring lock "cinder-quobyte-64adf173-e5b0-40e3-970d-a48903561407" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:20:14 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-de6723d0-d05c-4a6f-83ae-4f9f3724ed58 tempest-VolumeQuotasNegativeTestJSON-1217674680 None] Lock "cinder-quobyte-64adf173-e5b0-40e3-970d-a48903561407" acquired by "delete_volume" :: waited 0.020s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:20:14 devstack sudo[90479]: pam_unix(sudo:session): session closed for user root Nov 06 15:20:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ec314af8-acc9-405c-a05d-6eb81d1d07d3 tempest-GroupSnapshotsV319Test-2086602119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-7d86b7e6-76e2-47ff-8360-f3640fe46b96.info" returned: 0 in 0.339s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:20:14 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-ec314af8-acc9-405c-a05d-6eb81d1d07d3 tempest-GroupSnapshotsV319Test-2086602119 None] /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-7d86b7e6-76e2-47ff-8360-f3640fe46b96.info is being set with open permissions: ugo+rw: NotImplementedError Nov 06 15:20:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ec314af8-acc9-405c-a05d-6eb81d1d07d3 tempest-GroupSnapshotsV319Test-2086602119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-7d86b7e6-76e2-47ff-8360-f3640fe46b96.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:20:14 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[33d21b91-c108-43d6-9329-040e8bee4972]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:20:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-de6723d0-d05c-4a6f-83ae-4f9f3724ed58 tempest-VolumeQuotasNegativeTestJSON-1217674680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-64adf173-e5b0-40e3-970d-a48903561407 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:20:14 devstack sudo[90490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-7d86b7e6-76e2-47ff-8360-f3640fe46b96.info Nov 06 15:20:14 devstack sudo[90490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:20:14 devstack sudo[90495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-64adf173-e5b0-40e3-970d-a48903561407 Nov 06 15:20:14 devstack sudo[90495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:20:15 devstack sudo[90490]: pam_unix(sudo:session): session closed for user root Nov 06 15:20:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ec314af8-acc9-405c-a05d-6eb81d1d07d3 tempest-GroupSnapshotsV319Test-2086602119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-7d86b7e6-76e2-47ff-8360-f3640fe46b96.info" returned: 0 in 0.480s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:20:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ec314af8-acc9-405c-a05d-6eb81d1d07d3 tempest-GroupSnapshotsV319Test-2086602119 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.442s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:20:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8784793f-2f60-4ea8-9856-1a59cf540679 tempest-AttachVolumeShelveTestJSON-437798152 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.965s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:20:15 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-8784793f-2f60-4ea8-9856-1a59cf540679 tempest-AttachVolumeShelveTestJSON-437798152 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:20:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1699645130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8d6e758-dad1-463d-933d-8862c527bca7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3722bf9ea61415e94a5682a922dd0ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:20:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:20:14Z,use_quota=True,user_id='66cc1164c7904239891e9205d9486e90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:20:15 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-8784793f-2f60-4ea8-9856-1a59cf540679 tempest-AttachVolumeShelveTestJSON-437798152 None] Creating volume b8d6e758-dad1-463d-933d-8862c527bca7 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:20:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8784793f-2f60-4ea8-9856-1a59cf540679 tempest-AttachVolumeShelveTestJSON-437798152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:20:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8784793f-2f60-4ea8-9856-1a59cf540679 tempest-AttachVolumeShelveTestJSON-437798152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:20:15 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-8784793f-2f60-4ea8-9856-1a59cf540679 tempest-AttachVolumeShelveTestJSON-437798152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:20:15 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-8784793f-2f60-4ea8-9856-1a59cf540679 tempest-AttachVolumeShelveTestJSON-437798152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:20:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8784793f-2f60-4ea8-9856-1a59cf540679 tempest-AttachVolumeShelveTestJSON-437798152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:20:15 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-8784793f-2f60-4ea8-9856-1a59cf540679 tempest-AttachVolumeShelveTestJSON-437798152 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:20:15 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-8784793f-2f60-4ea8-9856-1a59cf540679 tempest-AttachVolumeShelveTestJSON-437798152 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:20:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8784793f-2f60-4ea8-9856-1a59cf540679 tempest-AttachVolumeShelveTestJSON-437798152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b8d6e758-dad1-463d-933d-8862c527bca7 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:20:15 devstack sudo[90513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b8d6e758-dad1-463d-933d-8862c527bca7 1073741824 Nov 06 15:20:15 devstack sudo[90513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:20:15 devstack sudo[90495]: pam_unix(sudo:session): session closed for user root Nov 06 15:20:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-de6723d0-d05c-4a6f-83ae-4f9f3724ed58 tempest-VolumeQuotasNegativeTestJSON-1217674680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-64adf173-e5b0-40e3-970d-a48903561407" returned: 0 in 0.589s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:20:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-de6723d0-d05c-4a6f-83ae-4f9f3724ed58 tempest-VolumeQuotasNegativeTestJSON-1217674680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-64adf173-e5b0-40e3-970d-a48903561407 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:20:15 devstack sudo[90515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-64adf173-e5b0-40e3-970d-a48903561407 Nov 06 15:20:15 devstack sudo[90515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:20:15 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-ec314af8-acc9-405c-a05d-6eb81d1d07d3 tempest-GroupSnapshotsV319Test-2086602119 None] group_snapshot c65f7ec8-b981-4a64-b7c6-0a8e71dc0eb2: created successfully Nov 06 15:20:15 devstack sudo[90515]: pam_unix(sudo:session): session closed for user root Nov 06 15:20:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-de6723d0-d05c-4a6f-83ae-4f9f3724ed58 tempest-VolumeQuotasNegativeTestJSON-1217674680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-64adf173-e5b0-40e3-970d-a48903561407" returned: 0 in 0.312s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:20:15 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-de6723d0-d05c-4a6f-83ae-4f9f3724ed58 tempest-VolumeQuotasNegativeTestJSON-1217674680 None] Lock "cinder-quobyte-64adf173-e5b0-40e3-970d-a48903561407" released by "delete_volume" :: held 0.971s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:20:15 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-de6723d0-d05c-4a6f-83ae-4f9f3724ed58 tempest-VolumeQuotasNegativeTestJSON-1217674680 None] Created reservations ['070db2eb-56cc-4708-9483-5d94a108013d', '5562e97c-d2f4-43eb-a275-8da2183ef84c', '14108c19-6658-4c71-9855-d3c2315856ea', '83f43fb2-7fb1-409d-a35a-d6ba37e111b4'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:20:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-de6723d0-d05c-4a6f-83ae-4f9f3724ed58 tempest-VolumeQuotasNegativeTestJSON-1217674680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:20:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-de6723d0-d05c-4a6f-83ae-4f9f3724ed58 tempest-VolumeQuotasNegativeTestJSON-1217674680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:20:15 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-de6723d0-d05c-4a6f-83ae-4f9f3724ed58 tempest-VolumeQuotasNegativeTestJSON-1217674680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:20:15 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-de6723d0-d05c-4a6f-83ae-4f9f3724ed58 tempest-VolumeQuotasNegativeTestJSON-1217674680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:20:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-de6723d0-d05c-4a6f-83ae-4f9f3724ed58 tempest-VolumeQuotasNegativeTestJSON-1217674680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:20:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-de6723d0-d05c-4a6f-83ae-4f9f3724ed58 tempest-VolumeQuotasNegativeTestJSON-1217674680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:20:15 devstack sudo[90524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:20:15 devstack sudo[90524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:20:15 devstack sudo[90513]: pam_unix(sudo:session): session closed for user root Nov 06 15:20:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8784793f-2f60-4ea8-9856-1a59cf540679 tempest-AttachVolumeShelveTestJSON-437798152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b8d6e758-dad1-463d-933d-8862c527bca7 1073741824" returned: 0 in 0.619s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:20:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8784793f-2f60-4ea8-9856-1a59cf540679 tempest-AttachVolumeShelveTestJSON-437798152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b8d6e758-dad1-463d-933d-8862c527bca7 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:20:15 devstack sudo[90526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b8d6e758-dad1-463d-933d-8862c527bca7 Nov 06 15:20:15 devstack sudo[90526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:20:16 devstack sudo[90524]: pam_unix(sudo:session): session closed for user root Nov 06 15:20:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-de6723d0-d05c-4a6f-83ae-4f9f3724ed58 tempest-VolumeQuotasNegativeTestJSON-1217674680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.293s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:20:16 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-de6723d0-d05c-4a6f-83ae-4f9f3724ed58 tempest-VolumeQuotasNegativeTestJSON-1217674680 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:20:16 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-de6723d0-d05c-4a6f-83ae-4f9f3724ed58 tempest-VolumeQuotasNegativeTestJSON-1217674680 None] Deleted volume successfully. Nov 06 15:20:16 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-de6723d0-d05c-4a6f-83ae-4f9f3724ed58 tempest-VolumeQuotasNegativeTestJSON-1217674680 None] Lock "cinder-64adf173-e5b0-40e3-970d-a48903561407-delete_volume" released by "delete_volume" :: held 1.539s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:20:16 devstack sudo[90526]: pam_unix(sudo:session): session closed for user root Nov 06 15:20:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8784793f-2f60-4ea8-9856-1a59cf540679 tempest-AttachVolumeShelveTestJSON-437798152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b8d6e758-dad1-463d-933d-8862c527bca7" returned: 0 in 0.311s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:20:16 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-8784793f-2f60-4ea8-9856-1a59cf540679 tempest-AttachVolumeShelveTestJSON-437798152 None] <== create_volume: return (975ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:20:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8784793f-2f60-4ea8-9856-1a59cf540679 tempest-AttachVolumeShelveTestJSON-437798152 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.978s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:20:16 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8784793f-2f60-4ea8-9856-1a59cf540679 tempest-AttachVolumeShelveTestJSON-437798152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9068a5b9-990c-48f8-86c8-0d6d5ff83289) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8d6e758-dad1-463d-933d-8862c527bca7', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:20:16 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8784793f-2f60-4ea8-9856-1a59cf540679 tempest-AttachVolumeShelveTestJSON-437798152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1972f483-f236-4442-9fad-ce5ebc197604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:20:16 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-8784793f-2f60-4ea8-9856-1a59cf540679 tempest-AttachVolumeShelveTestJSON-437798152 None] Volume volume-b8d6e758-dad1-463d-933d-8862c527bca7 (b8d6e758-dad1-463d-933d-8862c527bca7): created successfully Nov 06 15:20:16 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8784793f-2f60-4ea8-9856-1a59cf540679 tempest-AttachVolumeShelveTestJSON-437798152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1972f483-f236-4442-9fad-ce5ebc197604) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:20:16 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8784793f-2f60-4ea8-9856-1a59cf540679 tempest-AttachVolumeShelveTestJSON-437798152 None] Flow 'volume_create_manager' (b102d815-bfba-4936-88ba-b10294c32baa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:20:16 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-8784793f-2f60-4ea8-9856-1a59cf540679 tempest-AttachVolumeShelveTestJSON-437798152 None] Created volume successfully. Nov 06 15:20:16 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-6cc7edec-bbed-4bd3-af1a-7df943b5b368 tempest-GroupSnapshotsV319Test-2086602119 None] group_snapshot c65f7ec8-b981-4a64-b7c6-0a8e71dc0eb2: deleting Nov 06 15:20:16 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6cc7edec-bbed-4bd3-af1a-7df943b5b368 tempest-GroupSnapshotsV319Test-2086602119 None] group_snapshot c65f7ec8-b981-4a64-b7c6-0a8e71dc0eb2: deleting {{(pid=87132) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 06 15:20:16 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6cc7edec-bbed-4bd3-af1a-7df943b5b368 tempest-GroupSnapshotsV319Test-2086602119 None] Acquiring lock "cinder-quobyte-7d86b7e6-76e2-47ff-8360-f3640fe46b96" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:20:16 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6cc7edec-bbed-4bd3-af1a-7df943b5b368 tempest-GroupSnapshotsV319Test-2086602119 None] Lock "cinder-quobyte-7d86b7e6-76e2-47ff-8360-f3640fe46b96" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:20:16 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6cc7edec-bbed-4bd3-af1a-7df943b5b368 tempest-GroupSnapshotsV319Test-2086602119 None] Acquiring lock "cinder-quobyte-1e6954d5-3ac8-438d-b964-a861c97b2510" by "_delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:20:16 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6cc7edec-bbed-4bd3-af1a-7df943b5b368 tempest-GroupSnapshotsV319Test-2086602119 None] Lock "cinder-quobyte-1e6954d5-3ac8-438d-b964-a861c97b2510" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:20:16 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-6cc7edec-bbed-4bd3-af1a-7df943b5b368 tempest-GroupSnapshotsV319Test-2086602119 None] Deleting offline snapshot 1e6954d5-3ac8-438d-b964-a861c97b2510 of volume 7d86b7e6-76e2-47ff-8360-f3640fe46b96 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 15:20:16 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-6cc7edec-bbed-4bd3-af1a-7df943b5b368 tempest-GroupSnapshotsV319Test-2086602119 None] snapshot_file for this snap is: volume-7d86b7e6-76e2-47ff-8360-f3640fe46b96.1e6954d5-3ac8-438d-b964-a861c97b2510 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 15:20:16 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[f78e9d46-3cc7-4e22-88c0-7eae16d34728]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:20:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6cc7edec-bbed-4bd3-af1a-7df943b5b368 tempest-GroupSnapshotsV319Test-2086602119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-7d86b7e6-76e2-47ff-8360-f3640fe46b96.1e6954d5-3ac8-438d-b964-a861c97b2510 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:20:16 devstack sudo[90533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-7d86b7e6-76e2-47ff-8360-f3640fe46b96.1e6954d5-3ac8-438d-b964-a861c97b2510 Nov 06 15:20:16 devstack sudo[90533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:20:17 devstack sudo[90533]: pam_unix(sudo:session): session closed for user root Nov 06 15:20:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6cc7edec-bbed-4bd3-af1a-7df943b5b368 tempest-GroupSnapshotsV319Test-2086602119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-7d86b7e6-76e2-47ff-8360-f3640fe46b96.1e6954d5-3ac8-438d-b964-a861c97b2510" returned: 0 in 0.415s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:20:17 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-6cc7edec-bbed-4bd3-af1a-7df943b5b368 tempest-GroupSnapshotsV319Test-2086602119 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7d86b7e6-76e2-47ff-8360-f3640fe46b96(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 15:20:17 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3573dc4-d67d-4cf8-b99a-1f4628bfcb52]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:20:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6cc7edec-bbed-4bd3-af1a-7df943b5b368 tempest-GroupSnapshotsV319Test-2086602119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-7d86b7e6-76e2-47ff-8360-f3640fe46b96 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:20:17 devstack sudo[90540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-7d86b7e6-76e2-47ff-8360-f3640fe46b96 Nov 06 15:20:17 devstack sudo[90540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:20:17 devstack sudo[90540]: pam_unix(sudo:session): session closed for user root Nov 06 15:20:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6cc7edec-bbed-4bd3-af1a-7df943b5b368 tempest-GroupSnapshotsV319Test-2086602119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-7d86b7e6-76e2-47ff-8360-f3640fe46b96" returned: 0 in 0.429s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:20:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6cc7edec-bbed-4bd3-af1a-7df943b5b368 tempest-GroupSnapshotsV319Test-2086602119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-7d86b7e6-76e2-47ff-8360-f3640fe46b96.1e6954d5-3ac8-438d-b964-a861c97b2510 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:20:17 devstack sudo[90548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-7d86b7e6-76e2-47ff-8360-f3640fe46b96.1e6954d5-3ac8-438d-b964-a861c97b2510 Nov 06 15:20:17 devstack sudo[90548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:20:18 devstack sudo[90548]: pam_unix(sudo:session): session closed for user root Nov 06 15:20:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6cc7edec-bbed-4bd3-af1a-7df943b5b368 tempest-GroupSnapshotsV319Test-2086602119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-7d86b7e6-76e2-47ff-8360-f3640fe46b96.1e6954d5-3ac8-438d-b964-a861c97b2510" returned: 0 in 0.517s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:20:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6cc7edec-bbed-4bd3-af1a-7df943b5b368 tempest-GroupSnapshotsV319Test-2086602119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-7d86b7e6-76e2-47ff-8360-f3640fe46b96.1e6954d5-3ac8-438d-b964-a861c97b2510 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:20:18 devstack sudo[90554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-7d86b7e6-76e2-47ff-8360-f3640fe46b96.1e6954d5-3ac8-438d-b964-a861c97b2510 Nov 06 15:20:18 devstack sudo[90554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:20:18 devstack sudo[90554]: pam_unix(sudo:session): session closed for user root Nov 06 15:20:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6cc7edec-bbed-4bd3-af1a-7df943b5b368 tempest-GroupSnapshotsV319Test-2086602119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-7d86b7e6-76e2-47ff-8360-f3640fe46b96.1e6954d5-3ac8-438d-b964-a861c97b2510" returned: 0 in 0.280s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:20:18 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6cc7edec-bbed-4bd3-af1a-7df943b5b368 tempest-GroupSnapshotsV319Test-2086602119 None] Lock "cinder-quobyte-1e6954d5-3ac8-438d-b964-a861c97b2510" released by "_delete_snapshot" :: held 1.803s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:20:18 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6cc7edec-bbed-4bd3-af1a-7df943b5b368 tempest-GroupSnapshotsV319Test-2086602119 None] Lock "cinder-quobyte-7d86b7e6-76e2-47ff-8360-f3640fe46b96" released by "delete_snapshot" :: held 1.837s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:20:18 devstack cinder-volume[87132]: WARNING cinder.quota [None req-6cc7edec-bbed-4bd3-af1a-7df943b5b368 tempest-GroupSnapshotsV319Test-2086602119 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1711394325 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1711394325, it is now deprecated. Please use the default quota class for default quota. Nov 06 15:20:18 devstack cinder-volume[87132]: WARNING cinder.quota [None req-6cc7edec-bbed-4bd3-af1a-7df943b5b368 tempest-GroupSnapshotsV319Test-2086602119 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1711394325 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1711394325, it is now deprecated. Please use the default quota class for default quota. Nov 06 15:20:18 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-6cc7edec-bbed-4bd3-af1a-7df943b5b368 tempest-GroupSnapshotsV319Test-2086602119 None] Created reservations ['d3e1a5f8-51cb-43b3-8892-e0cb29d48665', '3367dbe9-c2c2-4d9e-adbf-cf1f61efdd40', 'c46d5162-b53a-427e-b203-b4b428785d40', 'a8e544fb-af18-4562-bb35-2ce1ce079bf1'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:20:18 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-6cc7edec-bbed-4bd3-af1a-7df943b5b368 tempest-GroupSnapshotsV319Test-2086602119 None] group_snapshot c65f7ec8-b981-4a64-b7c6-0a8e71dc0eb2: deleted successfully Nov 06 15:20:19 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-f97d0034-f66b-4335-b579-14354612d44a tempest-GroupSnapshotsV319Test-2086602119 None] Acquiring lock "cinder-quobyte-7d86b7e6-76e2-47ff-8360-f3640fe46b96" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:20:19 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-f97d0034-f66b-4335-b579-14354612d44a tempest-GroupSnapshotsV319Test-2086602119 None] Lock "cinder-quobyte-7d86b7e6-76e2-47ff-8360-f3640fe46b96" acquired by "delete_volume" :: waited 0.031s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:20:19 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf475ece-900d-457b-9aaf-f73b7e728139]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:20:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f97d0034-f66b-4335-b579-14354612d44a tempest-GroupSnapshotsV319Test-2086602119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-7d86b7e6-76e2-47ff-8360-f3640fe46b96 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:20:19 devstack sudo[90564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-7d86b7e6-76e2-47ff-8360-f3640fe46b96 Nov 06 15:20:19 devstack sudo[90564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:20:20 devstack sudo[90564]: pam_unix(sudo:session): session closed for user root Nov 06 15:20:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f97d0034-f66b-4335-b579-14354612d44a tempest-GroupSnapshotsV319Test-2086602119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-7d86b7e6-76e2-47ff-8360-f3640fe46b96" returned: 0 in 0.568s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:20:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f97d0034-f66b-4335-b579-14354612d44a tempest-GroupSnapshotsV319Test-2086602119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-7d86b7e6-76e2-47ff-8360-f3640fe46b96 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:20:20 devstack sudo[90579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-7d86b7e6-76e2-47ff-8360-f3640fe46b96 Nov 06 15:20:20 devstack sudo[90579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:20:20 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-9f0ba33e-c0ef-4c10-b8ad-ff5ec216505d tempest-TaggedAttachmentsTest-362746116 None] Acquiring lock "cinder-5b8bbe11-cb71-4060-9b5a-d2a1c5edda5f-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:20:20 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-9f0ba33e-c0ef-4c10-b8ad-ff5ec216505d tempest-TaggedAttachmentsTest-362746116 None] Lock "cinder-5b8bbe11-cb71-4060-9b5a-d2a1c5edda5f-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:20:20 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-9f0ba33e-c0ef-4c10-b8ad-ff5ec216505d tempest-TaggedAttachmentsTest-362746116 None] Acquiring lock "cinder-quobyte-5b8bbe11-cb71-4060-9b5a-d2a1c5edda5f" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:20:20 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-9f0ba33e-c0ef-4c10-b8ad-ff5ec216505d tempest-TaggedAttachmentsTest-362746116 None] Lock "cinder-quobyte-5b8bbe11-cb71-4060-9b5a-d2a1c5edda5f" acquired by "delete_volume" :: waited 0.036s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:20:20 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[8078d0d1-3e37-46a5-99c7-99505d34deca]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:20:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9f0ba33e-c0ef-4c10-b8ad-ff5ec216505d tempest-TaggedAttachmentsTest-362746116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-5b8bbe11-cb71-4060-9b5a-d2a1c5edda5f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:20:20 devstack sudo[90581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-5b8bbe11-cb71-4060-9b5a-d2a1c5edda5f Nov 06 15:20:20 devstack sudo[90581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:20:20 devstack sudo[90579]: pam_unix(sudo:session): session closed for user root Nov 06 15:20:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f97d0034-f66b-4335-b579-14354612d44a tempest-GroupSnapshotsV319Test-2086602119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-7d86b7e6-76e2-47ff-8360-f3640fe46b96" returned: 0 in 0.393s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:20:20 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-f97d0034-f66b-4335-b579-14354612d44a tempest-GroupSnapshotsV319Test-2086602119 None] Lock "cinder-quobyte-7d86b7e6-76e2-47ff-8360-f3640fe46b96" released by "delete_volume" :: held 1.103s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:20:20 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-f97d0034-f66b-4335-b579-14354612d44a tempest-GroupSnapshotsV319Test-2086602119 None] Created reservations ['4f5352d5-b493-4eff-ad0c-9871c37385e8'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:20:20 devstack cinder-volume[87132]: WARNING cinder.quota [None req-f97d0034-f66b-4335-b579-14354612d44a tempest-GroupSnapshotsV319Test-2086602119 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1711394325 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1711394325, it is now deprecated. Please use the default quota class for default quota. Nov 06 15:20:20 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-f97d0034-f66b-4335-b579-14354612d44a tempest-GroupSnapshotsV319Test-2086602119 None] Created reservations ['8ca91d43-305a-40bb-b0b5-05b71ce968bd', 'fb5290b7-e1bf-48dd-9ed2-cdcf68b0faa9', '87d8a1d1-a4c9-4a74-8256-5657ba9006da', 'd342731d-9f29-4263-8efa-78eaf7c67196'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:20:20 devstack sudo[90581]: pam_unix(sudo:session): session closed for user root Nov 06 15:20:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9f0ba33e-c0ef-4c10-b8ad-ff5ec216505d tempest-TaggedAttachmentsTest-362746116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-5b8bbe11-cb71-4060-9b5a-d2a1c5edda5f" returned: 0 in 0.486s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:20:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9f0ba33e-c0ef-4c10-b8ad-ff5ec216505d tempest-TaggedAttachmentsTest-362746116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-5b8bbe11-cb71-4060-9b5a-d2a1c5edda5f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:20:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f97d0034-f66b-4335-b579-14354612d44a tempest-GroupSnapshotsV319Test-2086602119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:20:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f97d0034-f66b-4335-b579-14354612d44a tempest-GroupSnapshotsV319Test-2086602119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:20:20 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-f97d0034-f66b-4335-b579-14354612d44a tempest-GroupSnapshotsV319Test-2086602119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:20:20 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-f97d0034-f66b-4335-b579-14354612d44a tempest-GroupSnapshotsV319Test-2086602119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:20:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f97d0034-f66b-4335-b579-14354612d44a tempest-GroupSnapshotsV319Test-2086602119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:20:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f97d0034-f66b-4335-b579-14354612d44a tempest-GroupSnapshotsV319Test-2086602119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:20:20 devstack sudo[90587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-5b8bbe11-cb71-4060-9b5a-d2a1c5edda5f Nov 06 15:20:20 devstack sudo[90587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:20:20 devstack sudo[90589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:20:20 devstack sudo[90589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:20:21 devstack sudo[90587]: pam_unix(sudo:session): session closed for user root Nov 06 15:20:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9f0ba33e-c0ef-4c10-b8ad-ff5ec216505d tempest-TaggedAttachmentsTest-362746116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-5b8bbe11-cb71-4060-9b5a-d2a1c5edda5f" returned: 0 in 0.511s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:20:21 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-9f0ba33e-c0ef-4c10-b8ad-ff5ec216505d tempest-TaggedAttachmentsTest-362746116 None] Lock "cinder-quobyte-5b8bbe11-cb71-4060-9b5a-d2a1c5edda5f" released by "delete_volume" :: held 1.068s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:20:21 devstack sudo[90589]: pam_unix(sudo:session): session closed for user root Nov 06 15:20:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f97d0034-f66b-4335-b579-14354612d44a tempest-GroupSnapshotsV319Test-2086602119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.510s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:20:21 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-f97d0034-f66b-4335-b579-14354612d44a tempest-GroupSnapshotsV319Test-2086602119 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:20:21 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-f97d0034-f66b-4335-b579-14354612d44a tempest-GroupSnapshotsV319Test-2086602119 None] Delete group completed successfully. Nov 06 15:20:21 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-9f0ba33e-c0ef-4c10-b8ad-ff5ec216505d tempest-TaggedAttachmentsTest-362746116 None] Created reservations ['8f182af5-736e-4b4a-9376-d02d57c8fc99', 'ecf8bacd-45d5-4a89-a469-0d1824f97fd6', '4c1f27a2-6f57-4527-a718-3d87384dd8f0', '06e04616-9cdc-4642-8f84-1d340cf66149'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:20:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9f0ba33e-c0ef-4c10-b8ad-ff5ec216505d tempest-TaggedAttachmentsTest-362746116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:20:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9f0ba33e-c0ef-4c10-b8ad-ff5ec216505d tempest-TaggedAttachmentsTest-362746116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:20:21 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-9f0ba33e-c0ef-4c10-b8ad-ff5ec216505d tempest-TaggedAttachmentsTest-362746116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:20:21 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-9f0ba33e-c0ef-4c10-b8ad-ff5ec216505d tempest-TaggedAttachmentsTest-362746116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:20:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9f0ba33e-c0ef-4c10-b8ad-ff5ec216505d tempest-TaggedAttachmentsTest-362746116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:20:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9f0ba33e-c0ef-4c10-b8ad-ff5ec216505d tempest-TaggedAttachmentsTest-362746116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:20:21 devstack sudo[90593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:20:21 devstack sudo[90593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:20:21 devstack sudo[90593]: pam_unix(sudo:session): session closed for user root Nov 06 15:20:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9f0ba33e-c0ef-4c10-b8ad-ff5ec216505d tempest-TaggedAttachmentsTest-362746116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.273s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:20:21 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-9f0ba33e-c0ef-4c10-b8ad-ff5ec216505d tempest-TaggedAttachmentsTest-362746116 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:20:21 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-9f0ba33e-c0ef-4c10-b8ad-ff5ec216505d tempest-TaggedAttachmentsTest-362746116 None] Deleted volume successfully. Nov 06 15:20:21 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-9f0ba33e-c0ef-4c10-b8ad-ff5ec216505d tempest-TaggedAttachmentsTest-362746116 None] Lock "cinder-5b8bbe11-cb71-4060-9b5a-d2a1c5edda5f-delete_volume" released by "delete_volume" :: held 1.640s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:20:30 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-77db6bc0-d5ec-4347-8b98-14a471beeac4 tempest-SnapshotsActionsTest-597994470 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:20:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-77db6bc0-d5ec-4347-8b98-14a471beeac4 tempest-SnapshotsActionsTest-597994470 None] Flow 'volume_create_manager' (f432961a-402a-45a2-b891-737df63e6bab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:20:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-77db6bc0-d5ec-4347-8b98-14a471beeac4 tempest-SnapshotsActionsTest-597994470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f73ff890-5bf3-495f-95c6-957e11b97725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:20:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-77db6bc0-d5ec-4347-8b98-14a471beeac4 tempest-SnapshotsActionsTest-597994470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f73ff890-5bf3-495f-95c6-957e11b97725) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:20:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-339255229',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99639d52-10ab-4623-b3fa-6d85a98a6854,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d26a0f035254a15a3293140c58dd091',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:20:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:20:30Z,use_quota=True,user_id='37b1333875ba4a58b556f0154dccb581',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:20:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-77db6bc0-d5ec-4347-8b98-14a471beeac4 tempest-SnapshotsActionsTest-597994470 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2a9a448-7479-4022-9289-004c2473a8aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:20:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-77db6bc0-d5ec-4347-8b98-14a471beeac4 tempest-SnapshotsActionsTest-597994470 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2a9a448-7479-4022-9289-004c2473a8aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:20:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-77db6bc0-d5ec-4347-8b98-14a471beeac4 tempest-SnapshotsActionsTest-597994470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b70d29a3-eac7-406a-ac92-c012a27d3631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:20:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-77db6bc0-d5ec-4347-8b98-14a471beeac4 tempest-SnapshotsActionsTest-597994470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b70d29a3-eac7-406a-ac92-c012a27d3631) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99639d52-10ab-4623-b3fa-6d85a98a6854', 'volume_name': 'volume-99639d52-10ab-4623-b3fa-6d85a98a6854', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:20:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-77db6bc0-d5ec-4347-8b98-14a471beeac4 tempest-SnapshotsActionsTest-597994470 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15fe0bef-f87d-448c-8b4d-b76bc8dfd5ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:20:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-77db6bc0-d5ec-4347-8b98-14a471beeac4 tempest-SnapshotsActionsTest-597994470 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15fe0bef-f87d-448c-8b4d-b76bc8dfd5ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:20:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-77db6bc0-d5ec-4347-8b98-14a471beeac4 tempest-SnapshotsActionsTest-597994470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (152ec952-f88a-4841-8c61-0185b39092f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:20:30 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-77db6bc0-d5ec-4347-8b98-14a471beeac4 tempest-SnapshotsActionsTest-597994470 None] Volume 99639d52-10ab-4623-b3fa-6d85a98a6854: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99639d52-10ab-4623-b3fa-6d85a98a6854', 'volume_size': 1} Nov 06 15:20:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-77db6bc0-d5ec-4347-8b98-14a471beeac4 tempest-SnapshotsActionsTest-597994470 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:20:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-77db6bc0-d5ec-4347-8b98-14a471beeac4 tempest-SnapshotsActionsTest-597994470 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:20:30 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-77db6bc0-d5ec-4347-8b98-14a471beeac4 tempest-SnapshotsActionsTest-597994470 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:20:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-339255229',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99639d52-10ab-4623-b3fa-6d85a98a6854,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d26a0f035254a15a3293140c58dd091',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:20:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:20:30Z,use_quota=True,user_id='37b1333875ba4a58b556f0154dccb581',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:20:30 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-77db6bc0-d5ec-4347-8b98-14a471beeac4 tempest-SnapshotsActionsTest-597994470 None] Creating volume 99639d52-10ab-4623-b3fa-6d85a98a6854 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:20:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-77db6bc0-d5ec-4347-8b98-14a471beeac4 tempest-SnapshotsActionsTest-597994470 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:20:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-77db6bc0-d5ec-4347-8b98-14a471beeac4 tempest-SnapshotsActionsTest-597994470 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:20:30 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-77db6bc0-d5ec-4347-8b98-14a471beeac4 tempest-SnapshotsActionsTest-597994470 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:20:30 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-77db6bc0-d5ec-4347-8b98-14a471beeac4 tempest-SnapshotsActionsTest-597994470 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:20:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-77db6bc0-d5ec-4347-8b98-14a471beeac4 tempest-SnapshotsActionsTest-597994470 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:20:30 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-77db6bc0-d5ec-4347-8b98-14a471beeac4 tempest-SnapshotsActionsTest-597994470 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:20:30 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-77db6bc0-d5ec-4347-8b98-14a471beeac4 tempest-SnapshotsActionsTest-597994470 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:20:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-77db6bc0-d5ec-4347-8b98-14a471beeac4 tempest-SnapshotsActionsTest-597994470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:20:30 devstack sudo[90620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854 1073741824 Nov 06 15:20:30 devstack sudo[90620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:20:30 devstack sudo[90620]: pam_unix(sudo:session): session closed for user root Nov 06 15:20:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-77db6bc0-d5ec-4347-8b98-14a471beeac4 tempest-SnapshotsActionsTest-597994470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854 1073741824" returned: 0 in 0.631s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:20:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-77db6bc0-d5ec-4347-8b98-14a471beeac4 tempest-SnapshotsActionsTest-597994470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:20:30 devstack sudo[90627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854 Nov 06 15:20:30 devstack sudo[90627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:20:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-0e13acca-e815-4a57-9cc8-95c1e5deecc1 req-9ff249ac-5752-423b-b100-993fbf30bd1f tempest-AttachVolumeShelveTestJSON-437798152 None] No connector for attachment 4965bee5-65b2-4010-8e31-a7b1b6721ef9; skipping storage backend terminate_connection call. {{(pid=87132) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Nov 06 15:20:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-0e13acca-e815-4a57-9cc8-95c1e5deecc1 req-9ff249ac-5752-423b-b100-993fbf30bd1f tempest-AttachVolumeShelveTestJSON-437798152 None] Deleting attachment 4965bee5-65b2-4010-8e31-a7b1b6721ef9. {{(pid=87132) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 06 15:20:31 devstack sudo[90627]: pam_unix(sudo:session): session closed for user root Nov 06 15:20:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-77db6bc0-d5ec-4347-8b98-14a471beeac4 tempest-SnapshotsActionsTest-597994470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854" returned: 0 in 0.367s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:20:31 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-77db6bc0-d5ec-4347-8b98-14a471beeac4 tempest-SnapshotsActionsTest-597994470 None] <== create_volume: return (1073ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:20:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-77db6bc0-d5ec-4347-8b98-14a471beeac4 tempest-SnapshotsActionsTest-597994470 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.077s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:20:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-77db6bc0-d5ec-4347-8b98-14a471beeac4 tempest-SnapshotsActionsTest-597994470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (152ec952-f88a-4841-8c61-0185b39092f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99639d52-10ab-4623-b3fa-6d85a98a6854', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:20:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-77db6bc0-d5ec-4347-8b98-14a471beeac4 tempest-SnapshotsActionsTest-597994470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (957a8c86-2b3b-4506-8bf9-874267b2c6d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:20:31 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-77db6bc0-d5ec-4347-8b98-14a471beeac4 tempest-SnapshotsActionsTest-597994470 None] Volume volume-99639d52-10ab-4623-b3fa-6d85a98a6854 (99639d52-10ab-4623-b3fa-6d85a98a6854): created successfully Nov 06 15:20:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-77db6bc0-d5ec-4347-8b98-14a471beeac4 tempest-SnapshotsActionsTest-597994470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (957a8c86-2b3b-4506-8bf9-874267b2c6d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:20:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-77db6bc0-d5ec-4347-8b98-14a471beeac4 tempest-SnapshotsActionsTest-597994470 None] Flow 'volume_create_manager' (f432961a-402a-45a2-b891-737df63e6bab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:20:31 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-77db6bc0-d5ec-4347-8b98-14a471beeac4 tempest-SnapshotsActionsTest-597994470 None] Created volume successfully. Nov 06 15:20:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-99f244c0-823e-4e7b-8c1a-cd5ff31ec3d2 tempest-SnapshotsActionsTest-597994470 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:20:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-99f244c0-823e-4e7b-8c1a-cd5ff31ec3d2 tempest-SnapshotsActionsTest-597994470 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:20:32 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-99f244c0-823e-4e7b-8c1a-cd5ff31ec3d2 tempest-SnapshotsActionsTest-597994470 None] Creating offline snapshot 74bfe026-fb95-4301-9aa0-75d765313be4 of volume 99639d52-10ab-4623-b3fa-6d85a98a6854 {{(pid=87132) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 15:20:32 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6722116-d892-4009-bc4a-1da3c67d2eda]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:20:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-99f244c0-823e-4e7b-8c1a-cd5ff31ec3d2 tempest-SnapshotsActionsTest-597994470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:20:32 devstack sudo[90633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854 Nov 06 15:20:32 devstack sudo[90633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:20:32 devstack sudo[90633]: pam_unix(sudo:session): session closed for user root Nov 06 15:20:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-99f244c0-823e-4e7b-8c1a-cd5ff31ec3d2 tempest-SnapshotsActionsTest-597994470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854" returned: 0 in 0.396s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:20:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-99f244c0-823e-4e7b-8c1a-cd5ff31ec3d2 tempest-SnapshotsActionsTest-597994470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854.74bfe026-fb95-4301-9aa0-75d765313be4 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:20:32 devstack sudo[90639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854.74bfe026-fb95-4301-9aa0-75d765313be4 1G Nov 06 15:20:32 devstack sudo[90639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:20:33 devstack sudo[90639]: pam_unix(sudo:session): session closed for user root Nov 06 15:20:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-99f244c0-823e-4e7b-8c1a-cd5ff31ec3d2 tempest-SnapshotsActionsTest-597994470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854.74bfe026-fb95-4301-9aa0-75d765313be4 1G" returned: 0 in 0.645s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:20:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-99f244c0-823e-4e7b-8c1a-cd5ff31ec3d2 tempest-SnapshotsActionsTest-597994470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99639d52-10ab-4623-b3fa-6d85a98a6854 -F qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854.74bfe026-fb95-4301-9aa0-75d765313be4 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:20:33 devstack sudo[90646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99639d52-10ab-4623-b3fa-6d85a98a6854 -F qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854.74bfe026-fb95-4301-9aa0-75d765313be4 Nov 06 15:20:33 devstack sudo[90646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:20:34 devstack sudo[90646]: pam_unix(sudo:session): session closed for user root Nov 06 15:20:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-99f244c0-823e-4e7b-8c1a-cd5ff31ec3d2 tempest-SnapshotsActionsTest-597994470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99639d52-10ab-4623-b3fa-6d85a98a6854 -F qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854.74bfe026-fb95-4301-9aa0-75d765313be4" returned: 0 in 0.451s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:20:34 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-99f244c0-823e-4e7b-8c1a-cd5ff31ec3d2 tempest-SnapshotsActionsTest-597994470 None] /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854.74bfe026-fb95-4301-9aa0-75d765313be4 is being set with open permissions: ugo+rw Nov 06 15:20:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-99f244c0-823e-4e7b-8c1a-cd5ff31ec3d2 tempest-SnapshotsActionsTest-597994470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854.74bfe026-fb95-4301-9aa0-75d765313be4 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:20:34 devstack sudo[90652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854.74bfe026-fb95-4301-9aa0-75d765313be4 Nov 06 15:20:34 devstack sudo[90652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:20:34 devstack sudo[90652]: pam_unix(sudo:session): session closed for user root Nov 06 15:20:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-99f244c0-823e-4e7b-8c1a-cd5ff31ec3d2 tempest-SnapshotsActionsTest-597994470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854.74bfe026-fb95-4301-9aa0-75d765313be4" returned: 0 in 0.303s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:20:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-99f244c0-823e-4e7b-8c1a-cd5ff31ec3d2 tempest-SnapshotsActionsTest-597994470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:20:34 devstack sudo[90656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854.info Nov 06 15:20:34 devstack sudo[90656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:20:34 devstack sudo[90656]: pam_unix(sudo:session): session closed for user root Nov 06 15:20:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-99f244c0-823e-4e7b-8c1a-cd5ff31ec3d2 tempest-SnapshotsActionsTest-597994470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854.info" returned: 0 in 0.427s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:20:34 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-99f244c0-823e-4e7b-8c1a-cd5ff31ec3d2 tempest-SnapshotsActionsTest-597994470 None] /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854.info is being set with open permissions: ugo+rw Nov 06 15:20:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-99f244c0-823e-4e7b-8c1a-cd5ff31ec3d2 tempest-SnapshotsActionsTest-597994470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:20:34 devstack sudo[90660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854.info Nov 06 15:20:34 devstack sudo[90660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:20:35 devstack sudo[90660]: pam_unix(sudo:session): session closed for user root Nov 06 15:20:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-99f244c0-823e-4e7b-8c1a-cd5ff31ec3d2 tempest-SnapshotsActionsTest-597994470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854.info" returned: 0 in 0.328s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:20:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-99f244c0-823e-4e7b-8c1a-cd5ff31ec3d2 tempest-SnapshotsActionsTest-597994470 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.674s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:20:35 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:UPDATE=125,cinder:SELECT=109,cinder:INSERT=19,cinder:DELETE=7 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 15:20:35 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-99f244c0-823e-4e7b-8c1a-cd5ff31ec3d2 tempest-SnapshotsActionsTest-597994470 None] Create snapshot completed successfully Nov 06 15:20:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-fd553a20-3d76-4054-8e81-5b88c351fc56 tempest-SnapshotsActionsTest-597994470 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:20:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-fd553a20-3d76-4054-8e81-5b88c351fc56 tempest-SnapshotsActionsTest-597994470 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:20:36 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-fd553a20-3d76-4054-8e81-5b88c351fc56 tempest-SnapshotsActionsTest-597994470 None] Creating offline snapshot 69ae70dc-204d-4eef-bf58-b7f8f2c92b51 of volume 99639d52-10ab-4623-b3fa-6d85a98a6854 {{(pid=87132) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 15:20:36 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4c1c86d-4245-4d0c-be24-f3da9b695098]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:20:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-fd553a20-3d76-4054-8e81-5b88c351fc56 tempest-SnapshotsActionsTest-597994470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854.74bfe026-fb95-4301-9aa0-75d765313be4 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:20:36 devstack sudo[90665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854.74bfe026-fb95-4301-9aa0-75d765313be4 Nov 06 15:20:36 devstack sudo[90665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:20:37 devstack sudo[90665]: pam_unix(sudo:session): session closed for user root Nov 06 15:20:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-fd553a20-3d76-4054-8e81-5b88c351fc56 tempest-SnapshotsActionsTest-597994470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854.74bfe026-fb95-4301-9aa0-75d765313be4" returned: 0 in 0.603s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:20:37 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-fd553a20-3d76-4054-8e81-5b88c351fc56 tempest-SnapshotsActionsTest-597994470 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-99639d52-10ab-4623-b3fa-6d85a98a6854(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 15:20:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-fd553a20-3d76-4054-8e81-5b88c351fc56 tempest-SnapshotsActionsTest-597994470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854.74bfe026-fb95-4301-9aa0-75d765313be4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854.69ae70dc-204d-4eef-bf58-b7f8f2c92b51 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:20:37 devstack sudo[90670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854.74bfe026-fb95-4301-9aa0-75d765313be4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854.69ae70dc-204d-4eef-bf58-b7f8f2c92b51 1G Nov 06 15:20:37 devstack sudo[90670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:20:38 devstack sudo[90670]: pam_unix(sudo:session): session closed for user root Nov 06 15:20:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-fd553a20-3d76-4054-8e81-5b88c351fc56 tempest-SnapshotsActionsTest-597994470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854.74bfe026-fb95-4301-9aa0-75d765313be4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854.69ae70dc-204d-4eef-bf58-b7f8f2c92b51 1G" returned: 0 in 0.719s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:20:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-fd553a20-3d76-4054-8e81-5b88c351fc56 tempest-SnapshotsActionsTest-597994470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99639d52-10ab-4623-b3fa-6d85a98a6854.74bfe026-fb95-4301-9aa0-75d765313be4 -F qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854.69ae70dc-204d-4eef-bf58-b7f8f2c92b51 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:20:38 devstack sudo[90676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99639d52-10ab-4623-b3fa-6d85a98a6854.74bfe026-fb95-4301-9aa0-75d765313be4 -F qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854.69ae70dc-204d-4eef-bf58-b7f8f2c92b51 Nov 06 15:20:38 devstack sudo[90676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:20:38 devstack sudo[90676]: pam_unix(sudo:session): session closed for user root Nov 06 15:20:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-fd553a20-3d76-4054-8e81-5b88c351fc56 tempest-SnapshotsActionsTest-597994470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99639d52-10ab-4623-b3fa-6d85a98a6854.74bfe026-fb95-4301-9aa0-75d765313be4 -F qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854.69ae70dc-204d-4eef-bf58-b7f8f2c92b51" returned: 0 in 0.378s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:20:38 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-fd553a20-3d76-4054-8e81-5b88c351fc56 tempest-SnapshotsActionsTest-597994470 None] /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854.69ae70dc-204d-4eef-bf58-b7f8f2c92b51 is being set with open permissions: ugo+rw Nov 06 15:20:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-fd553a20-3d76-4054-8e81-5b88c351fc56 tempest-SnapshotsActionsTest-597994470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854.69ae70dc-204d-4eef-bf58-b7f8f2c92b51 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:20:38 devstack sudo[90682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854.69ae70dc-204d-4eef-bf58-b7f8f2c92b51 Nov 06 15:20:38 devstack sudo[90682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:20:38 devstack sudo[90682]: pam_unix(sudo:session): session closed for user root Nov 06 15:20:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-fd553a20-3d76-4054-8e81-5b88c351fc56 tempest-SnapshotsActionsTest-597994470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854.69ae70dc-204d-4eef-bf58-b7f8f2c92b51" returned: 0 in 0.335s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:20:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-fd553a20-3d76-4054-8e81-5b88c351fc56 tempest-SnapshotsActionsTest-597994470 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.221s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:20:38 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-fd553a20-3d76-4054-8e81-5b88c351fc56 tempest-SnapshotsActionsTest-597994470 None] Create snapshot completed successfully Nov 06 15:20:40 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-90a0db91-5b03-4131-b356-e30276148eef tempest-SnapshotsActionsTest-937430708 None] Acquiring lock "cinder-69ae70dc-204d-4eef-bf58-b7f8f2c92b51-delete_snapshot" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:20:40 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-90a0db91-5b03-4131-b356-e30276148eef tempest-SnapshotsActionsTest-937430708 None] Lock "cinder-69ae70dc-204d-4eef-bf58-b7f8f2c92b51-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:20:40 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-90a0db91-5b03-4131-b356-e30276148eef tempest-SnapshotsActionsTest-937430708 None] Acquiring lock "cinder-quobyte-99639d52-10ab-4623-b3fa-6d85a98a6854" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:20:40 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-90a0db91-5b03-4131-b356-e30276148eef tempest-SnapshotsActionsTest-937430708 None] Lock "cinder-quobyte-99639d52-10ab-4623-b3fa-6d85a98a6854" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:20:40 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-90a0db91-5b03-4131-b356-e30276148eef tempest-SnapshotsActionsTest-937430708 None] Acquiring lock "cinder-quobyte-69ae70dc-204d-4eef-bf58-b7f8f2c92b51" by "_delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:20:40 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-90a0db91-5b03-4131-b356-e30276148eef tempest-SnapshotsActionsTest-937430708 None] Lock "cinder-quobyte-69ae70dc-204d-4eef-bf58-b7f8f2c92b51" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:20:40 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-90a0db91-5b03-4131-b356-e30276148eef tempest-SnapshotsActionsTest-937430708 None] Deleting offline snapshot 69ae70dc-204d-4eef-bf58-b7f8f2c92b51 of volume 99639d52-10ab-4623-b3fa-6d85a98a6854 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 15:20:40 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-90a0db91-5b03-4131-b356-e30276148eef tempest-SnapshotsActionsTest-937430708 None] snapshot_file for this snap is: volume-99639d52-10ab-4623-b3fa-6d85a98a6854.69ae70dc-204d-4eef-bf58-b7f8f2c92b51 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 15:20:40 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[29d5ba6d-cf3c-4689-9de2-b2c989c4fc0c]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:20:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-90a0db91-5b03-4131-b356-e30276148eef tempest-SnapshotsActionsTest-937430708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854.69ae70dc-204d-4eef-bf58-b7f8f2c92b51 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:20:40 devstack sudo[90718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854.69ae70dc-204d-4eef-bf58-b7f8f2c92b51 Nov 06 15:20:40 devstack sudo[90718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:20:40 devstack sudo[90718]: pam_unix(sudo:session): session closed for user root Nov 06 15:20:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-90a0db91-5b03-4131-b356-e30276148eef tempest-SnapshotsActionsTest-937430708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854.69ae70dc-204d-4eef-bf58-b7f8f2c92b51" returned: 0 in 0.559s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:20:40 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-90a0db91-5b03-4131-b356-e30276148eef tempest-SnapshotsActionsTest-937430708 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-99639d52-10ab-4623-b3fa-6d85a98a6854(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 15:20:40 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1ab41ef-2fde-4d43-ad39-cc6d24bf92e3]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:20:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-90a0db91-5b03-4131-b356-e30276148eef tempest-SnapshotsActionsTest-937430708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854.74bfe026-fb95-4301-9aa0-75d765313be4 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:20:41 devstack sudo[90724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854.74bfe026-fb95-4301-9aa0-75d765313be4 Nov 06 15:20:41 devstack sudo[90724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:20:41 devstack sudo[90724]: pam_unix(sudo:session): session closed for user root Nov 06 15:20:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-90a0db91-5b03-4131-b356-e30276148eef tempest-SnapshotsActionsTest-937430708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854.74bfe026-fb95-4301-9aa0-75d765313be4" returned: 0 in 0.627s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:20:41 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-90a0db91-5b03-4131-b356-e30276148eef tempest-SnapshotsActionsTest-937430708 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-99639d52-10ab-4623-b3fa-6d85a98a6854(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 15:20:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-90a0db91-5b03-4131-b356-e30276148eef tempest-SnapshotsActionsTest-937430708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854.69ae70dc-204d-4eef-bf58-b7f8f2c92b51 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:20:41 devstack sudo[90729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854.69ae70dc-204d-4eef-bf58-b7f8f2c92b51 Nov 06 15:20:41 devstack sudo[90729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:20:42 devstack sudo[90729]: pam_unix(sudo:session): session closed for user root Nov 06 15:20:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-90a0db91-5b03-4131-b356-e30276148eef tempest-SnapshotsActionsTest-937430708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854.69ae70dc-204d-4eef-bf58-b7f8f2c92b51" returned: 0 in 0.558s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:20:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-90a0db91-5b03-4131-b356-e30276148eef tempest-SnapshotsActionsTest-937430708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854.69ae70dc-204d-4eef-bf58-b7f8f2c92b51 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:20:42 devstack sudo[90735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854.69ae70dc-204d-4eef-bf58-b7f8f2c92b51 Nov 06 15:20:42 devstack sudo[90735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:20:42 devstack sudo[90735]: pam_unix(sudo:session): session closed for user root Nov 06 15:20:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-90a0db91-5b03-4131-b356-e30276148eef tempest-SnapshotsActionsTest-937430708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854.69ae70dc-204d-4eef-bf58-b7f8f2c92b51" returned: 0 in 0.644s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:20:42 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-90a0db91-5b03-4131-b356-e30276148eef tempest-SnapshotsActionsTest-937430708 None] Lock "cinder-quobyte-69ae70dc-204d-4eef-bf58-b7f8f2c92b51" released by "_delete_snapshot" :: held 2.585s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:20:42 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-90a0db91-5b03-4131-b356-e30276148eef tempest-SnapshotsActionsTest-937430708 None] Lock "cinder-quobyte-99639d52-10ab-4623-b3fa-6d85a98a6854" released by "delete_snapshot" :: held 2.635s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:20:42 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-90a0db91-5b03-4131-b356-e30276148eef tempest-SnapshotsActionsTest-937430708 None] Created reservations ['aaabae1b-0a61-40f4-be00-fd9cdae67ac6', 'b4c850cb-02e6-44a7-b4d8-b8afe305d6b7', 'd96b717a-b03b-4923-b492-a125c06674c7', '19e729ee-7345-4cb7-8345-5619bb057ee8'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:20:42 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-90a0db91-5b03-4131-b356-e30276148eef tempest-SnapshotsActionsTest-937430708 None] Delete snapshot completed successfully. Nov 06 15:20:43 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-90a0db91-5b03-4131-b356-e30276148eef tempest-SnapshotsActionsTest-937430708 None] Lock "cinder-69ae70dc-204d-4eef-bf58-b7f8f2c92b51-delete_snapshot" released by "delete_snapshot" :: held 2.867s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:20:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b8f2f9f7-599c-4eeb-8789-074ea8b3ec44 tempest-SnapshotsActionsTest-597994470 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:20:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b8f2f9f7-599c-4eeb-8789-074ea8b3ec44 tempest-SnapshotsActionsTest-597994470 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:20:44 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-b8f2f9f7-599c-4eeb-8789-074ea8b3ec44 tempest-SnapshotsActionsTest-597994470 None] Creating offline snapshot 230fa377-d882-4285-8b62-5aeb3a0e39e2 of volume 99639d52-10ab-4623-b3fa-6d85a98a6854 {{(pid=87132) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 15:20:44 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[ced9d0e6-f721-444c-934e-6bbb83db1968]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:20:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b8f2f9f7-599c-4eeb-8789-074ea8b3ec44 tempest-SnapshotsActionsTest-597994470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854.74bfe026-fb95-4301-9aa0-75d765313be4 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:20:44 devstack sudo[90808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854.74bfe026-fb95-4301-9aa0-75d765313be4 Nov 06 15:20:44 devstack sudo[90808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:20:45 devstack sudo[90808]: pam_unix(sudo:session): session closed for user root Nov 06 15:20:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b8f2f9f7-599c-4eeb-8789-074ea8b3ec44 tempest-SnapshotsActionsTest-597994470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854.74bfe026-fb95-4301-9aa0-75d765313be4" returned: 0 in 0.701s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:20:45 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-b8f2f9f7-599c-4eeb-8789-074ea8b3ec44 tempest-SnapshotsActionsTest-597994470 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-99639d52-10ab-4623-b3fa-6d85a98a6854(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 15:20:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b8f2f9f7-599c-4eeb-8789-074ea8b3ec44 tempest-SnapshotsActionsTest-597994470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854.74bfe026-fb95-4301-9aa0-75d765313be4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854.230fa377-d882-4285-8b62-5aeb3a0e39e2 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:20:45 devstack sudo[90814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854.74bfe026-fb95-4301-9aa0-75d765313be4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854.230fa377-d882-4285-8b62-5aeb3a0e39e2 1G Nov 06 15:20:45 devstack sudo[90814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:20:45 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c6b2aca-9191-4972-b12e-3399d830ecd7 tempest-SnapshotMetadataTestJSON-93339113 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:20:45 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2c6b2aca-9191-4972-b12e-3399d830ecd7 tempest-SnapshotMetadataTestJSON-93339113 None] Flow 'volume_create_manager' (cf65e308-855a-4f78-b91d-501b6ca79222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:20:45 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2c6b2aca-9191-4972-b12e-3399d830ecd7 tempest-SnapshotMetadataTestJSON-93339113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53d2737e-3a08-46eb-b508-cb18f74ea8dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:20:45 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2c6b2aca-9191-4972-b12e-3399d830ecd7 tempest-SnapshotMetadataTestJSON-93339113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53d2737e-3a08-46eb-b508-cb18f74ea8dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:20:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1306240642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6116ba8-ad55-486e-9539-da8535405ac0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89f99c676f484af0a477d42039b1e4de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:20:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:20:46Z,use_quota=True,user_id='593b453848294b5bac679ebcb679486a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:20:45 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2c6b2aca-9191-4972-b12e-3399d830ecd7 tempest-SnapshotMetadataTestJSON-93339113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5e97bed-3de7-46ee-90cc-97a5fe5f105a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:20:45 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2c6b2aca-9191-4972-b12e-3399d830ecd7 tempest-SnapshotMetadataTestJSON-93339113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5e97bed-3de7-46ee-90cc-97a5fe5f105a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:20:45 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2c6b2aca-9191-4972-b12e-3399d830ecd7 tempest-SnapshotMetadataTestJSON-93339113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fe05853-b3c8-4c01-bc9b-d970acb1a6b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:20:45 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2c6b2aca-9191-4972-b12e-3399d830ecd7 tempest-SnapshotMetadataTestJSON-93339113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fe05853-b3c8-4c01-bc9b-d970acb1a6b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6116ba8-ad55-486e-9539-da8535405ac0', 'volume_name': 'volume-e6116ba8-ad55-486e-9539-da8535405ac0', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:20:45 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2c6b2aca-9191-4972-b12e-3399d830ecd7 tempest-SnapshotMetadataTestJSON-93339113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd40dcff-50f8-461f-95f6-b3ddc4709ec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:20:45 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2c6b2aca-9191-4972-b12e-3399d830ecd7 tempest-SnapshotMetadataTestJSON-93339113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd40dcff-50f8-461f-95f6-b3ddc4709ec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:20:45 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2c6b2aca-9191-4972-b12e-3399d830ecd7 tempest-SnapshotMetadataTestJSON-93339113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (915aaf93-0841-443a-8500-8c398373f59a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:20:45 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-2c6b2aca-9191-4972-b12e-3399d830ecd7 tempest-SnapshotMetadataTestJSON-93339113 None] Volume e6116ba8-ad55-486e-9539-da8535405ac0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6116ba8-ad55-486e-9539-da8535405ac0', 'volume_size': 1} Nov 06 15:20:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-2c6b2aca-9191-4972-b12e-3399d830ecd7 tempest-SnapshotMetadataTestJSON-93339113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:20:45 devstack sudo[90814]: pam_unix(sudo:session): session closed for user root Nov 06 15:20:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b8f2f9f7-599c-4eeb-8789-074ea8b3ec44 tempest-SnapshotsActionsTest-597994470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854.74bfe026-fb95-4301-9aa0-75d765313be4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854.230fa377-d882-4285-8b62-5aeb3a0e39e2 1G" returned: 0 in 0.965s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:20:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b8f2f9f7-599c-4eeb-8789-074ea8b3ec44 tempest-SnapshotsActionsTest-597994470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99639d52-10ab-4623-b3fa-6d85a98a6854.74bfe026-fb95-4301-9aa0-75d765313be4 -F qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854.230fa377-d882-4285-8b62-5aeb3a0e39e2 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:20:46 devstack sudo[90858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99639d52-10ab-4623-b3fa-6d85a98a6854.74bfe026-fb95-4301-9aa0-75d765313be4 -F qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854.230fa377-d882-4285-8b62-5aeb3a0e39e2 Nov 06 15:20:46 devstack sudo[90858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:20:46 devstack sudo[90858]: pam_unix(sudo:session): session closed for user root Nov 06 15:20:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b8f2f9f7-599c-4eeb-8789-074ea8b3ec44 tempest-SnapshotsActionsTest-597994470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99639d52-10ab-4623-b3fa-6d85a98a6854.74bfe026-fb95-4301-9aa0-75d765313be4 -F qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854.230fa377-d882-4285-8b62-5aeb3a0e39e2" returned: 0 in 0.346s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:20:46 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-b8f2f9f7-599c-4eeb-8789-074ea8b3ec44 tempest-SnapshotsActionsTest-597994470 None] /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854.230fa377-d882-4285-8b62-5aeb3a0e39e2 is being set with open permissions: ugo+rw Nov 06 15:20:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b8f2f9f7-599c-4eeb-8789-074ea8b3ec44 tempest-SnapshotsActionsTest-597994470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854.230fa377-d882-4285-8b62-5aeb3a0e39e2 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:20:46 devstack sudo[90863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854.230fa377-d882-4285-8b62-5aeb3a0e39e2 Nov 06 15:20:46 devstack sudo[90863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:20:46 devstack sudo[90863]: pam_unix(sudo:session): session closed for user root Nov 06 15:20:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b8f2f9f7-599c-4eeb-8789-074ea8b3ec44 tempest-SnapshotsActionsTest-597994470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854.230fa377-d882-4285-8b62-5aeb3a0e39e2" returned: 0 in 0.400s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:20:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b8f2f9f7-599c-4eeb-8789-074ea8b3ec44 tempest-SnapshotsActionsTest-597994470 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.653s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:20:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-2c6b2aca-9191-4972-b12e-3399d830ecd7 tempest-SnapshotMetadataTestJSON-93339113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.949s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:20:46 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-2c6b2aca-9191-4972-b12e-3399d830ecd7 tempest-SnapshotMetadataTestJSON-93339113 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:20:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1306240642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6116ba8-ad55-486e-9539-da8535405ac0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89f99c676f484af0a477d42039b1e4de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:20:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:20:46Z,use_quota=True,user_id='593b453848294b5bac679ebcb679486a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:20:46 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-2c6b2aca-9191-4972-b12e-3399d830ecd7 tempest-SnapshotMetadataTestJSON-93339113 None] Creating volume e6116ba8-ad55-486e-9539-da8535405ac0 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:20:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-2c6b2aca-9191-4972-b12e-3399d830ecd7 tempest-SnapshotMetadataTestJSON-93339113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:20:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-2c6b2aca-9191-4972-b12e-3399d830ecd7 tempest-SnapshotMetadataTestJSON-93339113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:20:46 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-2c6b2aca-9191-4972-b12e-3399d830ecd7 tempest-SnapshotMetadataTestJSON-93339113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:20:46 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-2c6b2aca-9191-4972-b12e-3399d830ecd7 tempest-SnapshotMetadataTestJSON-93339113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:20:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-2c6b2aca-9191-4972-b12e-3399d830ecd7 tempest-SnapshotMetadataTestJSON-93339113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:20:46 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-2c6b2aca-9191-4972-b12e-3399d830ecd7 tempest-SnapshotMetadataTestJSON-93339113 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:20:46 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-2c6b2aca-9191-4972-b12e-3399d830ecd7 tempest-SnapshotMetadataTestJSON-93339113 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:20:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2c6b2aca-9191-4972-b12e-3399d830ecd7 tempest-SnapshotMetadataTestJSON-93339113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-e6116ba8-ad55-486e-9539-da8535405ac0 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:20:46 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-b8f2f9f7-599c-4eeb-8789-074ea8b3ec44 tempest-SnapshotsActionsTest-597994470 None] Create snapshot completed successfully Nov 06 15:20:46 devstack sudo[90866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-e6116ba8-ad55-486e-9539-da8535405ac0 1073741824 Nov 06 15:20:46 devstack sudo[90866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:20:47 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-2d0a385f-61a0-40e0-8e82-51f67280f0cb tempest-SnapshotsActionsTest-937430708 None] Acquiring lock "cinder-230fa377-d882-4285-8b62-5aeb3a0e39e2-delete_snapshot" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:20:47 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-2d0a385f-61a0-40e0-8e82-51f67280f0cb tempest-SnapshotsActionsTest-937430708 None] Lock "cinder-230fa377-d882-4285-8b62-5aeb3a0e39e2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:20:47 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-2d0a385f-61a0-40e0-8e82-51f67280f0cb tempest-SnapshotsActionsTest-937430708 None] Acquiring lock "cinder-quobyte-99639d52-10ab-4623-b3fa-6d85a98a6854" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:20:47 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-2d0a385f-61a0-40e0-8e82-51f67280f0cb tempest-SnapshotsActionsTest-937430708 None] Lock "cinder-quobyte-99639d52-10ab-4623-b3fa-6d85a98a6854" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:20:47 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-2d0a385f-61a0-40e0-8e82-51f67280f0cb tempest-SnapshotsActionsTest-937430708 None] Acquiring lock "cinder-quobyte-230fa377-d882-4285-8b62-5aeb3a0e39e2" by "_delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:20:47 devstack sudo[90866]: pam_unix(sudo:session): session closed for user root Nov 06 15:20:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2c6b2aca-9191-4972-b12e-3399d830ecd7 tempest-SnapshotMetadataTestJSON-93339113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-e6116ba8-ad55-486e-9539-da8535405ac0 1073741824" returned: 0 in 0.666s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:20:47 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-2d0a385f-61a0-40e0-8e82-51f67280f0cb tempest-SnapshotsActionsTest-937430708 None] Lock "cinder-quobyte-230fa377-d882-4285-8b62-5aeb3a0e39e2" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:20:47 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-2d0a385f-61a0-40e0-8e82-51f67280f0cb tempest-SnapshotsActionsTest-937430708 None] Deleting offline snapshot 230fa377-d882-4285-8b62-5aeb3a0e39e2 of volume 99639d52-10ab-4623-b3fa-6d85a98a6854 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 15:20:47 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-2d0a385f-61a0-40e0-8e82-51f67280f0cb tempest-SnapshotsActionsTest-937430708 None] snapshot_file for this snap is: volume-99639d52-10ab-4623-b3fa-6d85a98a6854.230fa377-d882-4285-8b62-5aeb3a0e39e2 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 15:20:47 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:SELECT=89,cinder:INSERT=27,cinder:UPDATE=96,cinder:DELETE=8 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 15:20:47 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cdfb021-7692-49af-8a3d-3bfde0529235]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:20:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2d0a385f-61a0-40e0-8e82-51f67280f0cb tempest-SnapshotsActionsTest-937430708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854.230fa377-d882-4285-8b62-5aeb3a0e39e2 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:20:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2c6b2aca-9191-4972-b12e-3399d830ecd7 tempest-SnapshotMetadataTestJSON-93339113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-e6116ba8-ad55-486e-9539-da8535405ac0 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:20:47 devstack sudo[90875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-e6116ba8-ad55-486e-9539-da8535405ac0 Nov 06 15:20:47 devstack sudo[90875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:20:47 devstack sudo[90874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854.230fa377-d882-4285-8b62-5aeb3a0e39e2 Nov 06 15:20:47 devstack sudo[90874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:20:47 devstack sudo[90875]: pam_unix(sudo:session): session closed for user root Nov 06 15:20:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2c6b2aca-9191-4972-b12e-3399d830ecd7 tempest-SnapshotMetadataTestJSON-93339113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-e6116ba8-ad55-486e-9539-da8535405ac0" returned: 0 in 0.373s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:20:47 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-2c6b2aca-9191-4972-b12e-3399d830ecd7 tempest-SnapshotMetadataTestJSON-93339113 None] <== create_volume: return (1159ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:20:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-2c6b2aca-9191-4972-b12e-3399d830ecd7 tempest-SnapshotMetadataTestJSON-93339113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.164s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:20:47 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2c6b2aca-9191-4972-b12e-3399d830ecd7 tempest-SnapshotMetadataTestJSON-93339113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (915aaf93-0841-443a-8500-8c398373f59a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6116ba8-ad55-486e-9539-da8535405ac0', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:20:47 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2c6b2aca-9191-4972-b12e-3399d830ecd7 tempest-SnapshotMetadataTestJSON-93339113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71bd271a-a402-4ef6-9fd8-7223cf0d5df4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:20:48 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-2c6b2aca-9191-4972-b12e-3399d830ecd7 tempest-SnapshotMetadataTestJSON-93339113 None] Volume volume-e6116ba8-ad55-486e-9539-da8535405ac0 (e6116ba8-ad55-486e-9539-da8535405ac0): created successfully Nov 06 15:20:48 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2c6b2aca-9191-4972-b12e-3399d830ecd7 tempest-SnapshotMetadataTestJSON-93339113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71bd271a-a402-4ef6-9fd8-7223cf0d5df4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:20:48 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2c6b2aca-9191-4972-b12e-3399d830ecd7 tempest-SnapshotMetadataTestJSON-93339113 None] Flow 'volume_create_manager' (cf65e308-855a-4f78-b91d-501b6ca79222) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:20:48 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-2c6b2aca-9191-4972-b12e-3399d830ecd7 tempest-SnapshotMetadataTestJSON-93339113 None] Created volume successfully. Nov 06 15:20:48 devstack sudo[90874]: pam_unix(sudo:session): session closed for user root Nov 06 15:20:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2d0a385f-61a0-40e0-8e82-51f67280f0cb tempest-SnapshotsActionsTest-937430708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854.230fa377-d882-4285-8b62-5aeb3a0e39e2" returned: 0 in 0.541s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:20:48 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-2d0a385f-61a0-40e0-8e82-51f67280f0cb tempest-SnapshotsActionsTest-937430708 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-99639d52-10ab-4623-b3fa-6d85a98a6854(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 15:20:48 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[640096a2-d33c-4e6f-9b1d-0f879ffdea5d]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:20:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2d0a385f-61a0-40e0-8e82-51f67280f0cb tempest-SnapshotsActionsTest-937430708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854.74bfe026-fb95-4301-9aa0-75d765313be4 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:20:48 devstack sudo[90883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854.74bfe026-fb95-4301-9aa0-75d765313be4 Nov 06 15:20:48 devstack sudo[90883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:20:48 devstack sudo[90883]: pam_unix(sudo:session): session closed for user root Nov 06 15:20:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2d0a385f-61a0-40e0-8e82-51f67280f0cb tempest-SnapshotsActionsTest-937430708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854.74bfe026-fb95-4301-9aa0-75d765313be4" returned: 0 in 0.394s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:20:48 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-2d0a385f-61a0-40e0-8e82-51f67280f0cb tempest-SnapshotsActionsTest-937430708 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-99639d52-10ab-4623-b3fa-6d85a98a6854(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 15:20:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2d0a385f-61a0-40e0-8e82-51f67280f0cb tempest-SnapshotsActionsTest-937430708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854.230fa377-d882-4285-8b62-5aeb3a0e39e2 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:20:48 devstack sudo[90888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854.230fa377-d882-4285-8b62-5aeb3a0e39e2 Nov 06 15:20:48 devstack sudo[90888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:20:49 devstack sudo[90888]: pam_unix(sudo:session): session closed for user root Nov 06 15:20:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2d0a385f-61a0-40e0-8e82-51f67280f0cb tempest-SnapshotsActionsTest-937430708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854.230fa377-d882-4285-8b62-5aeb3a0e39e2" returned: 0 in 0.483s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:20:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2d0a385f-61a0-40e0-8e82-51f67280f0cb tempest-SnapshotsActionsTest-937430708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854.230fa377-d882-4285-8b62-5aeb3a0e39e2 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:20:49 devstack sudo[90895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854.230fa377-d882-4285-8b62-5aeb3a0e39e2 Nov 06 15:20:49 devstack sudo[90895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:20:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4fc4934a-8e96-455b-bbea-f63a36d4e46e tempest-SnapshotMetadataTestJSON-93339113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:20:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4fc4934a-8e96-455b-bbea-f63a36d4e46e tempest-SnapshotMetadataTestJSON-93339113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:20:49 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-4fc4934a-8e96-455b-bbea-f63a36d4e46e tempest-SnapshotMetadataTestJSON-93339113 None] Creating offline snapshot ff0a76f8-babc-4e60-8826-be2b13fa8952 of volume e6116ba8-ad55-486e-9539-da8535405ac0 {{(pid=87132) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 15:20:49 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8840e23-1dd4-469b-aad6-2e525712f812]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:20:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4fc4934a-8e96-455b-bbea-f63a36d4e46e tempest-SnapshotMetadataTestJSON-93339113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-e6116ba8-ad55-486e-9539-da8535405ac0 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:20:49 devstack sudo[90895]: pam_unix(sudo:session): session closed for user root Nov 06 15:20:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2d0a385f-61a0-40e0-8e82-51f67280f0cb tempest-SnapshotsActionsTest-937430708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854.230fa377-d882-4285-8b62-5aeb3a0e39e2" returned: 0 in 0.483s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:20:49 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-2d0a385f-61a0-40e0-8e82-51f67280f0cb tempest-SnapshotsActionsTest-937430708 None] Lock "cinder-quobyte-230fa377-d882-4285-8b62-5aeb3a0e39e2" released by "_delete_snapshot" :: held 2.067s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:20:49 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-2d0a385f-61a0-40e0-8e82-51f67280f0cb tempest-SnapshotsActionsTest-937430708 None] Lock "cinder-quobyte-99639d52-10ab-4623-b3fa-6d85a98a6854" released by "delete_snapshot" :: held 2.108s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:20:49 devstack sudo[90898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-e6116ba8-ad55-486e-9539-da8535405ac0 Nov 06 15:20:49 devstack sudo[90898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:20:49 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-2d0a385f-61a0-40e0-8e82-51f67280f0cb tempest-SnapshotsActionsTest-937430708 None] Created reservations ['6c33f0fa-98c1-45ec-8c67-b24665d09604', '567fd82d-4833-40fc-9302-57b032158f1c', 'b5a46745-95e3-4184-a053-c493c3ef536b', 'b7baa385-be94-4818-8d10-a1a20c54cdb9'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:20:49 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-2d0a385f-61a0-40e0-8e82-51f67280f0cb tempest-SnapshotsActionsTest-937430708 None] Delete snapshot completed successfully. Nov 06 15:20:49 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-2d0a385f-61a0-40e0-8e82-51f67280f0cb tempest-SnapshotsActionsTest-937430708 None] Lock "cinder-230fa377-d882-4285-8b62-5aeb3a0e39e2-delete_snapshot" released by "delete_snapshot" :: held 2.369s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:20:49 devstack sudo[90898]: pam_unix(sudo:session): session closed for user root Nov 06 15:20:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4fc4934a-8e96-455b-bbea-f63a36d4e46e tempest-SnapshotMetadataTestJSON-93339113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-e6116ba8-ad55-486e-9539-da8535405ac0" returned: 0 in 0.554s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:20:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4fc4934a-8e96-455b-bbea-f63a36d4e46e tempest-SnapshotMetadataTestJSON-93339113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-e6116ba8-ad55-486e-9539-da8535405ac0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-e6116ba8-ad55-486e-9539-da8535405ac0.ff0a76f8-babc-4e60-8826-be2b13fa8952 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:20:49 devstack sudo[90905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-e6116ba8-ad55-486e-9539-da8535405ac0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-e6116ba8-ad55-486e-9539-da8535405ac0.ff0a76f8-babc-4e60-8826-be2b13fa8952 1G Nov 06 15:20:49 devstack sudo[90905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:20:50 devstack sudo[90905]: pam_unix(sudo:session): session closed for user root Nov 06 15:20:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4fc4934a-8e96-455b-bbea-f63a36d4e46e tempest-SnapshotMetadataTestJSON-93339113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-e6116ba8-ad55-486e-9539-da8535405ac0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-e6116ba8-ad55-486e-9539-da8535405ac0.ff0a76f8-babc-4e60-8826-be2b13fa8952 1G" returned: 0 in 0.461s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:20:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4fc4934a-8e96-455b-bbea-f63a36d4e46e tempest-SnapshotMetadataTestJSON-93339113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6116ba8-ad55-486e-9539-da8535405ac0 -F qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-e6116ba8-ad55-486e-9539-da8535405ac0.ff0a76f8-babc-4e60-8826-be2b13fa8952 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:20:50 devstack sudo[90912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6116ba8-ad55-486e-9539-da8535405ac0 -F qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-e6116ba8-ad55-486e-9539-da8535405ac0.ff0a76f8-babc-4e60-8826-be2b13fa8952 Nov 06 15:20:50 devstack sudo[90912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:20:50 devstack sudo[90912]: pam_unix(sudo:session): session closed for user root Nov 06 15:20:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4fc4934a-8e96-455b-bbea-f63a36d4e46e tempest-SnapshotMetadataTestJSON-93339113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6116ba8-ad55-486e-9539-da8535405ac0 -F qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-e6116ba8-ad55-486e-9539-da8535405ac0.ff0a76f8-babc-4e60-8826-be2b13fa8952" returned: 0 in 0.362s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:20:50 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-4fc4934a-8e96-455b-bbea-f63a36d4e46e tempest-SnapshotMetadataTestJSON-93339113 None] /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-e6116ba8-ad55-486e-9539-da8535405ac0.ff0a76f8-babc-4e60-8826-be2b13fa8952 is being set with open permissions: ugo+rw Nov 06 15:20:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4fc4934a-8e96-455b-bbea-f63a36d4e46e tempest-SnapshotMetadataTestJSON-93339113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-e6116ba8-ad55-486e-9539-da8535405ac0.ff0a76f8-babc-4e60-8826-be2b13fa8952 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:20:50 devstack sudo[90917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-e6116ba8-ad55-486e-9539-da8535405ac0.ff0a76f8-babc-4e60-8826-be2b13fa8952 Nov 06 15:20:50 devstack sudo[90917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:20:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b2596875-5f1a-41e0-8146-7eb1828b382a tempest-SnapshotsActionsTest-597994470 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:20:51 devstack sudo[90917]: pam_unix(sudo:session): session closed for user root Nov 06 15:20:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4fc4934a-8e96-455b-bbea-f63a36d4e46e tempest-SnapshotMetadataTestJSON-93339113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-e6116ba8-ad55-486e-9539-da8535405ac0.ff0a76f8-babc-4e60-8826-be2b13fa8952" returned: 0 in 0.365s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:20:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4fc4934a-8e96-455b-bbea-f63a36d4e46e tempest-SnapshotMetadataTestJSON-93339113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-e6116ba8-ad55-486e-9539-da8535405ac0.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:20:51 devstack sudo[90920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-e6116ba8-ad55-486e-9539-da8535405ac0.info Nov 06 15:20:51 devstack sudo[90920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:20:51 devstack sudo[90920]: pam_unix(sudo:session): session closed for user root Nov 06 15:20:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4fc4934a-8e96-455b-bbea-f63a36d4e46e tempest-SnapshotMetadataTestJSON-93339113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-e6116ba8-ad55-486e-9539-da8535405ac0.info" returned: 0 in 0.304s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:20:51 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-4fc4934a-8e96-455b-bbea-f63a36d4e46e tempest-SnapshotMetadataTestJSON-93339113 None] /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-e6116ba8-ad55-486e-9539-da8535405ac0.info is being set with open permissions: ugo+rw Nov 06 15:20:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4fc4934a-8e96-455b-bbea-f63a36d4e46e tempest-SnapshotMetadataTestJSON-93339113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-e6116ba8-ad55-486e-9539-da8535405ac0.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:20:51 devstack sudo[90923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-e6116ba8-ad55-486e-9539-da8535405ac0.info Nov 06 15:20:51 devstack sudo[90923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:20:51 devstack sudo[90923]: pam_unix(sudo:session): session closed for user root Nov 06 15:20:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4fc4934a-8e96-455b-bbea-f63a36d4e46e tempest-SnapshotMetadataTestJSON-93339113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-e6116ba8-ad55-486e-9539-da8535405ac0.info" returned: 0 in 0.366s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:20:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4fc4934a-8e96-455b-bbea-f63a36d4e46e tempest-SnapshotMetadataTestJSON-93339113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.544s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:20:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b2596875-5f1a-41e0-8146-7eb1828b382a tempest-SnapshotsActionsTest-597994470 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.797s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:20:51 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-b2596875-5f1a-41e0-8146-7eb1828b382a tempest-SnapshotsActionsTest-597994470 None] Creating offline snapshot 7445379f-b869-40b0-bd58-cb1faa34e8cd of volume 99639d52-10ab-4623-b3fa-6d85a98a6854 {{(pid=87132) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 15:20:51 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[73dd89d9-c3ae-408a-bf5b-ceca6e7859fb]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:20:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b2596875-5f1a-41e0-8146-7eb1828b382a tempest-SnapshotsActionsTest-597994470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854.74bfe026-fb95-4301-9aa0-75d765313be4 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:20:52 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-4fc4934a-8e96-455b-bbea-f63a36d4e46e tempest-SnapshotMetadataTestJSON-93339113 None] Create snapshot completed successfully Nov 06 15:20:52 devstack sudo[90928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854.74bfe026-fb95-4301-9aa0-75d765313be4 Nov 06 15:20:52 devstack sudo[90928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:20:52 devstack sudo[90928]: pam_unix(sudo:session): session closed for user root Nov 06 15:20:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b2596875-5f1a-41e0-8146-7eb1828b382a tempest-SnapshotsActionsTest-597994470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854.74bfe026-fb95-4301-9aa0-75d765313be4" returned: 0 in 0.508s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:20:52 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-b2596875-5f1a-41e0-8146-7eb1828b382a tempest-SnapshotsActionsTest-597994470 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-99639d52-10ab-4623-b3fa-6d85a98a6854(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 15:20:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b2596875-5f1a-41e0-8146-7eb1828b382a tempest-SnapshotsActionsTest-597994470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854.74bfe026-fb95-4301-9aa0-75d765313be4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854.7445379f-b869-40b0-bd58-cb1faa34e8cd 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:20:52 devstack sudo[90933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854.74bfe026-fb95-4301-9aa0-75d765313be4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854.7445379f-b869-40b0-bd58-cb1faa34e8cd 1G Nov 06 15:20:52 devstack sudo[90933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:20:53 devstack sudo[90933]: pam_unix(sudo:session): session closed for user root Nov 06 15:20:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b2596875-5f1a-41e0-8146-7eb1828b382a tempest-SnapshotsActionsTest-597994470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854.74bfe026-fb95-4301-9aa0-75d765313be4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854.7445379f-b869-40b0-bd58-cb1faa34e8cd 1G" returned: 0 in 0.808s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:20:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b2596875-5f1a-41e0-8146-7eb1828b382a tempest-SnapshotsActionsTest-597994470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99639d52-10ab-4623-b3fa-6d85a98a6854.74bfe026-fb95-4301-9aa0-75d765313be4 -F qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854.7445379f-b869-40b0-bd58-cb1faa34e8cd {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:20:53 devstack sudo[90940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99639d52-10ab-4623-b3fa-6d85a98a6854.74bfe026-fb95-4301-9aa0-75d765313be4 -F qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854.7445379f-b869-40b0-bd58-cb1faa34e8cd Nov 06 15:20:53 devstack sudo[90940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:20:53 devstack sudo[90940]: pam_unix(sudo:session): session closed for user root Nov 06 15:20:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b2596875-5f1a-41e0-8146-7eb1828b382a tempest-SnapshotsActionsTest-597994470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99639d52-10ab-4623-b3fa-6d85a98a6854.74bfe026-fb95-4301-9aa0-75d765313be4 -F qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854.7445379f-b869-40b0-bd58-cb1faa34e8cd" returned: 0 in 0.521s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:20:53 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-b2596875-5f1a-41e0-8146-7eb1828b382a tempest-SnapshotsActionsTest-597994470 None] /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854.7445379f-b869-40b0-bd58-cb1faa34e8cd is being set with open permissions: ugo+rw Nov 06 15:20:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b2596875-5f1a-41e0-8146-7eb1828b382a tempest-SnapshotsActionsTest-597994470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854.7445379f-b869-40b0-bd58-cb1faa34e8cd {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:20:53 devstack sudo[90949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854.7445379f-b869-40b0-bd58-cb1faa34e8cd Nov 06 15:20:53 devstack sudo[90949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:20:53 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a7d7d718-d069-41c0-aadf-03f77ff927d6 tempest-SnapshotMetadataTestJSON-93339113 None] Acquiring lock "cinder-ff0a76f8-babc-4e60-8826-be2b13fa8952-delete_snapshot" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:20:54 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a7d7d718-d069-41c0-aadf-03f77ff927d6 tempest-SnapshotMetadataTestJSON-93339113 None] Lock "cinder-ff0a76f8-babc-4e60-8826-be2b13fa8952-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:20:54 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a7d7d718-d069-41c0-aadf-03f77ff927d6 tempest-SnapshotMetadataTestJSON-93339113 None] Acquiring lock "cinder-quobyte-e6116ba8-ad55-486e-9539-da8535405ac0" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:20:54 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a7d7d718-d069-41c0-aadf-03f77ff927d6 tempest-SnapshotMetadataTestJSON-93339113 None] Lock "cinder-quobyte-e6116ba8-ad55-486e-9539-da8535405ac0" acquired by "delete_snapshot" :: waited 0.050s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:20:54 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a7d7d718-d069-41c0-aadf-03f77ff927d6 tempest-SnapshotMetadataTestJSON-93339113 None] Acquiring lock "cinder-quobyte-ff0a76f8-babc-4e60-8826-be2b13fa8952" by "_delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:20:54 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a7d7d718-d069-41c0-aadf-03f77ff927d6 tempest-SnapshotMetadataTestJSON-93339113 None] Lock "cinder-quobyte-ff0a76f8-babc-4e60-8826-be2b13fa8952" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:20:54 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-a7d7d718-d069-41c0-aadf-03f77ff927d6 tempest-SnapshotMetadataTestJSON-93339113 None] Deleting offline snapshot ff0a76f8-babc-4e60-8826-be2b13fa8952 of volume e6116ba8-ad55-486e-9539-da8535405ac0 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 15:20:54 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-a7d7d718-d069-41c0-aadf-03f77ff927d6 tempest-SnapshotMetadataTestJSON-93339113 None] snapshot_file for this snap is: volume-e6116ba8-ad55-486e-9539-da8535405ac0.ff0a76f8-babc-4e60-8826-be2b13fa8952 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 15:20:54 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[611442a0-2833-4ef1-b733-e8d2d034a2f4]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:20:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a7d7d718-d069-41c0-aadf-03f77ff927d6 tempest-SnapshotMetadataTestJSON-93339113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-e6116ba8-ad55-486e-9539-da8535405ac0.ff0a76f8-babc-4e60-8826-be2b13fa8952 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:20:54 devstack sudo[90949]: pam_unix(sudo:session): session closed for user root Nov 06 15:20:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b2596875-5f1a-41e0-8146-7eb1828b382a tempest-SnapshotsActionsTest-597994470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854.7445379f-b869-40b0-bd58-cb1faa34e8cd" returned: 0 in 0.492s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:20:54 devstack sudo[90956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-e6116ba8-ad55-486e-9539-da8535405ac0.ff0a76f8-babc-4e60-8826-be2b13fa8952 Nov 06 15:20:54 devstack sudo[90956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:20:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b2596875-5f1a-41e0-8146-7eb1828b382a tempest-SnapshotsActionsTest-597994470 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.505s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:20:54 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-b2596875-5f1a-41e0-8146-7eb1828b382a tempest-SnapshotsActionsTest-597994470 None] Create snapshot completed successfully Nov 06 15:20:54 devstack sudo[90956]: pam_unix(sudo:session): session closed for user root Nov 06 15:20:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a7d7d718-d069-41c0-aadf-03f77ff927d6 tempest-SnapshotMetadataTestJSON-93339113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-e6116ba8-ad55-486e-9539-da8535405ac0.ff0a76f8-babc-4e60-8826-be2b13fa8952" returned: 0 in 0.548s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:20:54 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-a7d7d718-d069-41c0-aadf-03f77ff927d6 tempest-SnapshotMetadataTestJSON-93339113 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e6116ba8-ad55-486e-9539-da8535405ac0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 15:20:54 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ba9f6bc-3c2d-4a05-815f-e11482f55c95]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:20:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a7d7d718-d069-41c0-aadf-03f77ff927d6 tempest-SnapshotMetadataTestJSON-93339113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-e6116ba8-ad55-486e-9539-da8535405ac0 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:20:54 devstack sudo[90963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-e6116ba8-ad55-486e-9539-da8535405ac0 Nov 06 15:20:54 devstack sudo[90963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:20:55 devstack sudo[90963]: pam_unix(sudo:session): session closed for user root Nov 06 15:20:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a7d7d718-d069-41c0-aadf-03f77ff927d6 tempest-SnapshotMetadataTestJSON-93339113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-e6116ba8-ad55-486e-9539-da8535405ac0" returned: 0 in 0.444s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:20:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a7d7d718-d069-41c0-aadf-03f77ff927d6 tempest-SnapshotMetadataTestJSON-93339113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-e6116ba8-ad55-486e-9539-da8535405ac0.ff0a76f8-babc-4e60-8826-be2b13fa8952 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:20:55 devstack sudo[90968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-e6116ba8-ad55-486e-9539-da8535405ac0.ff0a76f8-babc-4e60-8826-be2b13fa8952 Nov 06 15:20:55 devstack sudo[90968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:20:55 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-00da4132-5b0b-49b5-8077-f7bfaab6bd37 tempest-SnapshotsActionsTest-937430708 None] Acquiring lock "cinder-7445379f-b869-40b0-bd58-cb1faa34e8cd-delete_snapshot" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:20:55 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-00da4132-5b0b-49b5-8077-f7bfaab6bd37 tempest-SnapshotsActionsTest-937430708 None] Lock "cinder-7445379f-b869-40b0-bd58-cb1faa34e8cd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:20:55 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-00da4132-5b0b-49b5-8077-f7bfaab6bd37 tempest-SnapshotsActionsTest-937430708 None] Acquiring lock "cinder-quobyte-99639d52-10ab-4623-b3fa-6d85a98a6854" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:20:55 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-00da4132-5b0b-49b5-8077-f7bfaab6bd37 tempest-SnapshotsActionsTest-937430708 None] Lock "cinder-quobyte-99639d52-10ab-4623-b3fa-6d85a98a6854" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:20:55 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-00da4132-5b0b-49b5-8077-f7bfaab6bd37 tempest-SnapshotsActionsTest-937430708 None] Acquiring lock "cinder-quobyte-7445379f-b869-40b0-bd58-cb1faa34e8cd" by "_delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:20:55 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-00da4132-5b0b-49b5-8077-f7bfaab6bd37 tempest-SnapshotsActionsTest-937430708 None] Lock "cinder-quobyte-7445379f-b869-40b0-bd58-cb1faa34e8cd" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:20:55 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-00da4132-5b0b-49b5-8077-f7bfaab6bd37 tempest-SnapshotsActionsTest-937430708 None] Deleting offline snapshot 7445379f-b869-40b0-bd58-cb1faa34e8cd of volume 99639d52-10ab-4623-b3fa-6d85a98a6854 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 15:20:55 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-00da4132-5b0b-49b5-8077-f7bfaab6bd37 tempest-SnapshotsActionsTest-937430708 None] snapshot_file for this snap is: volume-99639d52-10ab-4623-b3fa-6d85a98a6854.7445379f-b869-40b0-bd58-cb1faa34e8cd {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 15:20:55 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd8bbcdb-680b-4ceb-aa34-3bd3bf18295c]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:20:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-00da4132-5b0b-49b5-8077-f7bfaab6bd37 tempest-SnapshotsActionsTest-937430708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854.7445379f-b869-40b0-bd58-cb1faa34e8cd {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:20:55 devstack sudo[90968]: pam_unix(sudo:session): session closed for user root Nov 06 15:20:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a7d7d718-d069-41c0-aadf-03f77ff927d6 tempest-SnapshotMetadataTestJSON-93339113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-e6116ba8-ad55-486e-9539-da8535405ac0.ff0a76f8-babc-4e60-8826-be2b13fa8952" returned: 0 in 0.477s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:20:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a7d7d718-d069-41c0-aadf-03f77ff927d6 tempest-SnapshotMetadataTestJSON-93339113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-e6116ba8-ad55-486e-9539-da8535405ac0.ff0a76f8-babc-4e60-8826-be2b13fa8952 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:20:55 devstack sudo[90975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-e6116ba8-ad55-486e-9539-da8535405ac0.ff0a76f8-babc-4e60-8826-be2b13fa8952 Nov 06 15:20:55 devstack sudo[90975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:20:55 devstack sudo[90974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854.7445379f-b869-40b0-bd58-cb1faa34e8cd Nov 06 15:20:55 devstack sudo[90974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:20:56 devstack sudo[90975]: pam_unix(sudo:session): session closed for user root Nov 06 15:20:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a7d7d718-d069-41c0-aadf-03f77ff927d6 tempest-SnapshotMetadataTestJSON-93339113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-e6116ba8-ad55-486e-9539-da8535405ac0.ff0a76f8-babc-4e60-8826-be2b13fa8952" returned: 0 in 0.356s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:20:56 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a7d7d718-d069-41c0-aadf-03f77ff927d6 tempest-SnapshotMetadataTestJSON-93339113 None] Lock "cinder-quobyte-ff0a76f8-babc-4e60-8826-be2b13fa8952" released by "_delete_snapshot" :: held 2.013s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:20:56 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a7d7d718-d069-41c0-aadf-03f77ff927d6 tempest-SnapshotMetadataTestJSON-93339113 None] Lock "cinder-quobyte-e6116ba8-ad55-486e-9539-da8535405ac0" released by "delete_snapshot" :: held 2.047s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:20:56 devstack sudo[90974]: pam_unix(sudo:session): session closed for user root Nov 06 15:20:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-00da4132-5b0b-49b5-8077-f7bfaab6bd37 tempest-SnapshotsActionsTest-937430708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854.7445379f-b869-40b0-bd58-cb1faa34e8cd" returned: 0 in 0.549s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:20:56 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-00da4132-5b0b-49b5-8077-f7bfaab6bd37 tempest-SnapshotsActionsTest-937430708 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-99639d52-10ab-4623-b3fa-6d85a98a6854(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 15:20:56 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-a7d7d718-d069-41c0-aadf-03f77ff927d6 tempest-SnapshotMetadataTestJSON-93339113 None] Created reservations ['ed429d77-bf9d-4445-bf87-d54d0efb3368', 'd1a3db98-ad9a-4730-8469-8d998a2e496d', '72bf0598-a569-4b70-882a-f9faf94777ea', '6a9855f5-17a5-46e5-94d0-f3f8fad98b0a'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:20:56 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[a07c62b0-d69d-40b3-931c-7c6b11984c3e]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:20:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-00da4132-5b0b-49b5-8077-f7bfaab6bd37 tempest-SnapshotsActionsTest-937430708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854.74bfe026-fb95-4301-9aa0-75d765313be4 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:20:56 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-a7d7d718-d069-41c0-aadf-03f77ff927d6 tempest-SnapshotMetadataTestJSON-93339113 None] Delete snapshot completed successfully. Nov 06 15:20:56 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a7d7d718-d069-41c0-aadf-03f77ff927d6 tempest-SnapshotMetadataTestJSON-93339113 None] Lock "cinder-ff0a76f8-babc-4e60-8826-be2b13fa8952-delete_snapshot" released by "delete_snapshot" :: held 2.324s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:20:56 devstack sudo[90994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854.74bfe026-fb95-4301-9aa0-75d765313be4 Nov 06 15:20:56 devstack sudo[90994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:20:56 devstack sudo[90994]: pam_unix(sudo:session): session closed for user root Nov 06 15:20:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-00da4132-5b0b-49b5-8077-f7bfaab6bd37 tempest-SnapshotsActionsTest-937430708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854.74bfe026-fb95-4301-9aa0-75d765313be4" returned: 0 in 0.419s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:20:56 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-00da4132-5b0b-49b5-8077-f7bfaab6bd37 tempest-SnapshotsActionsTest-937430708 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-99639d52-10ab-4623-b3fa-6d85a98a6854(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 15:20:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-00da4132-5b0b-49b5-8077-f7bfaab6bd37 tempest-SnapshotsActionsTest-937430708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854.7445379f-b869-40b0-bd58-cb1faa34e8cd {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:20:56 devstack sudo[91005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854.7445379f-b869-40b0-bd58-cb1faa34e8cd Nov 06 15:20:56 devstack sudo[91005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:20:57 devstack sudo[91005]: pam_unix(sudo:session): session closed for user root Nov 06 15:20:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-00da4132-5b0b-49b5-8077-f7bfaab6bd37 tempest-SnapshotsActionsTest-937430708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854.7445379f-b869-40b0-bd58-cb1faa34e8cd" returned: 0 in 0.396s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:20:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-00da4132-5b0b-49b5-8077-f7bfaab6bd37 tempest-SnapshotsActionsTest-937430708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854.7445379f-b869-40b0-bd58-cb1faa34e8cd {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:20:57 devstack sudo[91011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854.7445379f-b869-40b0-bd58-cb1faa34e8cd Nov 06 15:20:57 devstack sudo[91011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:20:57 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-9d7e7588-0a51-4837-b7a8-3cb2c2eb8bbb tempest-SnapshotMetadataTestJSON-93339113 None] Acquiring lock "cinder-e6116ba8-ad55-486e-9539-da8535405ac0-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:20:57 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-9d7e7588-0a51-4837-b7a8-3cb2c2eb8bbb tempest-SnapshotMetadataTestJSON-93339113 None] Lock "cinder-e6116ba8-ad55-486e-9539-da8535405ac0-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:20:57 devstack sudo[91011]: pam_unix(sudo:session): session closed for user root Nov 06 15:20:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-00da4132-5b0b-49b5-8077-f7bfaab6bd37 tempest-SnapshotsActionsTest-937430708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854.7445379f-b869-40b0-bd58-cb1faa34e8cd" returned: 0 in 0.286s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:20:57 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-9d7e7588-0a51-4837-b7a8-3cb2c2eb8bbb tempest-SnapshotMetadataTestJSON-93339113 None] Acquiring lock "cinder-quobyte-e6116ba8-ad55-486e-9539-da8535405ac0" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:20:57 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-00da4132-5b0b-49b5-8077-f7bfaab6bd37 tempest-SnapshotsActionsTest-937430708 None] Lock "cinder-quobyte-7445379f-b869-40b0-bd58-cb1faa34e8cd" released by "_delete_snapshot" :: held 1.784s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:20:57 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-00da4132-5b0b-49b5-8077-f7bfaab6bd37 tempest-SnapshotsActionsTest-937430708 None] Lock "cinder-quobyte-99639d52-10ab-4623-b3fa-6d85a98a6854" released by "delete_snapshot" :: held 1.819s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:20:57 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-9d7e7588-0a51-4837-b7a8-3cb2c2eb8bbb tempest-SnapshotMetadataTestJSON-93339113 None] Lock "cinder-quobyte-e6116ba8-ad55-486e-9539-da8535405ac0" acquired by "delete_volume" :: waited 0.019s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:20:57 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b48baf8-2ba6-4872-9a6a-3d26487e576f]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:20:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9d7e7588-0a51-4837-b7a8-3cb2c2eb8bbb tempest-SnapshotMetadataTestJSON-93339113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-e6116ba8-ad55-486e-9539-da8535405ac0 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:20:57 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-00da4132-5b0b-49b5-8077-f7bfaab6bd37 tempest-SnapshotsActionsTest-937430708 None] Created reservations ['cc766c39-588c-477b-b7eb-221dd76f24e9', 'd99bfa1a-a45f-43c5-8d2b-3e2902d0250d', 'c74b7892-476e-4df9-a16b-769d660259d3', 'a8a8ef34-af66-4fcf-b330-c90d6dbf9d14'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:20:57 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-00da4132-5b0b-49b5-8077-f7bfaab6bd37 tempest-SnapshotsActionsTest-937430708 None] Delete snapshot completed successfully. Nov 06 15:20:57 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-00da4132-5b0b-49b5-8077-f7bfaab6bd37 tempest-SnapshotsActionsTest-937430708 None] Lock "cinder-7445379f-b869-40b0-bd58-cb1faa34e8cd-delete_snapshot" released by "delete_snapshot" :: held 2.023s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:20:57 devstack sudo[91014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-e6116ba8-ad55-486e-9539-da8535405ac0 Nov 06 15:20:57 devstack sudo[91014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:20:57 devstack sudo[91014]: pam_unix(sudo:session): session closed for user root Nov 06 15:20:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9d7e7588-0a51-4837-b7a8-3cb2c2eb8bbb tempest-SnapshotMetadataTestJSON-93339113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-e6116ba8-ad55-486e-9539-da8535405ac0" returned: 0 in 0.430s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:20:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9d7e7588-0a51-4837-b7a8-3cb2c2eb8bbb tempest-SnapshotMetadataTestJSON-93339113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-e6116ba8-ad55-486e-9539-da8535405ac0 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:20:57 devstack sudo[91019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-e6116ba8-ad55-486e-9539-da8535405ac0 Nov 06 15:20:57 devstack sudo[91019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:20:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1eb19613-e67d-40c4-9cd5-9cb8ad701735 tempest-SnapshotsActionsTest-597994470 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:20:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1eb19613-e67d-40c4-9cd5-9cb8ad701735 tempest-SnapshotsActionsTest-597994470 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:20:58 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-1eb19613-e67d-40c4-9cd5-9cb8ad701735 tempest-SnapshotsActionsTest-597994470 None] Creating offline snapshot 3d497599-b520-4122-b3cc-3ced589104dc of volume 99639d52-10ab-4623-b3fa-6d85a98a6854 {{(pid=87132) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 15:20:58 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[81ca6032-9bd3-4212-9a8d-4f0fceaa3363]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:20:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1eb19613-e67d-40c4-9cd5-9cb8ad701735 tempest-SnapshotsActionsTest-597994470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854.74bfe026-fb95-4301-9aa0-75d765313be4 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:20:58 devstack sudo[91019]: pam_unix(sudo:session): session closed for user root Nov 06 15:20:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9d7e7588-0a51-4837-b7a8-3cb2c2eb8bbb tempest-SnapshotMetadataTestJSON-93339113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-e6116ba8-ad55-486e-9539-da8535405ac0" returned: 0 in 0.298s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:20:58 devstack sudo[91021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854.74bfe026-fb95-4301-9aa0-75d765313be4 Nov 06 15:20:58 devstack sudo[91021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:20:58 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-9d7e7588-0a51-4837-b7a8-3cb2c2eb8bbb tempest-SnapshotMetadataTestJSON-93339113 None] Lock "cinder-quobyte-e6116ba8-ad55-486e-9539-da8535405ac0" released by "delete_volume" :: held 0.804s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:20:58 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-9d7e7588-0a51-4837-b7a8-3cb2c2eb8bbb tempest-SnapshotMetadataTestJSON-93339113 None] Created reservations ['02e0250d-2f59-4ddc-9cde-70f413fd7a6f', 'a96bf0f7-d0f9-4ca4-9913-a99105345830', '42a079b1-2fac-4a56-bac2-1505872a6d52', '3e9f5fa5-82b6-4fbc-bfc2-7435c1693228'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:20:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9d7e7588-0a51-4837-b7a8-3cb2c2eb8bbb tempest-SnapshotMetadataTestJSON-93339113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:20:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9d7e7588-0a51-4837-b7a8-3cb2c2eb8bbb tempest-SnapshotMetadataTestJSON-93339113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:20:58 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-9d7e7588-0a51-4837-b7a8-3cb2c2eb8bbb tempest-SnapshotMetadataTestJSON-93339113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:20:58 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-9d7e7588-0a51-4837-b7a8-3cb2c2eb8bbb tempest-SnapshotMetadataTestJSON-93339113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:20:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9d7e7588-0a51-4837-b7a8-3cb2c2eb8bbb tempest-SnapshotMetadataTestJSON-93339113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:20:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9d7e7588-0a51-4837-b7a8-3cb2c2eb8bbb tempest-SnapshotMetadataTestJSON-93339113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:20:58 devstack sudo[91025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:20:58 devstack sudo[91025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:20:58 devstack sudo[91021]: pam_unix(sudo:session): session closed for user root Nov 06 15:20:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1eb19613-e67d-40c4-9cd5-9cb8ad701735 tempest-SnapshotsActionsTest-597994470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854.74bfe026-fb95-4301-9aa0-75d765313be4" returned: 0 in 0.515s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:20:58 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-1eb19613-e67d-40c4-9cd5-9cb8ad701735 tempest-SnapshotsActionsTest-597994470 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-99639d52-10ab-4623-b3fa-6d85a98a6854(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 15:20:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1eb19613-e67d-40c4-9cd5-9cb8ad701735 tempest-SnapshotsActionsTest-597994470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854.74bfe026-fb95-4301-9aa0-75d765313be4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854.3d497599-b520-4122-b3cc-3ced589104dc 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:20:58 devstack sudo[91032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854.74bfe026-fb95-4301-9aa0-75d765313be4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854.3d497599-b520-4122-b3cc-3ced589104dc 1G Nov 06 15:20:58 devstack sudo[91032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:20:58 devstack sudo[91025]: pam_unix(sudo:session): session closed for user root Nov 06 15:20:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9d7e7588-0a51-4837-b7a8-3cb2c2eb8bbb tempest-SnapshotMetadataTestJSON-93339113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.334s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:20:58 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-9d7e7588-0a51-4837-b7a8-3cb2c2eb8bbb tempest-SnapshotMetadataTestJSON-93339113 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:20:58 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-9d7e7588-0a51-4837-b7a8-3cb2c2eb8bbb tempest-SnapshotMetadataTestJSON-93339113 None] Deleted volume successfully. Nov 06 15:20:58 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-9d7e7588-0a51-4837-b7a8-3cb2c2eb8bbb tempest-SnapshotMetadataTestJSON-93339113 None] Lock "cinder-e6116ba8-ad55-486e-9539-da8535405ac0-delete_volume" released by "delete_volume" :: held 1.401s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:20:59 devstack sudo[91032]: pam_unix(sudo:session): session closed for user root Nov 06 15:20:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1eb19613-e67d-40c4-9cd5-9cb8ad701735 tempest-SnapshotsActionsTest-597994470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854.74bfe026-fb95-4301-9aa0-75d765313be4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854.3d497599-b520-4122-b3cc-3ced589104dc 1G" returned: 0 in 0.584s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:20:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1eb19613-e67d-40c4-9cd5-9cb8ad701735 tempest-SnapshotsActionsTest-597994470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99639d52-10ab-4623-b3fa-6d85a98a6854.74bfe026-fb95-4301-9aa0-75d765313be4 -F qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854.3d497599-b520-4122-b3cc-3ced589104dc {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:20:59 devstack sudo[91041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99639d52-10ab-4623-b3fa-6d85a98a6854.74bfe026-fb95-4301-9aa0-75d765313be4 -F qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854.3d497599-b520-4122-b3cc-3ced589104dc Nov 06 15:20:59 devstack sudo[91041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:20:59 devstack sudo[91041]: pam_unix(sudo:session): session closed for user root Nov 06 15:20:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1eb19613-e67d-40c4-9cd5-9cb8ad701735 tempest-SnapshotsActionsTest-597994470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99639d52-10ab-4623-b3fa-6d85a98a6854.74bfe026-fb95-4301-9aa0-75d765313be4 -F qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854.3d497599-b520-4122-b3cc-3ced589104dc" returned: 0 in 0.342s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:20:59 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-1eb19613-e67d-40c4-9cd5-9cb8ad701735 tempest-SnapshotsActionsTest-597994470 None] /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854.3d497599-b520-4122-b3cc-3ced589104dc is being set with open permissions: ugo+rw Nov 06 15:20:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1eb19613-e67d-40c4-9cd5-9cb8ad701735 tempest-SnapshotsActionsTest-597994470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854.3d497599-b520-4122-b3cc-3ced589104dc {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:20:59 devstack sudo[91047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854.3d497599-b520-4122-b3cc-3ced589104dc Nov 06 15:20:59 devstack sudo[91047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:20:59 devstack sudo[91047]: pam_unix(sudo:session): session closed for user root Nov 06 15:20:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1eb19613-e67d-40c4-9cd5-9cb8ad701735 tempest-SnapshotsActionsTest-597994470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854.3d497599-b520-4122-b3cc-3ced589104dc" returned: 0 in 0.409s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:20:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1eb19613-e67d-40c4-9cd5-9cb8ad701735 tempest-SnapshotsActionsTest-597994470 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.980s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:21:00 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-1eb19613-e67d-40c4-9cd5-9cb8ad701735 tempest-SnapshotsActionsTest-597994470 None] Create snapshot completed successfully Nov 06 15:21:00 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-ffd37ea4-d4b5-4743-9126-4d399aaf5fb5 tempest-SnapshotsActionsTest-937430708 None] Acquiring lock "cinder-3d497599-b520-4122-b3cc-3ced589104dc-delete_snapshot" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:21:00 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-ffd37ea4-d4b5-4743-9126-4d399aaf5fb5 tempest-SnapshotsActionsTest-937430708 None] Lock "cinder-3d497599-b520-4122-b3cc-3ced589104dc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:21:00 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-ffd37ea4-d4b5-4743-9126-4d399aaf5fb5 tempest-SnapshotsActionsTest-937430708 None] Acquiring lock "cinder-quobyte-99639d52-10ab-4623-b3fa-6d85a98a6854" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:21:00 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-ffd37ea4-d4b5-4743-9126-4d399aaf5fb5 tempest-SnapshotsActionsTest-937430708 None] Lock "cinder-quobyte-99639d52-10ab-4623-b3fa-6d85a98a6854" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:21:00 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-ffd37ea4-d4b5-4743-9126-4d399aaf5fb5 tempest-SnapshotsActionsTest-937430708 None] Acquiring lock "cinder-quobyte-3d497599-b520-4122-b3cc-3ced589104dc" by "_delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:21:00 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-ffd37ea4-d4b5-4743-9126-4d399aaf5fb5 tempest-SnapshotsActionsTest-937430708 None] Lock "cinder-quobyte-3d497599-b520-4122-b3cc-3ced589104dc" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:21:00 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-ffd37ea4-d4b5-4743-9126-4d399aaf5fb5 tempest-SnapshotsActionsTest-937430708 None] Deleting offline snapshot 3d497599-b520-4122-b3cc-3ced589104dc of volume 99639d52-10ab-4623-b3fa-6d85a98a6854 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 15:21:00 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-ffd37ea4-d4b5-4743-9126-4d399aaf5fb5 tempest-SnapshotsActionsTest-937430708 None] snapshot_file for this snap is: volume-99639d52-10ab-4623-b3fa-6d85a98a6854.3d497599-b520-4122-b3cc-3ced589104dc {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 15:21:00 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[de690041-6b7e-4ec2-b876-39dcaf6658c0]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:21:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ffd37ea4-d4b5-4743-9126-4d399aaf5fb5 tempest-SnapshotsActionsTest-937430708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854.3d497599-b520-4122-b3cc-3ced589104dc {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:21:00 devstack sudo[91057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854.3d497599-b520-4122-b3cc-3ced589104dc Nov 06 15:21:00 devstack sudo[91057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:21:00 devstack sudo[91057]: pam_unix(sudo:session): session closed for user root Nov 06 15:21:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ffd37ea4-d4b5-4743-9126-4d399aaf5fb5 tempest-SnapshotsActionsTest-937430708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854.3d497599-b520-4122-b3cc-3ced589104dc" returned: 0 in 0.533s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:21:00 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-ffd37ea4-d4b5-4743-9126-4d399aaf5fb5 tempest-SnapshotsActionsTest-937430708 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-99639d52-10ab-4623-b3fa-6d85a98a6854(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 15:21:01 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[86c10477-00d3-4e5e-80dc-d48f23ee8424]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:21:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ffd37ea4-d4b5-4743-9126-4d399aaf5fb5 tempest-SnapshotsActionsTest-937430708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854.74bfe026-fb95-4301-9aa0-75d765313be4 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:21:01 devstack sudo[91071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854.74bfe026-fb95-4301-9aa0-75d765313be4 Nov 06 15:21:01 devstack sudo[91071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:21:01 devstack sudo[91071]: pam_unix(sudo:session): session closed for user root Nov 06 15:21:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ffd37ea4-d4b5-4743-9126-4d399aaf5fb5 tempest-SnapshotsActionsTest-937430708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854.74bfe026-fb95-4301-9aa0-75d765313be4" returned: 0 in 0.416s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:21:01 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-ffd37ea4-d4b5-4743-9126-4d399aaf5fb5 tempest-SnapshotsActionsTest-937430708 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-99639d52-10ab-4623-b3fa-6d85a98a6854(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 15:21:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ffd37ea4-d4b5-4743-9126-4d399aaf5fb5 tempest-SnapshotsActionsTest-937430708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854.3d497599-b520-4122-b3cc-3ced589104dc {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:21:01 devstack sudo[91076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854.3d497599-b520-4122-b3cc-3ced589104dc Nov 06 15:21:01 devstack sudo[91076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:21:01 devstack sudo[91076]: pam_unix(sudo:session): session closed for user root Nov 06 15:21:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ffd37ea4-d4b5-4743-9126-4d399aaf5fb5 tempest-SnapshotsActionsTest-937430708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854.3d497599-b520-4122-b3cc-3ced589104dc" returned: 0 in 0.488s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:21:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ffd37ea4-d4b5-4743-9126-4d399aaf5fb5 tempest-SnapshotsActionsTest-937430708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854.3d497599-b520-4122-b3cc-3ced589104dc {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:21:01 devstack sudo[91082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854.3d497599-b520-4122-b3cc-3ced589104dc Nov 06 15:21:01 devstack sudo[91082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:21:02 devstack sudo[91082]: pam_unix(sudo:session): session closed for user root Nov 06 15:21:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ffd37ea4-d4b5-4743-9126-4d399aaf5fb5 tempest-SnapshotsActionsTest-937430708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854.3d497599-b520-4122-b3cc-3ced589104dc" returned: 0 in 0.309s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:21:02 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-ffd37ea4-d4b5-4743-9126-4d399aaf5fb5 tempest-SnapshotsActionsTest-937430708 None] Lock "cinder-quobyte-3d497599-b520-4122-b3cc-3ced589104dc" released by "_delete_snapshot" :: held 1.924s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:21:02 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-ffd37ea4-d4b5-4743-9126-4d399aaf5fb5 tempest-SnapshotsActionsTest-937430708 None] Lock "cinder-quobyte-99639d52-10ab-4623-b3fa-6d85a98a6854" released by "delete_snapshot" :: held 1.969s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:21:02 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-ffd37ea4-d4b5-4743-9126-4d399aaf5fb5 tempest-SnapshotsActionsTest-937430708 None] Created reservations ['35c38951-22f5-41a3-91c3-dd4ba77ad0d7', '17b4f74f-03c8-43a3-85e9-117d85937bac', '51661ae9-fdb7-4dfb-98a9-bae00dbaaf4e', 'cac10f4d-c75c-4721-8e7e-69fc408cdf71'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:21:02 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-ffd37ea4-d4b5-4743-9126-4d399aaf5fb5 tempest-SnapshotsActionsTest-937430708 None] Delete snapshot completed successfully. Nov 06 15:21:02 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-ffd37ea4-d4b5-4743-9126-4d399aaf5fb5 tempest-SnapshotsActionsTest-937430708 None] Lock "cinder-3d497599-b520-4122-b3cc-3ced589104dc-delete_snapshot" released by "delete_snapshot" :: held 2.195s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:21:04 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-60427352-8faa-4e31-ab31-8fc1184d521b tempest-SnapshotsActionsTest-597994470 None] Acquiring lock "cinder-74bfe026-fb95-4301-9aa0-75d765313be4-delete_snapshot" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:21:04 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-60427352-8faa-4e31-ab31-8fc1184d521b tempest-SnapshotsActionsTest-597994470 None] Lock "cinder-74bfe026-fb95-4301-9aa0-75d765313be4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:21:04 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-60427352-8faa-4e31-ab31-8fc1184d521b tempest-SnapshotsActionsTest-597994470 None] Acquiring lock "cinder-quobyte-99639d52-10ab-4623-b3fa-6d85a98a6854" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:21:04 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-60427352-8faa-4e31-ab31-8fc1184d521b tempest-SnapshotsActionsTest-597994470 None] Lock "cinder-quobyte-99639d52-10ab-4623-b3fa-6d85a98a6854" acquired by "delete_snapshot" :: waited 0.043s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:21:04 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-60427352-8faa-4e31-ab31-8fc1184d521b tempest-SnapshotsActionsTest-597994470 None] Acquiring lock "cinder-quobyte-74bfe026-fb95-4301-9aa0-75d765313be4" by "_delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:21:04 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-60427352-8faa-4e31-ab31-8fc1184d521b tempest-SnapshotsActionsTest-597994470 None] Lock "cinder-quobyte-74bfe026-fb95-4301-9aa0-75d765313be4" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:21:04 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-60427352-8faa-4e31-ab31-8fc1184d521b tempest-SnapshotsActionsTest-597994470 None] Deleting offline snapshot 74bfe026-fb95-4301-9aa0-75d765313be4 of volume 99639d52-10ab-4623-b3fa-6d85a98a6854 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 15:21:04 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-60427352-8faa-4e31-ab31-8fc1184d521b tempest-SnapshotsActionsTest-597994470 None] snapshot_file for this snap is: volume-99639d52-10ab-4623-b3fa-6d85a98a6854.74bfe026-fb95-4301-9aa0-75d765313be4 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 15:21:04 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[daef4405-d39c-4376-ac24-c62e5cc2157d]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:21:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-60427352-8faa-4e31-ab31-8fc1184d521b tempest-SnapshotsActionsTest-597994470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854.74bfe026-fb95-4301-9aa0-75d765313be4 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:21:05 devstack sudo[91157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854.74bfe026-fb95-4301-9aa0-75d765313be4 Nov 06 15:21:05 devstack sudo[91157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:21:05 devstack sudo[91157]: pam_unix(sudo:session): session closed for user root Nov 06 15:21:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-60427352-8faa-4e31-ab31-8fc1184d521b tempest-SnapshotsActionsTest-597994470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854.74bfe026-fb95-4301-9aa0-75d765313be4" returned: 0 in 0.653s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:21:05 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-60427352-8faa-4e31-ab31-8fc1184d521b tempest-SnapshotsActionsTest-597994470 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-99639d52-10ab-4623-b3fa-6d85a98a6854(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 15:21:05 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[224a0fb5-5f58-4b37-8b39-35edb3147c78]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:21:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-60427352-8faa-4e31-ab31-8fc1184d521b tempest-SnapshotsActionsTest-597994470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:21:05 devstack sudo[91163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854 Nov 06 15:21:05 devstack sudo[91163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:21:06 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e2d4d51-578e-492f-b363-91de85a9e556 tempest-VolumesTransfersTest-1586453716 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:21:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1e2d4d51-578e-492f-b363-91de85a9e556 tempest-VolumesTransfersTest-1586453716 None] Flow 'volume_create_manager' (b8a21fb5-2677-4376-b964-5b3e89a6cafa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:21:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1e2d4d51-578e-492f-b363-91de85a9e556 tempest-VolumesTransfersTest-1586453716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecaca80e-ebd5-4706-bbc4-01e3f3b8de7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:21:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1e2d4d51-578e-492f-b363-91de85a9e556 tempest-VolumesTransfersTest-1586453716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecaca80e-ebd5-4706-bbc4-01e3f3b8de7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:21:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-694914258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=521f3dc2-ff3e-4f6f-84c4-f48a3044f1bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1e838cfc17d49bc8154e7c6c217dae6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:21:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:21:06Z,use_quota=True,user_id='9428882c56564dc08262db234fb09ba4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:21:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1e2d4d51-578e-492f-b363-91de85a9e556 tempest-VolumesTransfersTest-1586453716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5c100eb-7a62-450f-81c1-3858d09ec406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:21:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1e2d4d51-578e-492f-b363-91de85a9e556 tempest-VolumesTransfersTest-1586453716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5c100eb-7a62-450f-81c1-3858d09ec406) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:21:06 devstack sudo[91163]: pam_unix(sudo:session): session closed for user root Nov 06 15:21:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1e2d4d51-578e-492f-b363-91de85a9e556 tempest-VolumesTransfersTest-1586453716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f405649-9bd1-4be8-8e87-0cc5851daec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:21:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1e2d4d51-578e-492f-b363-91de85a9e556 tempest-VolumesTransfersTest-1586453716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f405649-9bd1-4be8-8e87-0cc5851daec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '521f3dc2-ff3e-4f6f-84c4-f48a3044f1bf', 'volume_name': 'volume-521f3dc2-ff3e-4f6f-84c4-f48a3044f1bf', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:21:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1e2d4d51-578e-492f-b363-91de85a9e556 tempest-VolumesTransfersTest-1586453716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (468c79b1-2525-4d5a-beda-8a80e8d67e2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:21:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1e2d4d51-578e-492f-b363-91de85a9e556 tempest-VolumesTransfersTest-1586453716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (468c79b1-2525-4d5a-beda-8a80e8d67e2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:21:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1e2d4d51-578e-492f-b363-91de85a9e556 tempest-VolumesTransfersTest-1586453716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adf08825-caee-42ed-b951-7665ea5abe12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:21:06 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-1e2d4d51-578e-492f-b363-91de85a9e556 tempest-VolumesTransfersTest-1586453716 None] Volume 521f3dc2-ff3e-4f6f-84c4-f48a3044f1bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-521f3dc2-ff3e-4f6f-84c4-f48a3044f1bf', 'volume_size': 1} Nov 06 15:21:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1e2d4d51-578e-492f-b363-91de85a9e556 tempest-VolumesTransfersTest-1586453716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:21:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1e2d4d51-578e-492f-b363-91de85a9e556 tempest-VolumesTransfersTest-1586453716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:21:06 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1e2d4d51-578e-492f-b363-91de85a9e556 tempest-VolumesTransfersTest-1586453716 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:21:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-694914258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=521f3dc2-ff3e-4f6f-84c4-f48a3044f1bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1e838cfc17d49bc8154e7c6c217dae6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:21:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:21:06Z,use_quota=True,user_id='9428882c56564dc08262db234fb09ba4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:21:06 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-1e2d4d51-578e-492f-b363-91de85a9e556 tempest-VolumesTransfersTest-1586453716 None] Creating volume 521f3dc2-ff3e-4f6f-84c4-f48a3044f1bf {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:21:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1e2d4d51-578e-492f-b363-91de85a9e556 tempest-VolumesTransfersTest-1586453716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:21:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1e2d4d51-578e-492f-b363-91de85a9e556 tempest-VolumesTransfersTest-1586453716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:21:06 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1e2d4d51-578e-492f-b363-91de85a9e556 tempest-VolumesTransfersTest-1586453716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:21:06 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1e2d4d51-578e-492f-b363-91de85a9e556 tempest-VolumesTransfersTest-1586453716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:21:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1e2d4d51-578e-492f-b363-91de85a9e556 tempest-VolumesTransfersTest-1586453716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:21:06 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1e2d4d51-578e-492f-b363-91de85a9e556 tempest-VolumesTransfersTest-1586453716 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:21:06 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-1e2d4d51-578e-492f-b363-91de85a9e556 tempest-VolumesTransfersTest-1586453716 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:21:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1e2d4d51-578e-492f-b363-91de85a9e556 tempest-VolumesTransfersTest-1586453716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-521f3dc2-ff3e-4f6f-84c4-f48a3044f1bf 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:21:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-60427352-8faa-4e31-ab31-8fc1184d521b tempest-SnapshotsActionsTest-597994470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854" returned: 0 in 0.678s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:21:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-60427352-8faa-4e31-ab31-8fc1184d521b tempest-SnapshotsActionsTest-597994470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854.74bfe026-fb95-4301-9aa0-75d765313be4 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:21:06 devstack sudo[91168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-521f3dc2-ff3e-4f6f-84c4-f48a3044f1bf 1073741824 Nov 06 15:21:06 devstack sudo[91168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:21:06 devstack sudo[91169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854.74bfe026-fb95-4301-9aa0-75d765313be4 Nov 06 15:21:06 devstack sudo[91169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:21:06 devstack sudo[91169]: pam_unix(sudo:session): session closed for user root Nov 06 15:21:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-60427352-8faa-4e31-ab31-8fc1184d521b tempest-SnapshotsActionsTest-597994470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854.74bfe026-fb95-4301-9aa0-75d765313be4" returned: 0 in 0.413s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:21:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-60427352-8faa-4e31-ab31-8fc1184d521b tempest-SnapshotsActionsTest-597994470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854.74bfe026-fb95-4301-9aa0-75d765313be4 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:21:06 devstack sudo[91179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854.74bfe026-fb95-4301-9aa0-75d765313be4 Nov 06 15:21:06 devstack sudo[91179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:21:06 devstack sudo[91168]: pam_unix(sudo:session): session closed for user root Nov 06 15:21:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1e2d4d51-578e-492f-b363-91de85a9e556 tempest-VolumesTransfersTest-1586453716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-521f3dc2-ff3e-4f6f-84c4-f48a3044f1bf 1073741824" returned: 0 in 0.649s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:21:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1e2d4d51-578e-492f-b363-91de85a9e556 tempest-VolumesTransfersTest-1586453716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-521f3dc2-ff3e-4f6f-84c4-f48a3044f1bf {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:21:07 devstack sudo[91182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-521f3dc2-ff3e-4f6f-84c4-f48a3044f1bf Nov 06 15:21:07 devstack sudo[91182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:21:07 devstack sudo[91179]: pam_unix(sudo:session): session closed for user root Nov 06 15:21:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-60427352-8faa-4e31-ab31-8fc1184d521b tempest-SnapshotsActionsTest-597994470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854.74bfe026-fb95-4301-9aa0-75d765313be4" returned: 0 in 0.426s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:21:07 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-60427352-8faa-4e31-ab31-8fc1184d521b tempest-SnapshotsActionsTest-597994470 None] Lock "cinder-quobyte-74bfe026-fb95-4301-9aa0-75d765313be4" released by "_delete_snapshot" :: held 2.394s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:21:07 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-60427352-8faa-4e31-ab31-8fc1184d521b tempest-SnapshotsActionsTest-597994470 None] Lock "cinder-quobyte-99639d52-10ab-4623-b3fa-6d85a98a6854" released by "delete_snapshot" :: held 2.431s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:21:07 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-60427352-8faa-4e31-ab31-8fc1184d521b tempest-SnapshotsActionsTest-597994470 None] Created reservations ['e12a193c-d04d-4e46-9b7d-203984c8fda7', 'd9c323dd-b480-4165-ac7f-3927efe94f1d', '0b07b542-7278-43b2-a5aa-6839e8010e63', '2ff1e68d-760a-49f1-8d65-781bbfe6e5eb'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:21:07 devstack sudo[91182]: pam_unix(sudo:session): session closed for user root Nov 06 15:21:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1e2d4d51-578e-492f-b363-91de85a9e556 tempest-VolumesTransfersTest-1586453716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-521f3dc2-ff3e-4f6f-84c4-f48a3044f1bf" returned: 0 in 0.362s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:21:07 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1e2d4d51-578e-492f-b363-91de85a9e556 tempest-VolumesTransfersTest-1586453716 None] <== create_volume: return (1088ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:21:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1e2d4d51-578e-492f-b363-91de85a9e556 tempest-VolumesTransfersTest-1586453716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.091s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:21:07 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-60427352-8faa-4e31-ab31-8fc1184d521b tempest-SnapshotsActionsTest-597994470 None] Delete snapshot completed successfully. Nov 06 15:21:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1e2d4d51-578e-492f-b363-91de85a9e556 tempest-VolumesTransfersTest-1586453716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adf08825-caee-42ed-b951-7665ea5abe12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-521f3dc2-ff3e-4f6f-84c4-f48a3044f1bf', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:21:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1e2d4d51-578e-492f-b363-91de85a9e556 tempest-VolumesTransfersTest-1586453716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb7b2659-47dc-4e05-a89e-f2559b660475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:21:07 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-60427352-8faa-4e31-ab31-8fc1184d521b tempest-SnapshotsActionsTest-597994470 None] Lock "cinder-74bfe026-fb95-4301-9aa0-75d765313be4-delete_snapshot" released by "delete_snapshot" :: held 2.661s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:21:07 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-1e2d4d51-578e-492f-b363-91de85a9e556 tempest-VolumesTransfersTest-1586453716 None] Volume volume-521f3dc2-ff3e-4f6f-84c4-f48a3044f1bf (521f3dc2-ff3e-4f6f-84c4-f48a3044f1bf): created successfully Nov 06 15:21:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1e2d4d51-578e-492f-b363-91de85a9e556 tempest-VolumesTransfersTest-1586453716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb7b2659-47dc-4e05-a89e-f2559b660475) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:21:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1e2d4d51-578e-492f-b363-91de85a9e556 tempest-VolumesTransfersTest-1586453716 None] Flow 'volume_create_manager' (b8a21fb5-2677-4376-b964-5b3e89a6cafa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:21:07 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-1e2d4d51-578e-492f-b363-91de85a9e556 tempest-VolumesTransfersTest-1586453716 None] Created volume successfully. Nov 06 15:21:08 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 15:21:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:21:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:21:08 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:21:08 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:21:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:21:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:21:08 devstack sudo[91191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:21:08 devstack sudo[91191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:21:08 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c2da9857-f7f9-4a5e-b2c8-1209ab299ab8 tempest-SnapshotsActionsTest-597994470 None] Acquiring lock "cinder-99639d52-10ab-4623-b3fa-6d85a98a6854-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:21:08 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c2da9857-f7f9-4a5e-b2c8-1209ab299ab8 tempest-SnapshotsActionsTest-597994470 None] Lock "cinder-99639d52-10ab-4623-b3fa-6d85a98a6854-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:21:08 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c2da9857-f7f9-4a5e-b2c8-1209ab299ab8 tempest-SnapshotsActionsTest-597994470 None] Acquiring lock "cinder-quobyte-99639d52-10ab-4623-b3fa-6d85a98a6854" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:21:08 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c2da9857-f7f9-4a5e-b2c8-1209ab299ab8 tempest-SnapshotsActionsTest-597994470 None] Lock "cinder-quobyte-99639d52-10ab-4623-b3fa-6d85a98a6854" acquired by "delete_volume" :: waited 0.021s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:21:08 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[b86e21f8-d077-4998-ab37-1ce236fdb516]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:21:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c2da9857-f7f9-4a5e-b2c8-1209ab299ab8 tempest-SnapshotsActionsTest-597994470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:21:08 devstack sudo[91198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854 Nov 06 15:21:08 devstack sudo[91198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:21:08 devstack sudo[91191]: pam_unix(sudo:session): session closed for user root Nov 06 15:21:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.703s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:21:08 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:21:08 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Running periodic task VolumeManager._thread_info {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 15:21:08 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] thread count: 8 {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 15:21:08 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] thread info: [<_MainThread(MainThread, started 140011251929216)>, , , , , , , ] {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 06 15:21:09 devstack sudo[91198]: pam_unix(sudo:session): session closed for user root Nov 06 15:21:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c2da9857-f7f9-4a5e-b2c8-1209ab299ab8 tempest-SnapshotsActionsTest-597994470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854" returned: 0 in 0.765s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:21:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c2da9857-f7f9-4a5e-b2c8-1209ab299ab8 tempest-SnapshotsActionsTest-597994470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:21:09 devstack sudo[91222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854 Nov 06 15:21:09 devstack sudo[91222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:21:09 devstack sudo[91222]: pam_unix(sudo:session): session closed for user root Nov 06 15:21:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c2da9857-f7f9-4a5e-b2c8-1209ab299ab8 tempest-SnapshotsActionsTest-597994470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-99639d52-10ab-4623-b3fa-6d85a98a6854" returned: 0 in 0.340s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:21:09 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c2da9857-f7f9-4a5e-b2c8-1209ab299ab8 tempest-SnapshotsActionsTest-597994470 None] Lock "cinder-quobyte-99639d52-10ab-4623-b3fa-6d85a98a6854" released by "delete_volume" :: held 1.221s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:21:09 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-c2da9857-f7f9-4a5e-b2c8-1209ab299ab8 tempest-SnapshotsActionsTest-597994470 None] Created reservations ['97774284-681d-4200-8def-31634a0779f2', 'b54f52e6-2716-41a0-a5a6-1557fa789392', 'fb12e398-1334-40b6-a8c7-230cde7f7098', 'b3005ece-5ab3-41d8-a96f-caedc1d677a8'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:21:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c2da9857-f7f9-4a5e-b2c8-1209ab299ab8 tempest-SnapshotsActionsTest-597994470 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:21:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c2da9857-f7f9-4a5e-b2c8-1209ab299ab8 tempest-SnapshotsActionsTest-597994470 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:21:09 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c2da9857-f7f9-4a5e-b2c8-1209ab299ab8 tempest-SnapshotsActionsTest-597994470 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:21:09 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c2da9857-f7f9-4a5e-b2c8-1209ab299ab8 tempest-SnapshotsActionsTest-597994470 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:21:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c2da9857-f7f9-4a5e-b2c8-1209ab299ab8 tempest-SnapshotsActionsTest-597994470 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:21:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c2da9857-f7f9-4a5e-b2c8-1209ab299ab8 tempest-SnapshotsActionsTest-597994470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:21:09 devstack sudo[91226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:21:09 devstack sudo[91226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:21:09 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-924ef675-5ad3-4b5e-ae00-5f50a6eeda83 tempest-VolumesTransfersTest-1595156385 None] Transfer volume completed successfully. Nov 06 15:21:10 devstack sudo[91226]: pam_unix(sudo:session): session closed for user root Nov 06 15:21:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c2da9857-f7f9-4a5e-b2c8-1209ab299ab8 tempest-SnapshotsActionsTest-597994470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.438s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:21:10 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-c2da9857-f7f9-4a5e-b2c8-1209ab299ab8 tempest-SnapshotsActionsTest-597994470 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:21:10 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-c2da9857-f7f9-4a5e-b2c8-1209ab299ab8 tempest-SnapshotsActionsTest-597994470 None] Deleted volume successfully. Nov 06 15:21:10 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c2da9857-f7f9-4a5e-b2c8-1209ab299ab8 tempest-SnapshotsActionsTest-597994470 None] Lock "cinder-99639d52-10ab-4623-b3fa-6d85a98a6854-delete_volume" released by "delete_volume" :: held 2.030s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:21:10 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-905387c9-91fa-4301-bc5d-e4160b662051 tempest-VolumesTransfersTest-1818027108 None] Acquiring lock "cinder-521f3dc2-ff3e-4f6f-84c4-f48a3044f1bf-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:21:10 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-905387c9-91fa-4301-bc5d-e4160b662051 tempest-VolumesTransfersTest-1818027108 None] Lock "cinder-521f3dc2-ff3e-4f6f-84c4-f48a3044f1bf-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:21:10 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-905387c9-91fa-4301-bc5d-e4160b662051 tempest-VolumesTransfersTest-1818027108 None] Acquiring lock "cinder-quobyte-521f3dc2-ff3e-4f6f-84c4-f48a3044f1bf" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:21:10 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-905387c9-91fa-4301-bc5d-e4160b662051 tempest-VolumesTransfersTest-1818027108 None] Lock "cinder-quobyte-521f3dc2-ff3e-4f6f-84c4-f48a3044f1bf" acquired by "delete_volume" :: waited 0.030s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:21:10 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[c39abe7c-9d0d-4695-acd9-3f51d72ea34a]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:21:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-905387c9-91fa-4301-bc5d-e4160b662051 tempest-VolumesTransfersTest-1818027108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-521f3dc2-ff3e-4f6f-84c4-f48a3044f1bf {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:21:11 devstack sudo[91231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-521f3dc2-ff3e-4f6f-84c4-f48a3044f1bf Nov 06 15:21:11 devstack sudo[91231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:21:11 devstack sudo[91231]: pam_unix(sudo:session): session closed for user root Nov 06 15:21:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-905387c9-91fa-4301-bc5d-e4160b662051 tempest-VolumesTransfersTest-1818027108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-521f3dc2-ff3e-4f6f-84c4-f48a3044f1bf" returned: 0 in 0.582s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:21:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-905387c9-91fa-4301-bc5d-e4160b662051 tempest-VolumesTransfersTest-1818027108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-521f3dc2-ff3e-4f6f-84c4-f48a3044f1bf {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:21:11 devstack sudo[91237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-521f3dc2-ff3e-4f6f-84c4-f48a3044f1bf Nov 06 15:21:11 devstack sudo[91237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:21:11 devstack sudo[91237]: pam_unix(sudo:session): session closed for user root Nov 06 15:21:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-905387c9-91fa-4301-bc5d-e4160b662051 tempest-VolumesTransfersTest-1818027108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-521f3dc2-ff3e-4f6f-84c4-f48a3044f1bf" returned: 0 in 0.311s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:21:11 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-905387c9-91fa-4301-bc5d-e4160b662051 tempest-VolumesTransfersTest-1818027108 None] Lock "cinder-quobyte-521f3dc2-ff3e-4f6f-84c4-f48a3044f1bf" released by "delete_volume" :: held 0.962s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:21:11 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-905387c9-91fa-4301-bc5d-e4160b662051 tempest-VolumesTransfersTest-1818027108 None] Created reservations ['9a17b56b-de81-4bc8-883d-236d973a98d7', '97abd344-a32a-443e-8d4a-450aeee35853', '48b7ed60-d85e-4ed2-a96a-cccc6fd3bb8b', '1f00a9ce-e05d-4735-8387-36312198ece8'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:21:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-905387c9-91fa-4301-bc5d-e4160b662051 tempest-VolumesTransfersTest-1818027108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:21:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-905387c9-91fa-4301-bc5d-e4160b662051 tempest-VolumesTransfersTest-1818027108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:21:12 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-905387c9-91fa-4301-bc5d-e4160b662051 tempest-VolumesTransfersTest-1818027108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:21:12 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-905387c9-91fa-4301-bc5d-e4160b662051 tempest-VolumesTransfersTest-1818027108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:21:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-905387c9-91fa-4301-bc5d-e4160b662051 tempest-VolumesTransfersTest-1818027108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:21:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-905387c9-91fa-4301-bc5d-e4160b662051 tempest-VolumesTransfersTest-1818027108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:21:12 devstack sudo[91240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:21:12 devstack sudo[91240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:21:12 devstack sudo[91240]: pam_unix(sudo:session): session closed for user root Nov 06 15:21:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-905387c9-91fa-4301-bc5d-e4160b662051 tempest-VolumesTransfersTest-1818027108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.298s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:21:12 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-905387c9-91fa-4301-bc5d-e4160b662051 tempest-VolumesTransfersTest-1818027108 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:21:12 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-905387c9-91fa-4301-bc5d-e4160b662051 tempest-VolumesTransfersTest-1818027108 None] Deleted volume successfully. Nov 06 15:21:12 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-905387c9-91fa-4301-bc5d-e4160b662051 tempest-VolumesTransfersTest-1818027108 None] Lock "cinder-521f3dc2-ff3e-4f6f-84c4-f48a3044f1bf-delete_volume" released by "delete_volume" :: held 1.630s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:21:12 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b192bb96-b198-4103-a5da-c286e5547b0f tempest-AttachVolumeShelveTestJSON-437798152 None] Acquiring lock "cinder-b8d6e758-dad1-463d-933d-8862c527bca7-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:21:12 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b192bb96-b198-4103-a5da-c286e5547b0f tempest-AttachVolumeShelveTestJSON-437798152 None] Lock "cinder-b8d6e758-dad1-463d-933d-8862c527bca7-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:21:12 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b192bb96-b198-4103-a5da-c286e5547b0f tempest-AttachVolumeShelveTestJSON-437798152 None] Acquiring lock "cinder-quobyte-b8d6e758-dad1-463d-933d-8862c527bca7" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:21:12 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b192bb96-b198-4103-a5da-c286e5547b0f tempest-AttachVolumeShelveTestJSON-437798152 None] Lock "cinder-quobyte-b8d6e758-dad1-463d-933d-8862c527bca7" acquired by "delete_volume" :: waited 0.021s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:21:12 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[61e6c8e2-34ec-45c1-9544-3a974c23f0eb]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:21:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b192bb96-b198-4103-a5da-c286e5547b0f tempest-AttachVolumeShelveTestJSON-437798152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b8d6e758-dad1-463d-933d-8862c527bca7 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:21:12 devstack sudo[91243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b8d6e758-dad1-463d-933d-8862c527bca7 Nov 06 15:21:12 devstack sudo[91243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:21:13 devstack sudo[91243]: pam_unix(sudo:session): session closed for user root Nov 06 15:21:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b192bb96-b198-4103-a5da-c286e5547b0f tempest-AttachVolumeShelveTestJSON-437798152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b8d6e758-dad1-463d-933d-8862c527bca7" returned: 0 in 0.432s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:21:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b192bb96-b198-4103-a5da-c286e5547b0f tempest-AttachVolumeShelveTestJSON-437798152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b8d6e758-dad1-463d-933d-8862c527bca7 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:21:13 devstack sudo[91248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b8d6e758-dad1-463d-933d-8862c527bca7 Nov 06 15:21:13 devstack sudo[91248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:21:13 devstack sudo[91248]: pam_unix(sudo:session): session closed for user root Nov 06 15:21:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b192bb96-b198-4103-a5da-c286e5547b0f tempest-AttachVolumeShelveTestJSON-437798152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b8d6e758-dad1-463d-933d-8862c527bca7" returned: 0 in 0.372s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:21:13 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b192bb96-b198-4103-a5da-c286e5547b0f tempest-AttachVolumeShelveTestJSON-437798152 None] Lock "cinder-quobyte-b8d6e758-dad1-463d-933d-8862c527bca7" released by "delete_volume" :: held 0.859s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:21:13 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-b192bb96-b198-4103-a5da-c286e5547b0f tempest-AttachVolumeShelveTestJSON-437798152 None] Created reservations ['24ad7350-ef8b-4941-995a-d2e63c264ede', '7b5ef7ad-3753-47fa-9976-301cd914aa26', '77007850-5ca4-4c60-8318-76193aa6ccea', 'dd5aa818-c740-4300-9933-60d1e94df961'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:21:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b192bb96-b198-4103-a5da-c286e5547b0f tempest-AttachVolumeShelveTestJSON-437798152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:21:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b192bb96-b198-4103-a5da-c286e5547b0f tempest-AttachVolumeShelveTestJSON-437798152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:21:13 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-b192bb96-b198-4103-a5da-c286e5547b0f tempest-AttachVolumeShelveTestJSON-437798152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:21:13 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-b192bb96-b198-4103-a5da-c286e5547b0f tempest-AttachVolumeShelveTestJSON-437798152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:21:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b192bb96-b198-4103-a5da-c286e5547b0f tempest-AttachVolumeShelveTestJSON-437798152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:21:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b192bb96-b198-4103-a5da-c286e5547b0f tempest-AttachVolumeShelveTestJSON-437798152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:21:13 devstack sudo[91251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:21:13 devstack sudo[91251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:21:13 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-da6db129-a5b4-4685-a396-14568b6ffd33 tempest-VolumesTransfersTest-1586453716 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:21:13 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-da6db129-a5b4-4685-a396-14568b6ffd33 tempest-VolumesTransfersTest-1586453716 None] Flow 'volume_create_manager' (31b73141-2b6b-4cef-aabb-d92c70ca1fe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:21:13 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-da6db129-a5b4-4685-a396-14568b6ffd33 tempest-VolumesTransfersTest-1586453716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a461b3fc-3dcd-40ae-95f0-1ba6ccbc6027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:21:13 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-da6db129-a5b4-4685-a396-14568b6ffd33 tempest-VolumesTransfersTest-1586453716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a461b3fc-3dcd-40ae-95f0-1ba6ccbc6027) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:21:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1562448299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13cb0aa1-2765-467e-b978-28cfd7cf34c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1e838cfc17d49bc8154e7c6c217dae6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:21:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:21:14Z,use_quota=True,user_id='9428882c56564dc08262db234fb09ba4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:21:13 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-da6db129-a5b4-4685-a396-14568b6ffd33 tempest-VolumesTransfersTest-1586453716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0197dbb-d53c-47c6-8418-6483b1dd74e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:21:13 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-da6db129-a5b4-4685-a396-14568b6ffd33 tempest-VolumesTransfersTest-1586453716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0197dbb-d53c-47c6-8418-6483b1dd74e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:21:13 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-da6db129-a5b4-4685-a396-14568b6ffd33 tempest-VolumesTransfersTest-1586453716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71a96c1c-9b58-4d02-a9db-c7d463d84735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:21:13 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-da6db129-a5b4-4685-a396-14568b6ffd33 tempest-VolumesTransfersTest-1586453716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71a96c1c-9b58-4d02-a9db-c7d463d84735) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13cb0aa1-2765-467e-b978-28cfd7cf34c6', 'volume_name': 'volume-13cb0aa1-2765-467e-b978-28cfd7cf34c6', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:21:13 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-da6db129-a5b4-4685-a396-14568b6ffd33 tempest-VolumesTransfersTest-1586453716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (208bcdfa-d082-4ff4-8f77-adb676fd2ef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:21:14 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-da6db129-a5b4-4685-a396-14568b6ffd33 tempest-VolumesTransfersTest-1586453716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (208bcdfa-d082-4ff4-8f77-adb676fd2ef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:21:14 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-da6db129-a5b4-4685-a396-14568b6ffd33 tempest-VolumesTransfersTest-1586453716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a949246-452f-4e9f-9438-9e8db8d72fad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:21:14 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-da6db129-a5b4-4685-a396-14568b6ffd33 tempest-VolumesTransfersTest-1586453716 None] Volume 13cb0aa1-2765-467e-b978-28cfd7cf34c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13cb0aa1-2765-467e-b978-28cfd7cf34c6', 'volume_size': 1} Nov 06 15:21:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-da6db129-a5b4-4685-a396-14568b6ffd33 tempest-VolumesTransfersTest-1586453716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:21:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-da6db129-a5b4-4685-a396-14568b6ffd33 tempest-VolumesTransfersTest-1586453716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:21:14 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-da6db129-a5b4-4685-a396-14568b6ffd33 tempest-VolumesTransfersTest-1586453716 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:21:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1562448299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13cb0aa1-2765-467e-b978-28cfd7cf34c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1e838cfc17d49bc8154e7c6c217dae6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:21:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:21:14Z,use_quota=True,user_id='9428882c56564dc08262db234fb09ba4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:21:14 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-da6db129-a5b4-4685-a396-14568b6ffd33 tempest-VolumesTransfersTest-1586453716 None] Creating volume 13cb0aa1-2765-467e-b978-28cfd7cf34c6 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:21:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-da6db129-a5b4-4685-a396-14568b6ffd33 tempest-VolumesTransfersTest-1586453716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:21:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-da6db129-a5b4-4685-a396-14568b6ffd33 tempest-VolumesTransfersTest-1586453716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:21:14 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-da6db129-a5b4-4685-a396-14568b6ffd33 tempest-VolumesTransfersTest-1586453716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:21:14 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-da6db129-a5b4-4685-a396-14568b6ffd33 tempest-VolumesTransfersTest-1586453716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:21:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-da6db129-a5b4-4685-a396-14568b6ffd33 tempest-VolumesTransfersTest-1586453716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:21:14 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-da6db129-a5b4-4685-a396-14568b6ffd33 tempest-VolumesTransfersTest-1586453716 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:21:14 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-da6db129-a5b4-4685-a396-14568b6ffd33 tempest-VolumesTransfersTest-1586453716 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:21:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-da6db129-a5b4-4685-a396-14568b6ffd33 tempest-VolumesTransfersTest-1586453716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-13cb0aa1-2765-467e-b978-28cfd7cf34c6 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:21:14 devstack sudo[91253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-13cb0aa1-2765-467e-b978-28cfd7cf34c6 1073741824 Nov 06 15:21:14 devstack sudo[91253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:21:14 devstack sudo[91251]: pam_unix(sudo:session): session closed for user root Nov 06 15:21:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b192bb96-b198-4103-a5da-c286e5547b0f tempest-AttachVolumeShelveTestJSON-437798152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.475s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:21:14 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-b192bb96-b198-4103-a5da-c286e5547b0f tempest-AttachVolumeShelveTestJSON-437798152 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:21:14 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-b192bb96-b198-4103-a5da-c286e5547b0f tempest-AttachVolumeShelveTestJSON-437798152 None] Deleted volume successfully. Nov 06 15:21:14 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b192bb96-b198-4103-a5da-c286e5547b0f tempest-AttachVolumeShelveTestJSON-437798152 None] Lock "cinder-b8d6e758-dad1-463d-933d-8862c527bca7-delete_volume" released by "delete_volume" :: held 1.648s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:21:14 devstack sudo[91253]: pam_unix(sudo:session): session closed for user root Nov 06 15:21:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-da6db129-a5b4-4685-a396-14568b6ffd33 tempest-VolumesTransfersTest-1586453716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-13cb0aa1-2765-467e-b978-28cfd7cf34c6 1073741824" returned: 0 in 0.638s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:21:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-da6db129-a5b4-4685-a396-14568b6ffd33 tempest-VolumesTransfersTest-1586453716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-13cb0aa1-2765-467e-b978-28cfd7cf34c6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:21:14 devstack sudo[91261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-13cb0aa1-2765-467e-b978-28cfd7cf34c6 Nov 06 15:21:14 devstack sudo[91261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:21:15 devstack sudo[91261]: pam_unix(sudo:session): session closed for user root Nov 06 15:21:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-da6db129-a5b4-4685-a396-14568b6ffd33 tempest-VolumesTransfersTest-1586453716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-13cb0aa1-2765-467e-b978-28cfd7cf34c6" returned: 0 in 0.346s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:21:15 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-da6db129-a5b4-4685-a396-14568b6ffd33 tempest-VolumesTransfersTest-1586453716 None] <== create_volume: return (1050ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:21:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-da6db129-a5b4-4685-a396-14568b6ffd33 tempest-VolumesTransfersTest-1586453716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.057s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:21:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-da6db129-a5b4-4685-a396-14568b6ffd33 tempest-VolumesTransfersTest-1586453716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a949246-452f-4e9f-9438-9e8db8d72fad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13cb0aa1-2765-467e-b978-28cfd7cf34c6', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:21:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-da6db129-a5b4-4685-a396-14568b6ffd33 tempest-VolumesTransfersTest-1586453716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (284eed3c-3aa4-4687-8565-760788cb1f93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:21:15 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-da6db129-a5b4-4685-a396-14568b6ffd33 tempest-VolumesTransfersTest-1586453716 None] Volume volume-13cb0aa1-2765-467e-b978-28cfd7cf34c6 (13cb0aa1-2765-467e-b978-28cfd7cf34c6): created successfully Nov 06 15:21:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-da6db129-a5b4-4685-a396-14568b6ffd33 tempest-VolumesTransfersTest-1586453716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (284eed3c-3aa4-4687-8565-760788cb1f93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:21:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-da6db129-a5b4-4685-a396-14568b6ffd33 tempest-VolumesTransfersTest-1586453716 None] Flow 'volume_create_manager' (31b73141-2b6b-4cef-aabb-d92c70ca1fe5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:21:15 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-da6db129-a5b4-4685-a396-14568b6ffd33 tempest-VolumesTransfersTest-1586453716 None] Created volume successfully. Nov 06 15:21:16 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-3581ec31-f0a0-4f0a-956b-315924388f0d tempest-VolumesTransfersTest-1818027108 None] Acquiring lock "cinder-13cb0aa1-2765-467e-b978-28cfd7cf34c6-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:21:16 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-3581ec31-f0a0-4f0a-956b-315924388f0d tempest-VolumesTransfersTest-1818027108 None] Lock "cinder-13cb0aa1-2765-467e-b978-28cfd7cf34c6-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:21:16 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-3581ec31-f0a0-4f0a-956b-315924388f0d tempest-VolumesTransfersTest-1818027108 None] Acquiring lock "cinder-quobyte-13cb0aa1-2765-467e-b978-28cfd7cf34c6" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:21:16 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-3581ec31-f0a0-4f0a-956b-315924388f0d tempest-VolumesTransfersTest-1818027108 None] Lock "cinder-quobyte-13cb0aa1-2765-467e-b978-28cfd7cf34c6" acquired by "delete_volume" :: waited 0.027s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:21:16 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7a35e59-179d-4af1-8b7a-b0dab8e034c8]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:21:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3581ec31-f0a0-4f0a-956b-315924388f0d tempest-VolumesTransfersTest-1818027108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-13cb0aa1-2765-467e-b978-28cfd7cf34c6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:21:16 devstack sudo[91266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-13cb0aa1-2765-467e-b978-28cfd7cf34c6 Nov 06 15:21:16 devstack sudo[91266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:21:17 devstack sudo[91266]: pam_unix(sudo:session): session closed for user root Nov 06 15:21:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3581ec31-f0a0-4f0a-956b-315924388f0d tempest-VolumesTransfersTest-1818027108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-13cb0aa1-2765-467e-b978-28cfd7cf34c6" returned: 0 in 0.529s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:21:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3581ec31-f0a0-4f0a-956b-315924388f0d tempest-VolumesTransfersTest-1818027108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-13cb0aa1-2765-467e-b978-28cfd7cf34c6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:21:17 devstack sudo[91271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-13cb0aa1-2765-467e-b978-28cfd7cf34c6 Nov 06 15:21:17 devstack sudo[91271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:21:17 devstack sudo[91271]: pam_unix(sudo:session): session closed for user root Nov 06 15:21:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3581ec31-f0a0-4f0a-956b-315924388f0d tempest-VolumesTransfersTest-1818027108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-13cb0aa1-2765-467e-b978-28cfd7cf34c6" returned: 0 in 0.299s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:21:17 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-3581ec31-f0a0-4f0a-956b-315924388f0d tempest-VolumesTransfersTest-1818027108 None] Lock "cinder-quobyte-13cb0aa1-2765-467e-b978-28cfd7cf34c6" released by "delete_volume" :: held 0.893s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:21:17 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-3581ec31-f0a0-4f0a-956b-315924388f0d tempest-VolumesTransfersTest-1818027108 None] Created reservations ['8d1e3b78-1800-41e1-a51e-40bd75258747', '239a186d-71ba-4276-bebc-0ddcf3cc509c', 'b996cf63-a4e7-4e47-81ca-01a26af68a63', '8e8a3156-2ab8-4f69-8ed7-132840ce160c'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:21:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3581ec31-f0a0-4f0a-956b-315924388f0d tempest-VolumesTransfersTest-1818027108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:21:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3581ec31-f0a0-4f0a-956b-315924388f0d tempest-VolumesTransfersTest-1818027108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:21:17 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3581ec31-f0a0-4f0a-956b-315924388f0d tempest-VolumesTransfersTest-1818027108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:21:17 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3581ec31-f0a0-4f0a-956b-315924388f0d tempest-VolumesTransfersTest-1818027108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:21:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3581ec31-f0a0-4f0a-956b-315924388f0d tempest-VolumesTransfersTest-1818027108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:21:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3581ec31-f0a0-4f0a-956b-315924388f0d tempest-VolumesTransfersTest-1818027108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:21:17 devstack sudo[91291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:21:17 devstack sudo[91291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:21:17 devstack sudo[91291]: pam_unix(sudo:session): session closed for user root Nov 06 15:21:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3581ec31-f0a0-4f0a-956b-315924388f0d tempest-VolumesTransfersTest-1818027108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.303s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:21:17 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-3581ec31-f0a0-4f0a-956b-315924388f0d tempest-VolumesTransfersTest-1818027108 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:21:17 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-3581ec31-f0a0-4f0a-956b-315924388f0d tempest-VolumesTransfersTest-1818027108 None] Deleted volume successfully. Nov 06 15:21:17 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-3581ec31-f0a0-4f0a-956b-315924388f0d tempest-VolumesTransfersTest-1818027108 None] Lock "cinder-13cb0aa1-2765-467e-b978-28cfd7cf34c6-delete_volume" released by "delete_volume" :: held 1.478s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:21:23 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ef736e60-428f-42a0-b0dd-8599368aa5ba tempest-BackendsCapabilitiesAdminTestsJSON-1504898120 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.3763389587402, 'free_capacity_gb': 1773.3763389587402, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87132) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 06 15:21:23 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6d93b7c4-3bc4-4522-9a52-3075b0332a49 tempest-BackendsCapabilitiesAdminTestsJSON-1504898120 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.3763389587402, 'free_capacity_gb': 1773.3763389587402, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87132) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 06 15:21:27 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:UPDATE=75,cinder:SELECT=73,cinder:INSERT=20,cinder:DELETE=2 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 15:21:27 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:SELECT=65,cinder:UPDATE=91,cinder:DELETE=10,cinder:INSERT=25 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 15:21:27 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-6725691d-2710-46e3-96d1-ad033d99026d tempest-VolumesTransfersV357Test-1247977270 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:21:27 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6725691d-2710-46e3-96d1-ad033d99026d tempest-VolumesTransfersV357Test-1247977270 None] Flow 'volume_create_manager' (c97b7b17-c16a-4ae2-a59c-12b88ecaa607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:21:27 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6725691d-2710-46e3-96d1-ad033d99026d tempest-VolumesTransfersV357Test-1247977270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdaaf0d5-a0ae-46da-834f-50df08d49d97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:21:27 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6725691d-2710-46e3-96d1-ad033d99026d tempest-VolumesTransfersV357Test-1247977270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdaaf0d5-a0ae-46da-834f-50df08d49d97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:21:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2115692995',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65cd4295-d307-4fd4-a064-483b5579a9ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5223c1bed8204506b66cba4878386704',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:21:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:21:28Z,use_quota=True,user_id='35f280fb106041aab26e15b5b2f08bba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:21:27 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6725691d-2710-46e3-96d1-ad033d99026d tempest-VolumesTransfersV357Test-1247977270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84129469-6e75-481b-9d74-c3e93c42a319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:21:27 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6725691d-2710-46e3-96d1-ad033d99026d tempest-VolumesTransfersV357Test-1247977270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84129469-6e75-481b-9d74-c3e93c42a319) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:21:27 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6725691d-2710-46e3-96d1-ad033d99026d tempest-VolumesTransfersV357Test-1247977270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (406d0eee-f6e0-4547-82d3-6931f079347c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:21:27 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6725691d-2710-46e3-96d1-ad033d99026d tempest-VolumesTransfersV357Test-1247977270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (406d0eee-f6e0-4547-82d3-6931f079347c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65cd4295-d307-4fd4-a064-483b5579a9ab', 'volume_name': 'volume-65cd4295-d307-4fd4-a064-483b5579a9ab', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:21:28 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6725691d-2710-46e3-96d1-ad033d99026d tempest-VolumesTransfersV357Test-1247977270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abafc65a-6958-4012-928d-8674f329cc44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:21:28 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6725691d-2710-46e3-96d1-ad033d99026d tempest-VolumesTransfersV357Test-1247977270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abafc65a-6958-4012-928d-8674f329cc44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:21:28 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6725691d-2710-46e3-96d1-ad033d99026d tempest-VolumesTransfersV357Test-1247977270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (138b7a87-d57a-46c1-b023-03808a387b35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:21:28 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-6725691d-2710-46e3-96d1-ad033d99026d tempest-VolumesTransfersV357Test-1247977270 None] Volume 65cd4295-d307-4fd4-a064-483b5579a9ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65cd4295-d307-4fd4-a064-483b5579a9ab', 'volume_size': 1} Nov 06 15:21:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6725691d-2710-46e3-96d1-ad033d99026d tempest-VolumesTransfersV357Test-1247977270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:21:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6725691d-2710-46e3-96d1-ad033d99026d tempest-VolumesTransfersV357Test-1247977270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:21:28 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-6725691d-2710-46e3-96d1-ad033d99026d tempest-VolumesTransfersV357Test-1247977270 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:21:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2115692995',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65cd4295-d307-4fd4-a064-483b5579a9ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5223c1bed8204506b66cba4878386704',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:21:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:21:28Z,use_quota=True,user_id='35f280fb106041aab26e15b5b2f08bba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:21:28 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-6725691d-2710-46e3-96d1-ad033d99026d tempest-VolumesTransfersV357Test-1247977270 None] Creating volume 65cd4295-d307-4fd4-a064-483b5579a9ab {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:21:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6725691d-2710-46e3-96d1-ad033d99026d tempest-VolumesTransfersV357Test-1247977270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:21:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6725691d-2710-46e3-96d1-ad033d99026d tempest-VolumesTransfersV357Test-1247977270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:21:28 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-6725691d-2710-46e3-96d1-ad033d99026d tempest-VolumesTransfersV357Test-1247977270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:21:28 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-6725691d-2710-46e3-96d1-ad033d99026d tempest-VolumesTransfersV357Test-1247977270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:21:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6725691d-2710-46e3-96d1-ad033d99026d tempest-VolumesTransfersV357Test-1247977270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:21:28 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-6725691d-2710-46e3-96d1-ad033d99026d tempest-VolumesTransfersV357Test-1247977270 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:21:28 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-6725691d-2710-46e3-96d1-ad033d99026d tempest-VolumesTransfersV357Test-1247977270 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:21:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6725691d-2710-46e3-96d1-ad033d99026d tempest-VolumesTransfersV357Test-1247977270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-65cd4295-d307-4fd4-a064-483b5579a9ab 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:21:28 devstack sudo[91299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-65cd4295-d307-4fd4-a064-483b5579a9ab 1073741824 Nov 06 15:21:28 devstack sudo[91299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:21:28 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3e1591f-5038-463e-84f7-c24c5e74a5c9 tempest-ServerActionsTestOtherA-1409404420 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:21:28 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f3e1591f-5038-463e-84f7-c24c5e74a5c9 tempest-ServerActionsTestOtherA-1409404420 None] Flow 'volume_create_manager' (a28ec66a-d352-476c-895e-6b733a2854d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:21:28 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f3e1591f-5038-463e-84f7-c24c5e74a5c9 tempest-ServerActionsTestOtherA-1409404420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9516999-2d53-446d-bcc9-80b3d51af1b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:21:28 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f3e1591f-5038-463e-84f7-c24c5e74a5c9 tempest-ServerActionsTestOtherA-1409404420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9516999-2d53-446d-bcc9-80b3d51af1b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:21:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1847958376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=135c21e6-615b-4d80-81f0-bfac6e82d15c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4c45cbd16f1414ba252851d8d5359a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:21:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:21:28Z,use_quota=True,user_id='95de706326aa49ae829d0ac2fbb07e4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:21:28 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f3e1591f-5038-463e-84f7-c24c5e74a5c9 tempest-ServerActionsTestOtherA-1409404420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (471698c1-b0ea-4a14-b224-23537c41fbf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:21:28 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f3e1591f-5038-463e-84f7-c24c5e74a5c9 tempest-ServerActionsTestOtherA-1409404420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (471698c1-b0ea-4a14-b224-23537c41fbf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:21:28 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f3e1591f-5038-463e-84f7-c24c5e74a5c9 tempest-ServerActionsTestOtherA-1409404420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1714181-1e8e-4c26-a12e-e1be1e8111f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:21:28 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f3e1591f-5038-463e-84f7-c24c5e74a5c9 tempest-ServerActionsTestOtherA-1409404420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1714181-1e8e-4c26-a12e-e1be1e8111f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '135c21e6-615b-4d80-81f0-bfac6e82d15c', 'volume_name': 'volume-135c21e6-615b-4d80-81f0-bfac6e82d15c', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:21:28 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f3e1591f-5038-463e-84f7-c24c5e74a5c9 tempest-ServerActionsTestOtherA-1409404420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f866abb-802a-4772-aa75-ae55623e3783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:21:28 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f3e1591f-5038-463e-84f7-c24c5e74a5c9 tempest-ServerActionsTestOtherA-1409404420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f866abb-802a-4772-aa75-ae55623e3783) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:21:28 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f3e1591f-5038-463e-84f7-c24c5e74a5c9 tempest-ServerActionsTestOtherA-1409404420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a922a7a5-5224-4849-91e4-c965bd3a5748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:21:28 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-f3e1591f-5038-463e-84f7-c24c5e74a5c9 tempest-ServerActionsTestOtherA-1409404420 None] Volume 135c21e6-615b-4d80-81f0-bfac6e82d15c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-135c21e6-615b-4d80-81f0-bfac6e82d15c', 'volume_size': 1} Nov 06 15:21:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f3e1591f-5038-463e-84f7-c24c5e74a5c9 tempest-ServerActionsTestOtherA-1409404420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:21:28 devstack sudo[91299]: pam_unix(sudo:session): session closed for user root Nov 06 15:21:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6725691d-2710-46e3-96d1-ad033d99026d tempest-VolumesTransfersV357Test-1247977270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-65cd4295-d307-4fd4-a064-483b5579a9ab 1073741824" returned: 0 in 0.603s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:21:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6725691d-2710-46e3-96d1-ad033d99026d tempest-VolumesTransfersV357Test-1247977270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-65cd4295-d307-4fd4-a064-483b5579a9ab {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:21:28 devstack sudo[91305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-65cd4295-d307-4fd4-a064-483b5579a9ab Nov 06 15:21:28 devstack sudo[91305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:21:29 devstack sudo[91305]: pam_unix(sudo:session): session closed for user root Nov 06 15:21:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6725691d-2710-46e3-96d1-ad033d99026d tempest-VolumesTransfersV357Test-1247977270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-65cd4295-d307-4fd4-a064-483b5579a9ab" returned: 0 in 0.374s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:21:29 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-6725691d-2710-46e3-96d1-ad033d99026d tempest-VolumesTransfersV357Test-1247977270 None] <== create_volume: return (1027ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:21:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6725691d-2710-46e3-96d1-ad033d99026d tempest-VolumesTransfersV357Test-1247977270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.033s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:21:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f3e1591f-5038-463e-84f7-c24c5e74a5c9 tempest-ServerActionsTestOtherA-1409404420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.637s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:21:29 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-f3e1591f-5038-463e-84f7-c24c5e74a5c9 tempest-ServerActionsTestOtherA-1409404420 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:21:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1847958376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=135c21e6-615b-4d80-81f0-bfac6e82d15c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4c45cbd16f1414ba252851d8d5359a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:21:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:21:28Z,use_quota=True,user_id='95de706326aa49ae829d0ac2fbb07e4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:21:29 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-f3e1591f-5038-463e-84f7-c24c5e74a5c9 tempest-ServerActionsTestOtherA-1409404420 None] Creating volume 135c21e6-615b-4d80-81f0-bfac6e82d15c {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:21:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f3e1591f-5038-463e-84f7-c24c5e74a5c9 tempest-ServerActionsTestOtherA-1409404420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:21:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f3e1591f-5038-463e-84f7-c24c5e74a5c9 tempest-ServerActionsTestOtherA-1409404420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:21:29 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-f3e1591f-5038-463e-84f7-c24c5e74a5c9 tempest-ServerActionsTestOtherA-1409404420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:21:29 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-f3e1591f-5038-463e-84f7-c24c5e74a5c9 tempest-ServerActionsTestOtherA-1409404420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:21:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f3e1591f-5038-463e-84f7-c24c5e74a5c9 tempest-ServerActionsTestOtherA-1409404420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:21:29 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-f3e1591f-5038-463e-84f7-c24c5e74a5c9 tempest-ServerActionsTestOtherA-1409404420 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:21:29 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-f3e1591f-5038-463e-84f7-c24c5e74a5c9 tempest-ServerActionsTestOtherA-1409404420 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:21:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f3e1591f-5038-463e-84f7-c24c5e74a5c9 tempest-ServerActionsTestOtherA-1409404420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-135c21e6-615b-4d80-81f0-bfac6e82d15c 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:21:29 devstack sudo[91308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-135c21e6-615b-4d80-81f0-bfac6e82d15c 1073741824 Nov 06 15:21:29 devstack sudo[91308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:21:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6725691d-2710-46e3-96d1-ad033d99026d tempest-VolumesTransfersV357Test-1247977270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (138b7a87-d57a-46c1-b023-03808a387b35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65cd4295-d307-4fd4-a064-483b5579a9ab', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:21:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6725691d-2710-46e3-96d1-ad033d99026d tempest-VolumesTransfersV357Test-1247977270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f229cb70-a438-4b53-a593-c9ebdecf0db1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:21:29 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-6725691d-2710-46e3-96d1-ad033d99026d tempest-VolumesTransfersV357Test-1247977270 None] Volume volume-65cd4295-d307-4fd4-a064-483b5579a9ab (65cd4295-d307-4fd4-a064-483b5579a9ab): created successfully Nov 06 15:21:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6725691d-2710-46e3-96d1-ad033d99026d tempest-VolumesTransfersV357Test-1247977270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f229cb70-a438-4b53-a593-c9ebdecf0db1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:21:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6725691d-2710-46e3-96d1-ad033d99026d tempest-VolumesTransfersV357Test-1247977270 None] Flow 'volume_create_manager' (c97b7b17-c16a-4ae2-a59c-12b88ecaa607) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:21:29 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-6725691d-2710-46e3-96d1-ad033d99026d tempest-VolumesTransfersV357Test-1247977270 None] Created volume successfully. Nov 06 15:21:29 devstack sudo[91308]: pam_unix(sudo:session): session closed for user root Nov 06 15:21:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f3e1591f-5038-463e-84f7-c24c5e74a5c9 tempest-ServerActionsTestOtherA-1409404420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-135c21e6-615b-4d80-81f0-bfac6e82d15c 1073741824" returned: 0 in 0.565s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:21:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f3e1591f-5038-463e-84f7-c24c5e74a5c9 tempest-ServerActionsTestOtherA-1409404420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-135c21e6-615b-4d80-81f0-bfac6e82d15c {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:21:29 devstack sudo[91314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-135c21e6-615b-4d80-81f0-bfac6e82d15c Nov 06 15:21:29 devstack sudo[91314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:21:30 devstack sudo[91314]: pam_unix(sudo:session): session closed for user root Nov 06 15:21:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f3e1591f-5038-463e-84f7-c24c5e74a5c9 tempest-ServerActionsTestOtherA-1409404420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-135c21e6-615b-4d80-81f0-bfac6e82d15c" returned: 0 in 0.474s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:21:30 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-f3e1591f-5038-463e-84f7-c24c5e74a5c9 tempest-ServerActionsTestOtherA-1409404420 None] <== create_volume: return (1099ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:21:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f3e1591f-5038-463e-84f7-c24c5e74a5c9 tempest-ServerActionsTestOtherA-1409404420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.104s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:21:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f3e1591f-5038-463e-84f7-c24c5e74a5c9 tempest-ServerActionsTestOtherA-1409404420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a922a7a5-5224-4849-91e4-c965bd3a5748) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-135c21e6-615b-4d80-81f0-bfac6e82d15c', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:21:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f3e1591f-5038-463e-84f7-c24c5e74a5c9 tempest-ServerActionsTestOtherA-1409404420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (309b83df-5e5c-4ad8-9da2-02eb40b45ab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:21:30 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-f3e1591f-5038-463e-84f7-c24c5e74a5c9 tempest-ServerActionsTestOtherA-1409404420 None] Volume volume-135c21e6-615b-4d80-81f0-bfac6e82d15c (135c21e6-615b-4d80-81f0-bfac6e82d15c): created successfully Nov 06 15:21:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f3e1591f-5038-463e-84f7-c24c5e74a5c9 tempest-ServerActionsTestOtherA-1409404420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (309b83df-5e5c-4ad8-9da2-02eb40b45ab2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:21:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f3e1591f-5038-463e-84f7-c24c5e74a5c9 tempest-ServerActionsTestOtherA-1409404420 None] Flow 'volume_create_manager' (a28ec66a-d352-476c-895e-6b733a2854d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:21:30 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-f3e1591f-5038-463e-84f7-c24c5e74a5c9 tempest-ServerActionsTestOtherA-1409404420 None] Created volume successfully. Nov 06 15:21:31 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-bc5eb6b2-9337-427b-981e-074bfff89fe0 tempest-GroupSnapshotsTest-1169672434 None] Group tempest-GroupSnapshotsTest-Group-1713340239: creating Nov 06 15:21:31 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-c3b9905f-053a-406a-aa64-912451a4ce73 tempest-VolumesTransfersV357Test-1911419293 None] Transfer volume completed successfully. Nov 06 15:21:31 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-bc5eb6b2-9337-427b-981e-074bfff89fe0 tempest-GroupSnapshotsTest-1169672434 None] Group tempest-GroupSnapshotsTest-Group-1713340239: created successfully Nov 06 15:21:31 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-bc5eb6b2-9337-427b-981e-074bfff89fe0 tempest-GroupSnapshotsTest-1169672434 None] Create group completed successfully. Nov 06 15:21:31 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-0ea180d4-311d-4456-916f-185d35f628c6 tempest-VolumesTransfersV357Test-544611594 None] Acquiring lock "cinder-65cd4295-d307-4fd4-a064-483b5579a9ab-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:21:31 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-0ea180d4-311d-4456-916f-185d35f628c6 tempest-VolumesTransfersV357Test-544611594 None] Lock "cinder-65cd4295-d307-4fd4-a064-483b5579a9ab-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:21:32 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-0ea180d4-311d-4456-916f-185d35f628c6 tempest-VolumesTransfersV357Test-544611594 None] Acquiring lock "cinder-quobyte-65cd4295-d307-4fd4-a064-483b5579a9ab" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:21:32 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-0ea180d4-311d-4456-916f-185d35f628c6 tempest-VolumesTransfersV357Test-544611594 None] Lock "cinder-quobyte-65cd4295-d307-4fd4-a064-483b5579a9ab" acquired by "delete_volume" :: waited 0.016s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:21:32 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a49758b-3d8a-41fc-879a-e9e92c219004]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:21:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0ea180d4-311d-4456-916f-185d35f628c6 tempest-VolumesTransfersV357Test-544611594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-65cd4295-d307-4fd4-a064-483b5579a9ab {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:21:32 devstack sudo[91320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-65cd4295-d307-4fd4-a064-483b5579a9ab Nov 06 15:21:32 devstack sudo[91320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:21:32 devstack sudo[91320]: pam_unix(sudo:session): session closed for user root Nov 06 15:21:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0ea180d4-311d-4456-916f-185d35f628c6 tempest-VolumesTransfersV357Test-544611594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-65cd4295-d307-4fd4-a064-483b5579a9ab" returned: 0 in 0.510s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:21:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0ea180d4-311d-4456-916f-185d35f628c6 tempest-VolumesTransfersV357Test-544611594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-65cd4295-d307-4fd4-a064-483b5579a9ab {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:21:32 devstack sudo[91328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-65cd4295-d307-4fd4-a064-483b5579a9ab Nov 06 15:21:32 devstack sudo[91328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:21:32 devstack sudo[91328]: pam_unix(sudo:session): session closed for user root Nov 06 15:21:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0ea180d4-311d-4456-916f-185d35f628c6 tempest-VolumesTransfersV357Test-544611594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-65cd4295-d307-4fd4-a064-483b5579a9ab" returned: 0 in 0.407s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:21:33 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-0ea180d4-311d-4456-916f-185d35f628c6 tempest-VolumesTransfersV357Test-544611594 None] Lock "cinder-quobyte-65cd4295-d307-4fd4-a064-483b5579a9ab" released by "delete_volume" :: held 1.013s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:21:33 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b2121f1-59e9-421e-b37f-0ef274c50c83 tempest-GroupSnapshotsTest-1169672434 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:21:33 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2b2121f1-59e9-421e-b37f-0ef274c50c83 tempest-GroupSnapshotsTest-1169672434 None] Flow 'volume_create_manager' (777d2a4a-6caa-4f50-8874-8e22349b3563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:21:33 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2b2121f1-59e9-421e-b37f-0ef274c50c83 tempest-GroupSnapshotsTest-1169672434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cad71ff4-cc73-4f3b-8eb4-4241a39055b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:21:33 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2b2121f1-59e9-421e-b37f-0ef274c50c83 tempest-GroupSnapshotsTest-1169672434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cad71ff4-cc73-4f3b-8eb4-4241a39055b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:21:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1266099707',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=95d9db9c-de3d-463f-b1ef-df0fde0b610f,host='devstack@QuobyteHD#QuobyteHD',id=58110c7f-fac1-4b1b-a0d6-10d1cc9fcec8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df60dde68c6c4ecb9ae1da55ae49b1d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:21:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:21:33Z,use_quota=True,user_id='5c43bea8dd194538a5806a4085a0a9bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c2de515-c96b-4e88-aa94-001c3d5a4680),volume_type_id=2c2de515-c96b-4e88-aa94-001c3d5a4680)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:21:33 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2b2121f1-59e9-421e-b37f-0ef274c50c83 tempest-GroupSnapshotsTest-1169672434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a81526ed-70c1-45dc-86c0-2085add940d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:21:33 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2b2121f1-59e9-421e-b37f-0ef274c50c83 tempest-GroupSnapshotsTest-1169672434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a81526ed-70c1-45dc-86c0-2085add940d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:21:33 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2b2121f1-59e9-421e-b37f-0ef274c50c83 tempest-GroupSnapshotsTest-1169672434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6378132f-6fea-4c0a-bd3c-eb140674a2d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:21:33 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2b2121f1-59e9-421e-b37f-0ef274c50c83 tempest-GroupSnapshotsTest-1169672434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6378132f-6fea-4c0a-bd3c-eb140674a2d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58110c7f-fac1-4b1b-a0d6-10d1cc9fcec8', 'volume_name': 'volume-58110c7f-fac1-4b1b-a0d6-10d1cc9fcec8', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:21:33 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2b2121f1-59e9-421e-b37f-0ef274c50c83 tempest-GroupSnapshotsTest-1169672434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ccd3da7-aeb5-4434-948c-43206fc94b91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:21:33 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2b2121f1-59e9-421e-b37f-0ef274c50c83 tempest-GroupSnapshotsTest-1169672434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ccd3da7-aeb5-4434-948c-43206fc94b91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:21:33 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2b2121f1-59e9-421e-b37f-0ef274c50c83 tempest-GroupSnapshotsTest-1169672434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e356ae51-e39a-4432-97e8-030e2f069ba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:21:33 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-2b2121f1-59e9-421e-b37f-0ef274c50c83 tempest-GroupSnapshotsTest-1169672434 None] Volume 58110c7f-fac1-4b1b-a0d6-10d1cc9fcec8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58110c7f-fac1-4b1b-a0d6-10d1cc9fcec8', 'volume_size': 1} Nov 06 15:21:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-2b2121f1-59e9-421e-b37f-0ef274c50c83 tempest-GroupSnapshotsTest-1169672434 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:21:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-2b2121f1-59e9-421e-b37f-0ef274c50c83 tempest-GroupSnapshotsTest-1169672434 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:21:33 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-2b2121f1-59e9-421e-b37f-0ef274c50c83 tempest-GroupSnapshotsTest-1169672434 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=95d9db9c-de3d-463f-b1ef-df0fde0b610f,created_at=2026-11-06T14:21:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1266099707',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=95d9db9c-de3d-463f-b1ef-df0fde0b610f,host='devstack@QuobyteHD#QuobyteHD',id=58110c7f-fac1-4b1b-a0d6-10d1cc9fcec8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df60dde68c6c4ecb9ae1da55ae49b1d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:21:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:21:33Z,use_quota=True,user_id='5c43bea8dd194538a5806a4085a0a9bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c2de515-c96b-4e88-aa94-001c3d5a4680),volume_type_id=2c2de515-c96b-4e88-aa94-001c3d5a4680)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:21:33 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-2b2121f1-59e9-421e-b37f-0ef274c50c83 tempest-GroupSnapshotsTest-1169672434 None] Creating volume 58110c7f-fac1-4b1b-a0d6-10d1cc9fcec8 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:21:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-2b2121f1-59e9-421e-b37f-0ef274c50c83 tempest-GroupSnapshotsTest-1169672434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:21:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-2b2121f1-59e9-421e-b37f-0ef274c50c83 tempest-GroupSnapshotsTest-1169672434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:21:33 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-2b2121f1-59e9-421e-b37f-0ef274c50c83 tempest-GroupSnapshotsTest-1169672434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:21:33 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-2b2121f1-59e9-421e-b37f-0ef274c50c83 tempest-GroupSnapshotsTest-1169672434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:21:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-2b2121f1-59e9-421e-b37f-0ef274c50c83 tempest-GroupSnapshotsTest-1169672434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:21:33 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-2b2121f1-59e9-421e-b37f-0ef274c50c83 tempest-GroupSnapshotsTest-1169672434 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:21:33 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-2b2121f1-59e9-421e-b37f-0ef274c50c83 tempest-GroupSnapshotsTest-1169672434 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:21:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2b2121f1-59e9-421e-b37f-0ef274c50c83 tempest-GroupSnapshotsTest-1169672434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-58110c7f-fac1-4b1b-a0d6-10d1cc9fcec8 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:21:33 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-0ea180d4-311d-4456-916f-185d35f628c6 tempest-VolumesTransfersV357Test-544611594 None] Created reservations ['56c2a4e8-5e95-4c91-b7eb-e46b8b913f26', 'f723661c-163d-4bc9-aa0c-ad3f59ff2911', 'ecda4034-5257-4c57-911d-957f2d57948e', 'b08e722b-2b06-48c3-ba13-c0bd24183adb'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:21:33 devstack sudo[91331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-58110c7f-fac1-4b1b-a0d6-10d1cc9fcec8 1073741824 Nov 06 15:21:33 devstack sudo[91331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:21:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0ea180d4-311d-4456-916f-185d35f628c6 tempest-VolumesTransfersV357Test-544611594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:21:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0ea180d4-311d-4456-916f-185d35f628c6 tempest-VolumesTransfersV357Test-544611594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:21:33 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0ea180d4-311d-4456-916f-185d35f628c6 tempest-VolumesTransfersV357Test-544611594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:21:33 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0ea180d4-311d-4456-916f-185d35f628c6 tempest-VolumesTransfersV357Test-544611594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:21:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0ea180d4-311d-4456-916f-185d35f628c6 tempest-VolumesTransfersV357Test-544611594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:21:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0ea180d4-311d-4456-916f-185d35f628c6 tempest-VolumesTransfersV357Test-544611594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:21:33 devstack sudo[91333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:21:33 devstack sudo[91333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:21:33 devstack sudo[91333]: pam_unix(sudo:session): session closed for user root Nov 06 15:21:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0ea180d4-311d-4456-916f-185d35f628c6 tempest-VolumesTransfersV357Test-544611594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.399s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:21:33 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-0ea180d4-311d-4456-916f-185d35f628c6 tempest-VolumesTransfersV357Test-544611594 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:21:33 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-0ea180d4-311d-4456-916f-185d35f628c6 tempest-VolumesTransfersV357Test-544611594 None] Deleted volume successfully. Nov 06 15:21:33 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-0ea180d4-311d-4456-916f-185d35f628c6 tempest-VolumesTransfersV357Test-544611594 None] Lock "cinder-65cd4295-d307-4fd4-a064-483b5579a9ab-delete_volume" released by "delete_volume" :: held 1.844s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:21:34 devstack sudo[91331]: pam_unix(sudo:session): session closed for user root Nov 06 15:21:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2b2121f1-59e9-421e-b37f-0ef274c50c83 tempest-GroupSnapshotsTest-1169672434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-58110c7f-fac1-4b1b-a0d6-10d1cc9fcec8 1073741824" returned: 0 in 0.779s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:21:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2b2121f1-59e9-421e-b37f-0ef274c50c83 tempest-GroupSnapshotsTest-1169672434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-58110c7f-fac1-4b1b-a0d6-10d1cc9fcec8 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:21:34 devstack sudo[91351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-58110c7f-fac1-4b1b-a0d6-10d1cc9fcec8 Nov 06 15:21:34 devstack sudo[91351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:21:34 devstack sudo[91351]: pam_unix(sudo:session): session closed for user root Nov 06 15:21:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2b2121f1-59e9-421e-b37f-0ef274c50c83 tempest-GroupSnapshotsTest-1169672434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-58110c7f-fac1-4b1b-a0d6-10d1cc9fcec8" returned: 0 in 0.394s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:21:34 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-2b2121f1-59e9-421e-b37f-0ef274c50c83 tempest-GroupSnapshotsTest-1169672434 None] <== create_volume: return (1247ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:21:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-2b2121f1-59e9-421e-b37f-0ef274c50c83 tempest-GroupSnapshotsTest-1169672434 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.249s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:21:34 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2b2121f1-59e9-421e-b37f-0ef274c50c83 tempest-GroupSnapshotsTest-1169672434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e356ae51-e39a-4432-97e8-030e2f069ba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58110c7f-fac1-4b1b-a0d6-10d1cc9fcec8', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:21:34 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2b2121f1-59e9-421e-b37f-0ef274c50c83 tempest-GroupSnapshotsTest-1169672434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4e0ea29-326d-4524-802a-e76a674b2a0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:21:34 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-2b2121f1-59e9-421e-b37f-0ef274c50c83 tempest-GroupSnapshotsTest-1169672434 None] Volume volume-58110c7f-fac1-4b1b-a0d6-10d1cc9fcec8 (58110c7f-fac1-4b1b-a0d6-10d1cc9fcec8): created successfully Nov 06 15:21:34 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2b2121f1-59e9-421e-b37f-0ef274c50c83 tempest-GroupSnapshotsTest-1169672434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4e0ea29-326d-4524-802a-e76a674b2a0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:21:34 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2b2121f1-59e9-421e-b37f-0ef274c50c83 tempest-GroupSnapshotsTest-1169672434 None] Flow 'volume_create_manager' (777d2a4a-6caa-4f50-8874-8e22349b3563) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:21:34 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-2b2121f1-59e9-421e-b37f-0ef274c50c83 tempest-GroupSnapshotsTest-1169672434 None] Created volume successfully. Nov 06 15:21:35 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-5392b4ed-c6db-46a3-b5d7-f89fd4c5b01b tempest-VolumesTransfersV357Test-1247977270 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:21:35 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5392b4ed-c6db-46a3-b5d7-f89fd4c5b01b tempest-VolumesTransfersV357Test-1247977270 None] Flow 'volume_create_manager' (63c02193-e749-46cb-a5d8-10739d6216ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:21:35 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5392b4ed-c6db-46a3-b5d7-f89fd4c5b01b tempest-VolumesTransfersV357Test-1247977270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34e6f229-8104-438f-ab3a-64efb370f737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:21:35 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5392b4ed-c6db-46a3-b5d7-f89fd4c5b01b tempest-VolumesTransfersV357Test-1247977270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34e6f229-8104-438f-ab3a-64efb370f737) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:21:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-30956621',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a074f05-85f7-4623-81fa-8e173039501d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5223c1bed8204506b66cba4878386704',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:21:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:21:35Z,use_quota=True,user_id='35f280fb106041aab26e15b5b2f08bba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:21:35 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5392b4ed-c6db-46a3-b5d7-f89fd4c5b01b tempest-VolumesTransfersV357Test-1247977270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84403f8e-7eea-4177-a709-314763f2221d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:21:35 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5392b4ed-c6db-46a3-b5d7-f89fd4c5b01b tempest-VolumesTransfersV357Test-1247977270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84403f8e-7eea-4177-a709-314763f2221d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:21:35 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5392b4ed-c6db-46a3-b5d7-f89fd4c5b01b tempest-VolumesTransfersV357Test-1247977270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c11a9926-f4ad-4ed0-948f-a93c2e10c687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:21:35 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5392b4ed-c6db-46a3-b5d7-f89fd4c5b01b tempest-VolumesTransfersV357Test-1247977270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c11a9926-f4ad-4ed0-948f-a93c2e10c687) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a074f05-85f7-4623-81fa-8e173039501d', 'volume_name': 'volume-5a074f05-85f7-4623-81fa-8e173039501d', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:21:35 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5392b4ed-c6db-46a3-b5d7-f89fd4c5b01b tempest-VolumesTransfersV357Test-1247977270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28d7652d-64fe-4149-bfbd-b088f2399fed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:21:35 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5392b4ed-c6db-46a3-b5d7-f89fd4c5b01b tempest-VolumesTransfersV357Test-1247977270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28d7652d-64fe-4149-bfbd-b088f2399fed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:21:35 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5392b4ed-c6db-46a3-b5d7-f89fd4c5b01b tempest-VolumesTransfersV357Test-1247977270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (647ad9b9-87e2-40af-8f2d-4d2014e979cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:21:35 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-5392b4ed-c6db-46a3-b5d7-f89fd4c5b01b tempest-VolumesTransfersV357Test-1247977270 None] Volume 5a074f05-85f7-4623-81fa-8e173039501d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a074f05-85f7-4623-81fa-8e173039501d', 'volume_size': 1} Nov 06 15:21:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5392b4ed-c6db-46a3-b5d7-f89fd4c5b01b tempest-VolumesTransfersV357Test-1247977270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:21:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5392b4ed-c6db-46a3-b5d7-f89fd4c5b01b tempest-VolumesTransfersV357Test-1247977270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:21:35 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-5392b4ed-c6db-46a3-b5d7-f89fd4c5b01b tempest-VolumesTransfersV357Test-1247977270 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:21:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-30956621',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a074f05-85f7-4623-81fa-8e173039501d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5223c1bed8204506b66cba4878386704',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:21:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:21:35Z,use_quota=True,user_id='35f280fb106041aab26e15b5b2f08bba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:21:35 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-5392b4ed-c6db-46a3-b5d7-f89fd4c5b01b tempest-VolumesTransfersV357Test-1247977270 None] Creating volume 5a074f05-85f7-4623-81fa-8e173039501d {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:21:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5392b4ed-c6db-46a3-b5d7-f89fd4c5b01b tempest-VolumesTransfersV357Test-1247977270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:21:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5392b4ed-c6db-46a3-b5d7-f89fd4c5b01b tempest-VolumesTransfersV357Test-1247977270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:21:35 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-5392b4ed-c6db-46a3-b5d7-f89fd4c5b01b tempest-VolumesTransfersV357Test-1247977270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:21:35 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-5392b4ed-c6db-46a3-b5d7-f89fd4c5b01b tempest-VolumesTransfersV357Test-1247977270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:21:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5392b4ed-c6db-46a3-b5d7-f89fd4c5b01b tempest-VolumesTransfersV357Test-1247977270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:21:35 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-5392b4ed-c6db-46a3-b5d7-f89fd4c5b01b tempest-VolumesTransfersV357Test-1247977270 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:21:35 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-5392b4ed-c6db-46a3-b5d7-f89fd4c5b01b tempest-VolumesTransfersV357Test-1247977270 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:21:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5392b4ed-c6db-46a3-b5d7-f89fd4c5b01b tempest-VolumesTransfersV357Test-1247977270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-5a074f05-85f7-4623-81fa-8e173039501d 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:21:35 devstack sudo[91361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-5a074f05-85f7-4623-81fa-8e173039501d 1073741824 Nov 06 15:21:35 devstack sudo[91361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:21:35 devstack sudo[91361]: pam_unix(sudo:session): session closed for user root Nov 06 15:21:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5392b4ed-c6db-46a3-b5d7-f89fd4c5b01b tempest-VolumesTransfersV357Test-1247977270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-5a074f05-85f7-4623-81fa-8e173039501d 1073741824" returned: 0 in 0.517s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:21:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5392b4ed-c6db-46a3-b5d7-f89fd4c5b01b tempest-VolumesTransfersV357Test-1247977270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-5a074f05-85f7-4623-81fa-8e173039501d {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:21:35 devstack sudo[91366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-5a074f05-85f7-4623-81fa-8e173039501d Nov 06 15:21:35 devstack sudo[91366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:21:35 devstack sudo[91366]: pam_unix(sudo:session): session closed for user root Nov 06 15:21:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5392b4ed-c6db-46a3-b5d7-f89fd4c5b01b tempest-VolumesTransfersV357Test-1247977270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-5a074f05-85f7-4623-81fa-8e173039501d" returned: 0 in 0.312s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:21:35 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-5392b4ed-c6db-46a3-b5d7-f89fd4c5b01b tempest-VolumesTransfersV357Test-1247977270 None] <== create_volume: return (884ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:21:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5392b4ed-c6db-46a3-b5d7-f89fd4c5b01b tempest-VolumesTransfersV357Test-1247977270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.887s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:21:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5392b4ed-c6db-46a3-b5d7-f89fd4c5b01b tempest-VolumesTransfersV357Test-1247977270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (647ad9b9-87e2-40af-8f2d-4d2014e979cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a074f05-85f7-4623-81fa-8e173039501d', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:21:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5392b4ed-c6db-46a3-b5d7-f89fd4c5b01b tempest-VolumesTransfersV357Test-1247977270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad6853a4-2965-4191-b151-fbba15870526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:21:36 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-5392b4ed-c6db-46a3-b5d7-f89fd4c5b01b tempest-VolumesTransfersV357Test-1247977270 None] Volume volume-5a074f05-85f7-4623-81fa-8e173039501d (5a074f05-85f7-4623-81fa-8e173039501d): created successfully Nov 06 15:21:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5392b4ed-c6db-46a3-b5d7-f89fd4c5b01b tempest-VolumesTransfersV357Test-1247977270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad6853a4-2965-4191-b151-fbba15870526) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:21:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5392b4ed-c6db-46a3-b5d7-f89fd4c5b01b tempest-VolumesTransfersV357Test-1247977270 None] Flow 'volume_create_manager' (63c02193-e749-46cb-a5d8-10739d6216ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:21:36 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-5392b4ed-c6db-46a3-b5d7-f89fd4c5b01b tempest-VolumesTransfersV357Test-1247977270 None] Created volume successfully. Nov 06 15:21:36 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-30abac0d-ebd2-46c8-89f2-8e7e4de85941 tempest-GroupSnapshotsTest-1169672434 None] GroupSnapshot 15210300-f62a-4cb5-9d20-2d2923dccf5c: creating. Nov 06 15:21:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-30abac0d-ebd2-46c8-89f2-8e7e4de85941 tempest-GroupSnapshotsTest-1169672434 None] Group snapshot 15210300-f62a-4cb5-9d20-2d2923dccf5c: creating. {{(pid=87132) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 06 15:21:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-30abac0d-ebd2-46c8-89f2-8e7e4de85941 tempest-GroupSnapshotsTest-1169672434 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:21:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-30abac0d-ebd2-46c8-89f2-8e7e4de85941 tempest-GroupSnapshotsTest-1169672434 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:21:36 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-30abac0d-ebd2-46c8-89f2-8e7e4de85941 tempest-GroupSnapshotsTest-1169672434 None] Creating offline snapshot 80fa5e86-4637-4f1b-8736-10e2fb6efc73 of volume 58110c7f-fac1-4b1b-a0d6-10d1cc9fcec8 {{(pid=87132) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 15:21:36 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[05ae3fe1-2959-4538-b067-8f74fec2e9d9]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:21:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-30abac0d-ebd2-46c8-89f2-8e7e4de85941 tempest-GroupSnapshotsTest-1169672434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-58110c7f-fac1-4b1b-a0d6-10d1cc9fcec8 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:21:36 devstack sudo[91370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-58110c7f-fac1-4b1b-a0d6-10d1cc9fcec8 Nov 06 15:21:36 devstack sudo[91370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:21:36 devstack sudo[91370]: pam_unix(sudo:session): session closed for user root Nov 06 15:21:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-30abac0d-ebd2-46c8-89f2-8e7e4de85941 tempest-GroupSnapshotsTest-1169672434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-58110c7f-fac1-4b1b-a0d6-10d1cc9fcec8" returned: 0 in 0.400s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:21:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-30abac0d-ebd2-46c8-89f2-8e7e4de85941 tempest-GroupSnapshotsTest-1169672434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-58110c7f-fac1-4b1b-a0d6-10d1cc9fcec8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-58110c7f-fac1-4b1b-a0d6-10d1cc9fcec8.80fa5e86-4637-4f1b-8736-10e2fb6efc73 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:21:36 devstack sudo[91376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-58110c7f-fac1-4b1b-a0d6-10d1cc9fcec8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-58110c7f-fac1-4b1b-a0d6-10d1cc9fcec8.80fa5e86-4637-4f1b-8736-10e2fb6efc73 1G Nov 06 15:21:36 devstack sudo[91376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:21:37 devstack sudo[91376]: pam_unix(sudo:session): session closed for user root Nov 06 15:21:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-30abac0d-ebd2-46c8-89f2-8e7e4de85941 tempest-GroupSnapshotsTest-1169672434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-58110c7f-fac1-4b1b-a0d6-10d1cc9fcec8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-58110c7f-fac1-4b1b-a0d6-10d1cc9fcec8.80fa5e86-4637-4f1b-8736-10e2fb6efc73 1G" returned: 0 in 0.975s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:21:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-30abac0d-ebd2-46c8-89f2-8e7e4de85941 tempest-GroupSnapshotsTest-1169672434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58110c7f-fac1-4b1b-a0d6-10d1cc9fcec8 -F qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-58110c7f-fac1-4b1b-a0d6-10d1cc9fcec8.80fa5e86-4637-4f1b-8736-10e2fb6efc73 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:21:37 devstack sudo[91422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58110c7f-fac1-4b1b-a0d6-10d1cc9fcec8 -F qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-58110c7f-fac1-4b1b-a0d6-10d1cc9fcec8.80fa5e86-4637-4f1b-8736-10e2fb6efc73 Nov 06 15:21:37 devstack sudo[91422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:21:38 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-3e9d6f86-2d18-425c-8316-c0fff4f082b6 tempest-VolumesTransfersV357Test-544611594 None] Acquiring lock "cinder-5a074f05-85f7-4623-81fa-8e173039501d-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:21:38 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-3e9d6f86-2d18-425c-8316-c0fff4f082b6 tempest-VolumesTransfersV357Test-544611594 None] Lock "cinder-5a074f05-85f7-4623-81fa-8e173039501d-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:21:38 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-3e9d6f86-2d18-425c-8316-c0fff4f082b6 tempest-VolumesTransfersV357Test-544611594 None] Acquiring lock "cinder-quobyte-5a074f05-85f7-4623-81fa-8e173039501d" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:21:38 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-3e9d6f86-2d18-425c-8316-c0fff4f082b6 tempest-VolumesTransfersV357Test-544611594 None] Lock "cinder-quobyte-5a074f05-85f7-4623-81fa-8e173039501d" acquired by "delete_volume" :: waited 0.028s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:21:38 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[78905a08-90c3-4846-959d-4eeb78c1959d]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:21:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3e9d6f86-2d18-425c-8316-c0fff4f082b6 tempest-VolumesTransfersV357Test-544611594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-5a074f05-85f7-4623-81fa-8e173039501d {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:21:38 devstack sudo[91422]: pam_unix(sudo:session): session closed for user root Nov 06 15:21:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-30abac0d-ebd2-46c8-89f2-8e7e4de85941 tempest-GroupSnapshotsTest-1169672434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58110c7f-fac1-4b1b-a0d6-10d1cc9fcec8 -F qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-58110c7f-fac1-4b1b-a0d6-10d1cc9fcec8.80fa5e86-4637-4f1b-8736-10e2fb6efc73" returned: 0 in 0.634s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:21:38 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-30abac0d-ebd2-46c8-89f2-8e7e4de85941 tempest-GroupSnapshotsTest-1169672434 None] /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-58110c7f-fac1-4b1b-a0d6-10d1cc9fcec8.80fa5e86-4637-4f1b-8736-10e2fb6efc73 is being set with open permissions: ugo+rw: NotImplementedError Nov 06 15:21:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-30abac0d-ebd2-46c8-89f2-8e7e4de85941 tempest-GroupSnapshotsTest-1169672434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-58110c7f-fac1-4b1b-a0d6-10d1cc9fcec8.80fa5e86-4637-4f1b-8736-10e2fb6efc73 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:21:38 devstack sudo[91429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-58110c7f-fac1-4b1b-a0d6-10d1cc9fcec8.80fa5e86-4637-4f1b-8736-10e2fb6efc73 Nov 06 15:21:38 devstack sudo[91429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:21:38 devstack sudo[91428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-5a074f05-85f7-4623-81fa-8e173039501d Nov 06 15:21:38 devstack sudo[91428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:21:38 devstack sudo[91429]: pam_unix(sudo:session): session closed for user root Nov 06 15:21:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-30abac0d-ebd2-46c8-89f2-8e7e4de85941 tempest-GroupSnapshotsTest-1169672434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-58110c7f-fac1-4b1b-a0d6-10d1cc9fcec8.80fa5e86-4637-4f1b-8736-10e2fb6efc73" returned: 0 in 0.322s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:21:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-30abac0d-ebd2-46c8-89f2-8e7e4de85941 tempest-GroupSnapshotsTest-1169672434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-58110c7f-fac1-4b1b-a0d6-10d1cc9fcec8.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:21:38 devstack sudo[91434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-58110c7f-fac1-4b1b-a0d6-10d1cc9fcec8.info Nov 06 15:21:38 devstack sudo[91434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:21:38 devstack sudo[91428]: pam_unix(sudo:session): session closed for user root Nov 06 15:21:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3e9d6f86-2d18-425c-8316-c0fff4f082b6 tempest-VolumesTransfersV357Test-544611594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-5a074f05-85f7-4623-81fa-8e173039501d" returned: 0 in 0.733s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:21:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3e9d6f86-2d18-425c-8316-c0fff4f082b6 tempest-VolumesTransfersV357Test-544611594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-5a074f05-85f7-4623-81fa-8e173039501d {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:21:38 devstack sudo[91434]: pam_unix(sudo:session): session closed for user root Nov 06 15:21:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-30abac0d-ebd2-46c8-89f2-8e7e4de85941 tempest-GroupSnapshotsTest-1169672434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-58110c7f-fac1-4b1b-a0d6-10d1cc9fcec8.info" returned: 0 in 0.395s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:21:39 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-30abac0d-ebd2-46c8-89f2-8e7e4de85941 tempest-GroupSnapshotsTest-1169672434 None] /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-58110c7f-fac1-4b1b-a0d6-10d1cc9fcec8.info is being set with open permissions: ugo+rw: NotImplementedError Nov 06 15:21:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-30abac0d-ebd2-46c8-89f2-8e7e4de85941 tempest-GroupSnapshotsTest-1169672434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-58110c7f-fac1-4b1b-a0d6-10d1cc9fcec8.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:21:39 devstack sudo[91442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-5a074f05-85f7-4623-81fa-8e173039501d Nov 06 15:21:39 devstack sudo[91442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:21:39 devstack sudo[91444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-58110c7f-fac1-4b1b-a0d6-10d1cc9fcec8.info Nov 06 15:21:39 devstack sudo[91444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:21:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-30abac0d-ebd2-46c8-89f2-8e7e4de85941 tempest-GroupSnapshotsTest-1169672434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-58110c7f-fac1-4b1b-a0d6-10d1cc9fcec8.info" returned: 0 in 0.499s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:21:39 devstack sudo[91444]: pam_unix(sudo:session): session closed for user root Nov 06 15:21:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-30abac0d-ebd2-46c8-89f2-8e7e4de85941 tempest-GroupSnapshotsTest-1169672434 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.349s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:21:39 devstack sudo[91442]: pam_unix(sudo:session): session closed for user root Nov 06 15:21:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3e9d6f86-2d18-425c-8316-c0fff4f082b6 tempest-VolumesTransfersV357Test-544611594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-5a074f05-85f7-4623-81fa-8e173039501d" returned: 0 in 0.628s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:21:39 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-3e9d6f86-2d18-425c-8316-c0fff4f082b6 tempest-VolumesTransfersV357Test-544611594 None] Lock "cinder-quobyte-5a074f05-85f7-4623-81fa-8e173039501d" released by "delete_volume" :: held 1.457s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:21:39 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-3e9d6f86-2d18-425c-8316-c0fff4f082b6 tempest-VolumesTransfersV357Test-544611594 None] Created reservations ['2e38c35c-44f8-4906-80ce-09fe03730318', 'd41a443e-9528-4140-87b9-e6e5833efaf2', '20d654db-e62d-4134-a09a-0cc9b0932e62', '3992dabb-02ce-4195-ab4b-6b04092a91dd'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:21:39 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-30abac0d-ebd2-46c8-89f2-8e7e4de85941 tempest-GroupSnapshotsTest-1169672434 None] group_snapshot 15210300-f62a-4cb5-9d20-2d2923dccf5c: created successfully Nov 06 15:21:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3e9d6f86-2d18-425c-8316-c0fff4f082b6 tempest-VolumesTransfersV357Test-544611594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:21:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3e9d6f86-2d18-425c-8316-c0fff4f082b6 tempest-VolumesTransfersV357Test-544611594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:21:39 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3e9d6f86-2d18-425c-8316-c0fff4f082b6 tempest-VolumesTransfersV357Test-544611594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:21:39 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3e9d6f86-2d18-425c-8316-c0fff4f082b6 tempest-VolumesTransfersV357Test-544611594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:21:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3e9d6f86-2d18-425c-8316-c0fff4f082b6 tempest-VolumesTransfersV357Test-544611594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:21:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3e9d6f86-2d18-425c-8316-c0fff4f082b6 tempest-VolumesTransfersV357Test-544611594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:21:39 devstack sudo[91449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:21:39 devstack sudo[91449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:21:40 devstack sudo[91449]: pam_unix(sudo:session): session closed for user root Nov 06 15:21:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3e9d6f86-2d18-425c-8316-c0fff4f082b6 tempest-VolumesTransfersV357Test-544611594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.306s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:21:40 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-3e9d6f86-2d18-425c-8316-c0fff4f082b6 tempest-VolumesTransfersV357Test-544611594 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:21:40 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-3e9d6f86-2d18-425c-8316-c0fff4f082b6 tempest-VolumesTransfersV357Test-544611594 None] Deleted volume successfully. Nov 06 15:21:40 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-3e9d6f86-2d18-425c-8316-c0fff4f082b6 tempest-VolumesTransfersV357Test-544611594 None] Lock "cinder-5a074f05-85f7-4623-81fa-8e173039501d-delete_volume" released by "delete_volume" :: held 2.086s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:21:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c192728e-e1bb-4f4f-956b-e8ce92460a34 tempest-GroupSnapshotsTest-1169672434 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:21:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c192728e-e1bb-4f4f-956b-e8ce92460a34 tempest-GroupSnapshotsTest-1169672434 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:21:42 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c192728e-e1bb-4f4f-956b-e8ce92460a34 tempest-GroupSnapshotsTest-1169672434 None] Acquiring lock "cinder-quobyte-80fa5e86-4637-4f1b-8736-10e2fb6efc73-efaf4140-5b85-46f3-a8dc-b11ad8694bfc" by "_create_volume_from_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:21:42 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c192728e-e1bb-4f4f-956b-e8ce92460a34 tempest-GroupSnapshotsTest-1169672434 None] Lock "cinder-quobyte-80fa5e86-4637-4f1b-8736-10e2fb6efc73-efaf4140-5b85-46f3-a8dc-b11ad8694bfc" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:21:42 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c192728e-e1bb-4f4f-956b-e8ce92460a34 tempest-GroupSnapshotsTest-1169672434 None] Creating volume efaf4140-5b85-46f3-a8dc-b11ad8694bfc from snapshot 80fa5e86-4637-4f1b-8736-10e2fb6efc73 {{(pid=87132) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 06 15:21:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c192728e-e1bb-4f4f-956b-e8ce92460a34 tempest-GroupSnapshotsTest-1169672434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:21:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c192728e-e1bb-4f4f-956b-e8ce92460a34 tempest-GroupSnapshotsTest-1169672434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:21:42 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c192728e-e1bb-4f4f-956b-e8ce92460a34 tempest-GroupSnapshotsTest-1169672434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:21:42 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c192728e-e1bb-4f4f-956b-e8ce92460a34 tempest-GroupSnapshotsTest-1169672434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:21:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c192728e-e1bb-4f4f-956b-e8ce92460a34 tempest-GroupSnapshotsTest-1169672434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:21:42 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c192728e-e1bb-4f4f-956b-e8ce92460a34 tempest-GroupSnapshotsTest-1169672434 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:21:42 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c192728e-e1bb-4f4f-956b-e8ce92460a34 tempest-GroupSnapshotsTest-1169672434 None] Acquiring lock "cinder-quobyte-efaf4140-5b85-46f3-a8dc-b11ad8694bfc" by "_copy_volume_from_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:21:42 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c192728e-e1bb-4f4f-956b-e8ce92460a34 tempest-GroupSnapshotsTest-1169672434 None] Lock "cinder-quobyte-efaf4140-5b85-46f3-a8dc-b11ad8694bfc" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:21:42 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c192728e-e1bb-4f4f-956b-e8ce92460a34 tempest-GroupSnapshotsTest-1169672434 None] snapshot: 80fa5e86-4637-4f1b-8736-10e2fb6efc73, volume: efaf4140-5b85-46f3-a8dc-b11ad8694bfc, {{(pid=87132) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 06 15:21:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c192728e-e1bb-4f4f-956b-e8ce92460a34 tempest-GroupSnapshotsTest-1169672434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:21:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c192728e-e1bb-4f4f-956b-e8ce92460a34 tempest-GroupSnapshotsTest-1169672434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:21:42 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c192728e-e1bb-4f4f-956b-e8ce92460a34 tempest-GroupSnapshotsTest-1169672434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:21:42 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c192728e-e1bb-4f4f-956b-e8ce92460a34 tempest-GroupSnapshotsTest-1169672434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:21:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c192728e-e1bb-4f4f-956b-e8ce92460a34 tempest-GroupSnapshotsTest-1169672434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:21:42 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8da738d-fb03-4ace-8ae8-cc462a66469a]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:21:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c192728e-e1bb-4f4f-956b-e8ce92460a34 tempest-GroupSnapshotsTest-1169672434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-58110c7f-fac1-4b1b-a0d6-10d1cc9fcec8.80fa5e86-4637-4f1b-8736-10e2fb6efc73 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:21:42 devstack sudo[91452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-58110c7f-fac1-4b1b-a0d6-10d1cc9fcec8.80fa5e86-4637-4f1b-8736-10e2fb6efc73 Nov 06 15:21:42 devstack sudo[91452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:21:42 devstack sudo[91452]: pam_unix(sudo:session): session closed for user root Nov 06 15:21:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c192728e-e1bb-4f4f-956b-e8ce92460a34 tempest-GroupSnapshotsTest-1169672434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-58110c7f-fac1-4b1b-a0d6-10d1cc9fcec8.80fa5e86-4637-4f1b-8736-10e2fb6efc73" returned: 0 in 0.610s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:21:42 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-c192728e-e1bb-4f4f-956b-e8ce92460a34 tempest-GroupSnapshotsTest-1169672434 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-58110c7f-fac1-4b1b-a0d6-10d1cc9fcec8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 15:21:42 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d3fa9bd-5e1d-4dee-a5da-de8f01966ff4]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:21:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c192728e-e1bb-4f4f-956b-e8ce92460a34 tempest-GroupSnapshotsTest-1169672434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-58110c7f-fac1-4b1b-a0d6-10d1cc9fcec8 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:21:42 devstack sudo[91458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-58110c7f-fac1-4b1b-a0d6-10d1cc9fcec8 Nov 06 15:21:42 devstack sudo[91458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:21:43 devstack sudo[91458]: pam_unix(sudo:session): session closed for user root Nov 06 15:21:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c192728e-e1bb-4f4f-956b-e8ce92460a34 tempest-GroupSnapshotsTest-1169672434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-58110c7f-fac1-4b1b-a0d6-10d1cc9fcec8" returned: 0 in 0.528s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:21:43 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c192728e-e1bb-4f4f-956b-e8ce92460a34 tempest-GroupSnapshotsTest-1169672434 None] will copy from snapshot at /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-58110c7f-fac1-4b1b-a0d6-10d1cc9fcec8 {{(pid=87132) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 06 15:21:43 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c192728e-e1bb-4f4f-956b-e8ce92460a34 tempest-GroupSnapshotsTest-1169672434 None] Creating direct copy from snapshot {{(pid=87132) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 06 15:21:43 devstack cinder-volume[87132]: DEBUG cinder.utils [None req-c192728e-e1bb-4f4f-956b-e8ce92460a34 tempest-GroupSnapshotsTest-1169672434 None] Path /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-efaf4140-5b85-46f3-a8dc-b11ad8694bfc not found in is_blk_device check {{(pid=87132) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 06 15:21:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c192728e-e1bb-4f4f-956b-e8ce92460a34 tempest-GroupSnapshotsTest-1169672434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-58110c7f-fac1-4b1b-a0d6-10d1cc9fcec8 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-efaf4140-5b85-46f3-a8dc-b11ad8694bfc {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:21:43 devstack sudo[91465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-58110c7f-fac1-4b1b-a0d6-10d1cc9fcec8 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-efaf4140-5b85-46f3-a8dc-b11ad8694bfc Nov 06 15:21:43 devstack sudo[91465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:21:52 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:SELECT=26,cinder:UPDATE=32,cinder:DELETE=3,cinder:INSERT=4 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 15:21:52 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:SELECT=31,cinder:UPDATE=30,cinder:INSERT=9,cinder:DELETE=3 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 15:21:54 devstack sudo[91465]: pam_unix(sudo:session): session closed for user root Nov 06 15:21:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c192728e-e1bb-4f4f-956b-e8ce92460a34 tempest-GroupSnapshotsTest-1169672434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-58110c7f-fac1-4b1b-a0d6-10d1cc9fcec8 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-efaf4140-5b85-46f3-a8dc-b11ad8694bfc" returned: 0 in 11.094s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:21:54 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-c192728e-e1bb-4f4f-956b-e8ce92460a34 tempest-GroupSnapshotsTest-1169672434 None] Image conversion details: src /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-58110c7f-fac1-4b1b-a0d6-10d1cc9fcec8, size 1024.00 MB, duration 11.10 sec, destination /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-efaf4140-5b85-46f3-a8dc-b11ad8694bfc {{(pid=87132) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 06 15:21:54 devstack cinder-volume[87132]: INFO cinder.image.image_utils [None req-c192728e-e1bb-4f4f-956b-e8ce92460a34 tempest-GroupSnapshotsTest-1169672434 None] Converted 1024.00 MB image at 92.29 MB/s Nov 06 15:21:54 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-c192728e-e1bb-4f4f-956b-e8ce92460a34 tempest-GroupSnapshotsTest-1169672434 None] /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-efaf4140-5b85-46f3-a8dc-b11ad8694bfc is being set with open permissions: ugo+rw: NotImplementedError Nov 06 15:21:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c192728e-e1bb-4f4f-956b-e8ce92460a34 tempest-GroupSnapshotsTest-1169672434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-efaf4140-5b85-46f3-a8dc-b11ad8694bfc {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:21:54 devstack sudo[91545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-efaf4140-5b85-46f3-a8dc-b11ad8694bfc Nov 06 15:21:54 devstack sudo[91545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:21:54 devstack sudo[91545]: pam_unix(sudo:session): session closed for user root Nov 06 15:21:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c192728e-e1bb-4f4f-956b-e8ce92460a34 tempest-GroupSnapshotsTest-1169672434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-efaf4140-5b85-46f3-a8dc-b11ad8694bfc" returned: 0 in 0.348s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:21:54 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c192728e-e1bb-4f4f-956b-e8ce92460a34 tempest-GroupSnapshotsTest-1169672434 None] Lock "cinder-quobyte-efaf4140-5b85-46f3-a8dc-b11ad8694bfc" released by "_copy_volume_from_snapshot" :: held 12.760s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:21:54 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c192728e-e1bb-4f4f-956b-e8ce92460a34 tempest-GroupSnapshotsTest-1169672434 None] Lock "cinder-quobyte-80fa5e86-4637-4f1b-8736-10e2fb6efc73-efaf4140-5b85-46f3-a8dc-b11ad8694bfc" released by "_create_volume_from_snapshot" :: held 12.858s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:21:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c192728e-e1bb-4f4f-956b-e8ce92460a34 tempest-GroupSnapshotsTest-1169672434 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.879s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:21:55 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-c192728e-e1bb-4f4f-956b-e8ce92460a34 tempest-GroupSnapshotsTest-1169672434 None] Create group from source-snapshot-15210300-f62a-4cb5-9d20-2d2923dccf5c completed successfully. Nov 06 15:21:55 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-867be65e-468f-48da-860b-bdd8f63cd1d7 tempest-AbsoluteLimitsTests-1469137223 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:21:55 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-867be65e-468f-48da-860b-bdd8f63cd1d7 tempest-AbsoluteLimitsTests-1469137223 None] Flow 'volume_create_manager' (d5c2f8e9-6dcb-442e-bd38-a5d5ec996e8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:21:55 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-867be65e-468f-48da-860b-bdd8f63cd1d7 tempest-AbsoluteLimitsTests-1469137223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7a51460-4168-4705-aab2-b51053f8fa3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:21:55 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-867be65e-468f-48da-860b-bdd8f63cd1d7 tempest-AbsoluteLimitsTests-1469137223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7a51460-4168-4705-aab2-b51053f8fa3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:21:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-796016062',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5e7522c-72f2-4dee-bf91-60fc7b7a8f67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9edd44eddc884216bd3c39f77a0c45fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:21:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:21:55Z,use_quota=True,user_id='156aede69a14421abf36df23b334cd0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:21:55 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-867be65e-468f-48da-860b-bdd8f63cd1d7 tempest-AbsoluteLimitsTests-1469137223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50b90454-da9c-4952-9ec3-0a3fc8c48962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:21:55 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-867be65e-468f-48da-860b-bdd8f63cd1d7 tempest-AbsoluteLimitsTests-1469137223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50b90454-da9c-4952-9ec3-0a3fc8c48962) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:21:55 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-867be65e-468f-48da-860b-bdd8f63cd1d7 tempest-AbsoluteLimitsTests-1469137223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6eec7a9a-cd2e-4025-9606-cd1d2e871639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:21:55 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-867be65e-468f-48da-860b-bdd8f63cd1d7 tempest-AbsoluteLimitsTests-1469137223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6eec7a9a-cd2e-4025-9606-cd1d2e871639) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5e7522c-72f2-4dee-bf91-60fc7b7a8f67', 'volume_name': 'volume-c5e7522c-72f2-4dee-bf91-60fc7b7a8f67', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:21:55 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-867be65e-468f-48da-860b-bdd8f63cd1d7 tempest-AbsoluteLimitsTests-1469137223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (199b15e3-2a59-4bae-b412-5f94b9dcd439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:21:55 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-867be65e-468f-48da-860b-bdd8f63cd1d7 tempest-AbsoluteLimitsTests-1469137223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (199b15e3-2a59-4bae-b412-5f94b9dcd439) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:21:55 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-867be65e-468f-48da-860b-bdd8f63cd1d7 tempest-AbsoluteLimitsTests-1469137223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (865d6637-97f5-4846-8278-f7c221bdc89a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:21:55 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-867be65e-468f-48da-860b-bdd8f63cd1d7 tempest-AbsoluteLimitsTests-1469137223 None] Volume c5e7522c-72f2-4dee-bf91-60fc7b7a8f67: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5e7522c-72f2-4dee-bf91-60fc7b7a8f67', 'volume_size': 1} Nov 06 15:21:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-867be65e-468f-48da-860b-bdd8f63cd1d7 tempest-AbsoluteLimitsTests-1469137223 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:21:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-867be65e-468f-48da-860b-bdd8f63cd1d7 tempest-AbsoluteLimitsTests-1469137223 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:21:55 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-867be65e-468f-48da-860b-bdd8f63cd1d7 tempest-AbsoluteLimitsTests-1469137223 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:21:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-796016062',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5e7522c-72f2-4dee-bf91-60fc7b7a8f67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9edd44eddc884216bd3c39f77a0c45fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:21:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:21:55Z,use_quota=True,user_id='156aede69a14421abf36df23b334cd0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:21:55 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-867be65e-468f-48da-860b-bdd8f63cd1d7 tempest-AbsoluteLimitsTests-1469137223 None] Creating volume c5e7522c-72f2-4dee-bf91-60fc7b7a8f67 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:21:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-867be65e-468f-48da-860b-bdd8f63cd1d7 tempest-AbsoluteLimitsTests-1469137223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:21:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-867be65e-468f-48da-860b-bdd8f63cd1d7 tempest-AbsoluteLimitsTests-1469137223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:21:55 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-867be65e-468f-48da-860b-bdd8f63cd1d7 tempest-AbsoluteLimitsTests-1469137223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:21:55 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-867be65e-468f-48da-860b-bdd8f63cd1d7 tempest-AbsoluteLimitsTests-1469137223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:21:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-867be65e-468f-48da-860b-bdd8f63cd1d7 tempest-AbsoluteLimitsTests-1469137223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:21:55 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-867be65e-468f-48da-860b-bdd8f63cd1d7 tempest-AbsoluteLimitsTests-1469137223 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:21:55 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-867be65e-468f-48da-860b-bdd8f63cd1d7 tempest-AbsoluteLimitsTests-1469137223 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:21:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-867be65e-468f-48da-860b-bdd8f63cd1d7 tempest-AbsoluteLimitsTests-1469137223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-c5e7522c-72f2-4dee-bf91-60fc7b7a8f67 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:21:55 devstack sudo[91556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-c5e7522c-72f2-4dee-bf91-60fc7b7a8f67 1073741824 Nov 06 15:21:55 devstack sudo[91556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:21:55 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-868b5825-b24d-461c-a6a9-6f475d130750 tempest-GroupSnapshotsTest-1169672434 None] Acquiring lock "cinder-quobyte-efaf4140-5b85-46f3-a8dc-b11ad8694bfc" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:21:56 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-868b5825-b24d-461c-a6a9-6f475d130750 tempest-GroupSnapshotsTest-1169672434 None] Lock "cinder-quobyte-efaf4140-5b85-46f3-a8dc-b11ad8694bfc" acquired by "delete_volume" :: waited 0.039s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:21:56 devstack sudo[91556]: pam_unix(sudo:session): session closed for user root Nov 06 15:21:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-867be65e-468f-48da-860b-bdd8f63cd1d7 tempest-AbsoluteLimitsTests-1469137223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-c5e7522c-72f2-4dee-bf91-60fc7b7a8f67 1073741824" returned: 0 in 0.581s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:21:56 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1e4e11f-ba86-47cd-84c4-4ef49c7d995e]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:21:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-868b5825-b24d-461c-a6a9-6f475d130750 tempest-GroupSnapshotsTest-1169672434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-efaf4140-5b85-46f3-a8dc-b11ad8694bfc {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:21:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-867be65e-468f-48da-860b-bdd8f63cd1d7 tempest-AbsoluteLimitsTests-1469137223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-c5e7522c-72f2-4dee-bf91-60fc7b7a8f67 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:21:56 devstack sudo[91563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-c5e7522c-72f2-4dee-bf91-60fc7b7a8f67 Nov 06 15:21:56 devstack sudo[91563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:21:56 devstack sudo[91562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-efaf4140-5b85-46f3-a8dc-b11ad8694bfc Nov 06 15:21:56 devstack sudo[91562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:21:56 devstack sudo[91563]: pam_unix(sudo:session): session closed for user root Nov 06 15:21:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-867be65e-468f-48da-860b-bdd8f63cd1d7 tempest-AbsoluteLimitsTests-1469137223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-c5e7522c-72f2-4dee-bf91-60fc7b7a8f67" returned: 0 in 0.273s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:21:56 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-867be65e-468f-48da-860b-bdd8f63cd1d7 tempest-AbsoluteLimitsTests-1469137223 None] <== create_volume: return (920ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:21:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-867be65e-468f-48da-860b-bdd8f63cd1d7 tempest-AbsoluteLimitsTests-1469137223 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.923s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:21:56 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-867be65e-468f-48da-860b-bdd8f63cd1d7 tempest-AbsoluteLimitsTests-1469137223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (865d6637-97f5-4846-8278-f7c221bdc89a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5e7522c-72f2-4dee-bf91-60fc7b7a8f67', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:21:56 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-867be65e-468f-48da-860b-bdd8f63cd1d7 tempest-AbsoluteLimitsTests-1469137223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8616cdd-07d6-4cd1-bed4-0729d4ce6f03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:21:56 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-867be65e-468f-48da-860b-bdd8f63cd1d7 tempest-AbsoluteLimitsTests-1469137223 None] Volume volume-c5e7522c-72f2-4dee-bf91-60fc7b7a8f67 (c5e7522c-72f2-4dee-bf91-60fc7b7a8f67): created successfully Nov 06 15:21:56 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-867be65e-468f-48da-860b-bdd8f63cd1d7 tempest-AbsoluteLimitsTests-1469137223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8616cdd-07d6-4cd1-bed4-0729d4ce6f03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:21:56 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-867be65e-468f-48da-860b-bdd8f63cd1d7 tempest-AbsoluteLimitsTests-1469137223 None] Flow 'volume_create_manager' (d5c2f8e9-6dcb-442e-bd38-a5d5ec996e8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:21:56 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-867be65e-468f-48da-860b-bdd8f63cd1d7 tempest-AbsoluteLimitsTests-1469137223 None] Created volume successfully. Nov 06 15:21:56 devstack sudo[91562]: pam_unix(sudo:session): session closed for user root Nov 06 15:21:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-868b5825-b24d-461c-a6a9-6f475d130750 tempest-GroupSnapshotsTest-1169672434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-efaf4140-5b85-46f3-a8dc-b11ad8694bfc" returned: 0 in 0.407s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:21:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-868b5825-b24d-461c-a6a9-6f475d130750 tempest-GroupSnapshotsTest-1169672434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-efaf4140-5b85-46f3-a8dc-b11ad8694bfc {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:21:56 devstack sudo[91570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-efaf4140-5b85-46f3-a8dc-b11ad8694bfc Nov 06 15:21:56 devstack sudo[91570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:21:56 devstack sudo[91570]: pam_unix(sudo:session): session closed for user root Nov 06 15:21:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-868b5825-b24d-461c-a6a9-6f475d130750 tempest-GroupSnapshotsTest-1169672434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-efaf4140-5b85-46f3-a8dc-b11ad8694bfc" returned: 0 in 0.250s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:21:56 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-868b5825-b24d-461c-a6a9-6f475d130750 tempest-GroupSnapshotsTest-1169672434 None] Lock "cinder-quobyte-efaf4140-5b85-46f3-a8dc-b11ad8694bfc" released by "delete_volume" :: held 0.719s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:21:56 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-868b5825-b24d-461c-a6a9-6f475d130750 tempest-GroupSnapshotsTest-1169672434 None] Created reservations ['ed3f309b-f756-4fc9-b4ba-8c4545b66930'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:21:56 devstack cinder-volume[87132]: WARNING cinder.quota [None req-868b5825-b24d-461c-a6a9-6f475d130750 tempest-GroupSnapshotsTest-1169672434 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-87895929 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-87895929, it is now deprecated. Please use the default quota class for default quota. Nov 06 15:21:56 devstack cinder-volume[87132]: WARNING cinder.quota [None req-868b5825-b24d-461c-a6a9-6f475d130750 tempest-GroupSnapshotsTest-1169672434 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-87895929 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-87895929, it is now deprecated. Please use the default quota class for default quota. Nov 06 15:21:56 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-868b5825-b24d-461c-a6a9-6f475d130750 tempest-GroupSnapshotsTest-1169672434 None] Created reservations ['41b5b040-9740-4ff8-a906-00766f50904d', '568c6c0f-6707-4e4d-b96c-16354bf69624', '83f0c11c-3020-4de2-aad9-42ca06538314', 'e6c85243-d183-4522-8f9f-2ecdd2e5a242'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:21:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-868b5825-b24d-461c-a6a9-6f475d130750 tempest-GroupSnapshotsTest-1169672434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:21:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-868b5825-b24d-461c-a6a9-6f475d130750 tempest-GroupSnapshotsTest-1169672434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:21:56 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-868b5825-b24d-461c-a6a9-6f475d130750 tempest-GroupSnapshotsTest-1169672434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:21:56 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-868b5825-b24d-461c-a6a9-6f475d130750 tempest-GroupSnapshotsTest-1169672434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:21:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-868b5825-b24d-461c-a6a9-6f475d130750 tempest-GroupSnapshotsTest-1169672434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:21:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-868b5825-b24d-461c-a6a9-6f475d130750 tempest-GroupSnapshotsTest-1169672434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:21:57 devstack sudo[91579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:21:57 devstack sudo[91579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:21:57 devstack sudo[91579]: pam_unix(sudo:session): session closed for user root Nov 06 15:21:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-868b5825-b24d-461c-a6a9-6f475d130750 tempest-GroupSnapshotsTest-1169672434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.263s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:21:57 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-868b5825-b24d-461c-a6a9-6f475d130750 tempest-GroupSnapshotsTest-1169672434 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:21:57 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-868b5825-b24d-461c-a6a9-6f475d130750 tempest-GroupSnapshotsTest-1169672434 None] Delete group completed successfully. Nov 06 15:21:57 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-5d362d33-6710-426c-a8e2-d2762d8939d4 tempest-GroupSnapshotsTest-1169672434 None] group_snapshot 15210300-f62a-4cb5-9d20-2d2923dccf5c: deleting Nov 06 15:21:57 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5d362d33-6710-426c-a8e2-d2762d8939d4 tempest-GroupSnapshotsTest-1169672434 None] group_snapshot 15210300-f62a-4cb5-9d20-2d2923dccf5c: deleting {{(pid=87132) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 06 15:21:57 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-5d362d33-6710-426c-a8e2-d2762d8939d4 tempest-GroupSnapshotsTest-1169672434 None] Acquiring lock "cinder-quobyte-58110c7f-fac1-4b1b-a0d6-10d1cc9fcec8" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:21:57 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-5d362d33-6710-426c-a8e2-d2762d8939d4 tempest-GroupSnapshotsTest-1169672434 None] Lock "cinder-quobyte-58110c7f-fac1-4b1b-a0d6-10d1cc9fcec8" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:21:57 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-5d362d33-6710-426c-a8e2-d2762d8939d4 tempest-GroupSnapshotsTest-1169672434 None] Acquiring lock "cinder-quobyte-80fa5e86-4637-4f1b-8736-10e2fb6efc73" by "_delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:21:57 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-5d362d33-6710-426c-a8e2-d2762d8939d4 tempest-GroupSnapshotsTest-1169672434 None] Lock "cinder-quobyte-80fa5e86-4637-4f1b-8736-10e2fb6efc73" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:21:57 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-5d362d33-6710-426c-a8e2-d2762d8939d4 tempest-GroupSnapshotsTest-1169672434 None] Deleting offline snapshot 80fa5e86-4637-4f1b-8736-10e2fb6efc73 of volume 58110c7f-fac1-4b1b-a0d6-10d1cc9fcec8 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 15:21:57 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-5d362d33-6710-426c-a8e2-d2762d8939d4 tempest-GroupSnapshotsTest-1169672434 None] snapshot_file for this snap is: volume-58110c7f-fac1-4b1b-a0d6-10d1cc9fcec8.80fa5e86-4637-4f1b-8736-10e2fb6efc73 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 15:21:57 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fd08d3b-9696-43fa-b7f4-24121219a5d8]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:21:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5d362d33-6710-426c-a8e2-d2762d8939d4 tempest-GroupSnapshotsTest-1169672434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-58110c7f-fac1-4b1b-a0d6-10d1cc9fcec8.80fa5e86-4637-4f1b-8736-10e2fb6efc73 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:21:57 devstack sudo[91582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-58110c7f-fac1-4b1b-a0d6-10d1cc9fcec8.80fa5e86-4637-4f1b-8736-10e2fb6efc73 Nov 06 15:21:57 devstack sudo[91582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:21:57 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-121972c9-30b7-4967-af70-d8583fcd8eb5 tempest-AbsoluteLimitsTests-1469137223 None] Acquiring lock "cinder-c5e7522c-72f2-4dee-bf91-60fc7b7a8f67-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:21:57 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-121972c9-30b7-4967-af70-d8583fcd8eb5 tempest-AbsoluteLimitsTests-1469137223 None] Lock "cinder-c5e7522c-72f2-4dee-bf91-60fc7b7a8f67-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:21:57 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-121972c9-30b7-4967-af70-d8583fcd8eb5 tempest-AbsoluteLimitsTests-1469137223 None] Acquiring lock "cinder-quobyte-c5e7522c-72f2-4dee-bf91-60fc7b7a8f67" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:21:57 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-121972c9-30b7-4967-af70-d8583fcd8eb5 tempest-AbsoluteLimitsTests-1469137223 None] Lock "cinder-quobyte-c5e7522c-72f2-4dee-bf91-60fc7b7a8f67" acquired by "delete_volume" :: waited 0.017s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:21:57 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ff6fc7e-99ad-4928-b450-fa9486d9d99b]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:21:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-121972c9-30b7-4967-af70-d8583fcd8eb5 tempest-AbsoluteLimitsTests-1469137223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-c5e7522c-72f2-4dee-bf91-60fc7b7a8f67 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:21:57 devstack sudo[91596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-c5e7522c-72f2-4dee-bf91-60fc7b7a8f67 Nov 06 15:21:57 devstack sudo[91596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:21:57 devstack sudo[91582]: pam_unix(sudo:session): session closed for user root Nov 06 15:21:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5d362d33-6710-426c-a8e2-d2762d8939d4 tempest-GroupSnapshotsTest-1169672434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-58110c7f-fac1-4b1b-a0d6-10d1cc9fcec8.80fa5e86-4637-4f1b-8736-10e2fb6efc73" returned: 0 in 0.482s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:21:57 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-5d362d33-6710-426c-a8e2-d2762d8939d4 tempest-GroupSnapshotsTest-1169672434 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-58110c7f-fac1-4b1b-a0d6-10d1cc9fcec8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 15:21:58 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[b45d225e-6363-4de2-90ff-4596d6337740]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:21:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5d362d33-6710-426c-a8e2-d2762d8939d4 tempest-GroupSnapshotsTest-1169672434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-58110c7f-fac1-4b1b-a0d6-10d1cc9fcec8 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:21:58 devstack sudo[91601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-58110c7f-fac1-4b1b-a0d6-10d1cc9fcec8 Nov 06 15:21:58 devstack sudo[91601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:21:58 devstack sudo[91596]: pam_unix(sudo:session): session closed for user root Nov 06 15:21:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-121972c9-30b7-4967-af70-d8583fcd8eb5 tempest-AbsoluteLimitsTests-1469137223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-c5e7522c-72f2-4dee-bf91-60fc7b7a8f67" returned: 0 in 0.511s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:21:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-121972c9-30b7-4967-af70-d8583fcd8eb5 tempest-AbsoluteLimitsTests-1469137223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-c5e7522c-72f2-4dee-bf91-60fc7b7a8f67 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:21:58 devstack sudo[91606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-c5e7522c-72f2-4dee-bf91-60fc7b7a8f67 Nov 06 15:21:58 devstack sudo[91606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:21:58 devstack sudo[91606]: pam_unix(sudo:session): session closed for user root Nov 06 15:21:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-121972c9-30b7-4967-af70-d8583fcd8eb5 tempest-AbsoluteLimitsTests-1469137223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-c5e7522c-72f2-4dee-bf91-60fc7b7a8f67" returned: 0 in 0.305s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:21:58 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-121972c9-30b7-4967-af70-d8583fcd8eb5 tempest-AbsoluteLimitsTests-1469137223 None] Lock "cinder-quobyte-c5e7522c-72f2-4dee-bf91-60fc7b7a8f67" released by "delete_volume" :: held 0.870s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:21:58 devstack sudo[91601]: pam_unix(sudo:session): session closed for user root Nov 06 15:21:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5d362d33-6710-426c-a8e2-d2762d8939d4 tempest-GroupSnapshotsTest-1169672434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-58110c7f-fac1-4b1b-a0d6-10d1cc9fcec8" returned: 0 in 0.697s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:21:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5d362d33-6710-426c-a8e2-d2762d8939d4 tempest-GroupSnapshotsTest-1169672434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-58110c7f-fac1-4b1b-a0d6-10d1cc9fcec8.80fa5e86-4637-4f1b-8736-10e2fb6efc73 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:21:58 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-121972c9-30b7-4967-af70-d8583fcd8eb5 tempest-AbsoluteLimitsTests-1469137223 None] Created reservations ['652fc381-b465-464b-a58d-2b15cf822280', 'c6672089-1e22-4214-8390-f992b136bd03', 'c1a17b70-baff-4850-a2b5-ad392d97e6a1', 'b2412465-f5f4-4692-bb9c-c1e16f5c7463'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:21:58 devstack sudo[91613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-58110c7f-fac1-4b1b-a0d6-10d1cc9fcec8.80fa5e86-4637-4f1b-8736-10e2fb6efc73 Nov 06 15:21:58 devstack sudo[91613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:21:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-121972c9-30b7-4967-af70-d8583fcd8eb5 tempest-AbsoluteLimitsTests-1469137223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:21:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-121972c9-30b7-4967-af70-d8583fcd8eb5 tempest-AbsoluteLimitsTests-1469137223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:21:58 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-121972c9-30b7-4967-af70-d8583fcd8eb5 tempest-AbsoluteLimitsTests-1469137223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:21:58 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-121972c9-30b7-4967-af70-d8583fcd8eb5 tempest-AbsoluteLimitsTests-1469137223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:21:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-121972c9-30b7-4967-af70-d8583fcd8eb5 tempest-AbsoluteLimitsTests-1469137223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:21:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-121972c9-30b7-4967-af70-d8583fcd8eb5 tempest-AbsoluteLimitsTests-1469137223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:21:58 devstack sudo[91615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:21:58 devstack sudo[91615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:21:59 devstack sudo[91615]: pam_unix(sudo:session): session closed for user root Nov 06 15:21:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-121972c9-30b7-4967-af70-d8583fcd8eb5 tempest-AbsoluteLimitsTests-1469137223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.335s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:21:59 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-121972c9-30b7-4967-af70-d8583fcd8eb5 tempest-AbsoluteLimitsTests-1469137223 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:21:59 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-121972c9-30b7-4967-af70-d8583fcd8eb5 tempest-AbsoluteLimitsTests-1469137223 None] Deleted volume successfully. Nov 06 15:21:59 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-121972c9-30b7-4967-af70-d8583fcd8eb5 tempest-AbsoluteLimitsTests-1469137223 None] Lock "cinder-c5e7522c-72f2-4dee-bf91-60fc7b7a8f67-delete_volume" released by "delete_volume" :: held 1.522s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:21:59 devstack sudo[91613]: pam_unix(sudo:session): session closed for user root Nov 06 15:21:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5d362d33-6710-426c-a8e2-d2762d8939d4 tempest-GroupSnapshotsTest-1169672434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-58110c7f-fac1-4b1b-a0d6-10d1cc9fcec8.80fa5e86-4637-4f1b-8736-10e2fb6efc73" returned: 0 in 0.639s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:21:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5d362d33-6710-426c-a8e2-d2762d8939d4 tempest-GroupSnapshotsTest-1169672434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-58110c7f-fac1-4b1b-a0d6-10d1cc9fcec8.80fa5e86-4637-4f1b-8736-10e2fb6efc73 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:21:59 devstack sudo[91623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-58110c7f-fac1-4b1b-a0d6-10d1cc9fcec8.80fa5e86-4637-4f1b-8736-10e2fb6efc73 Nov 06 15:21:59 devstack sudo[91623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:21:59 devstack sudo[91623]: pam_unix(sudo:session): session closed for user root Nov 06 15:21:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5d362d33-6710-426c-a8e2-d2762d8939d4 tempest-GroupSnapshotsTest-1169672434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-58110c7f-fac1-4b1b-a0d6-10d1cc9fcec8.80fa5e86-4637-4f1b-8736-10e2fb6efc73" returned: 0 in 0.509s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:21:59 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-5d362d33-6710-426c-a8e2-d2762d8939d4 tempest-GroupSnapshotsTest-1169672434 None] Lock "cinder-quobyte-80fa5e86-4637-4f1b-8736-10e2fb6efc73" released by "_delete_snapshot" :: held 2.499s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:21:59 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-5d362d33-6710-426c-a8e2-d2762d8939d4 tempest-GroupSnapshotsTest-1169672434 None] Lock "cinder-quobyte-58110c7f-fac1-4b1b-a0d6-10d1cc9fcec8" released by "delete_snapshot" :: held 2.535s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:22:00 devstack cinder-volume[87132]: WARNING cinder.quota [None req-5d362d33-6710-426c-a8e2-d2762d8939d4 tempest-GroupSnapshotsTest-1169672434 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-87895929 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-87895929, it is now deprecated. Please use the default quota class for default quota. Nov 06 15:22:00 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-5d362d33-6710-426c-a8e2-d2762d8939d4 tempest-GroupSnapshotsTest-1169672434 None] Created reservations ['5caee8b6-eb3d-492a-bcf9-7e0dd4115e3c', 'f168ee50-e448-4dea-8f90-d7577479aff9', '28b3abc2-3025-4253-a1a5-b0b33541b430', 'c0c2db67-0b98-4fc3-ad38-6aff2482e754'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:22:00 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-5d362d33-6710-426c-a8e2-d2762d8939d4 tempest-GroupSnapshotsTest-1169672434 None] group_snapshot 15210300-f62a-4cb5-9d20-2d2923dccf5c: deleted successfully Nov 06 15:22:01 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-51978378-c87e-4da1-b0b7-b70a4f8bedb0 tempest-GroupSnapshotsTest-1169672434 None] Acquiring lock "cinder-quobyte-58110c7f-fac1-4b1b-a0d6-10d1cc9fcec8" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:22:01 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-51978378-c87e-4da1-b0b7-b70a4f8bedb0 tempest-GroupSnapshotsTest-1169672434 None] Lock "cinder-quobyte-58110c7f-fac1-4b1b-a0d6-10d1cc9fcec8" acquired by "delete_volume" :: waited 0.026s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:22:01 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cdbc115-1ec5-457f-a251-551721838189]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:22:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-51978378-c87e-4da1-b0b7-b70a4f8bedb0 tempest-GroupSnapshotsTest-1169672434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-58110c7f-fac1-4b1b-a0d6-10d1cc9fcec8 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:22:01 devstack sudo[91626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-58110c7f-fac1-4b1b-a0d6-10d1cc9fcec8 Nov 06 15:22:01 devstack sudo[91626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:22:01 devstack sudo[91626]: pam_unix(sudo:session): session closed for user root Nov 06 15:22:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-51978378-c87e-4da1-b0b7-b70a4f8bedb0 tempest-GroupSnapshotsTest-1169672434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-58110c7f-fac1-4b1b-a0d6-10d1cc9fcec8" returned: 0 in 0.464s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:22:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-51978378-c87e-4da1-b0b7-b70a4f8bedb0 tempest-GroupSnapshotsTest-1169672434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-58110c7f-fac1-4b1b-a0d6-10d1cc9fcec8 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:22:01 devstack sudo[91632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-58110c7f-fac1-4b1b-a0d6-10d1cc9fcec8 Nov 06 15:22:01 devstack sudo[91632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:22:01 devstack sudo[91632]: pam_unix(sudo:session): session closed for user root Nov 06 15:22:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-51978378-c87e-4da1-b0b7-b70a4f8bedb0 tempest-GroupSnapshotsTest-1169672434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-58110c7f-fac1-4b1b-a0d6-10d1cc9fcec8" returned: 0 in 0.336s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:22:01 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-51978378-c87e-4da1-b0b7-b70a4f8bedb0 tempest-GroupSnapshotsTest-1169672434 None] Lock "cinder-quobyte-58110c7f-fac1-4b1b-a0d6-10d1cc9fcec8" released by "delete_volume" :: held 0.896s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:22:02 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-51978378-c87e-4da1-b0b7-b70a4f8bedb0 tempest-GroupSnapshotsTest-1169672434 None] Created reservations ['f7adeb69-64fe-43fa-8e91-52a70d90a092'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:22:02 devstack cinder-volume[87132]: WARNING cinder.db.api [None req-51978378-c87e-4da1-b0b7-b70a4f8bedb0 tempest-GroupSnapshotsTest-1169672434 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-87895929'] Nov 06 15:22:02 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-51978378-c87e-4da1-b0b7-b70a4f8bedb0 tempest-GroupSnapshotsTest-1169672434 None] Created reservations ['9062f80a-bc33-4dc7-b7d5-24bed4f5169b', '628e7285-cf48-423f-8134-0604a66270a7', '06170900-01f9-4014-8895-6a654502dfda', '59258d7a-214f-4a35-b278-8c609d3e5416'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:22:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-51978378-c87e-4da1-b0b7-b70a4f8bedb0 tempest-GroupSnapshotsTest-1169672434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:22:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-51978378-c87e-4da1-b0b7-b70a4f8bedb0 tempest-GroupSnapshotsTest-1169672434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:22:02 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-51978378-c87e-4da1-b0b7-b70a4f8bedb0 tempest-GroupSnapshotsTest-1169672434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:22:02 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-51978378-c87e-4da1-b0b7-b70a4f8bedb0 tempest-GroupSnapshotsTest-1169672434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:22:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-51978378-c87e-4da1-b0b7-b70a4f8bedb0 tempest-GroupSnapshotsTest-1169672434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:22:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-51978378-c87e-4da1-b0b7-b70a4f8bedb0 tempest-GroupSnapshotsTest-1169672434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:22:02 devstack sudo[91635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:22:02 devstack sudo[91635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:22:02 devstack sudo[91635]: pam_unix(sudo:session): session closed for user root Nov 06 15:22:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-51978378-c87e-4da1-b0b7-b70a4f8bedb0 tempest-GroupSnapshotsTest-1169672434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.344s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:22:02 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-51978378-c87e-4da1-b0b7-b70a4f8bedb0 tempest-GroupSnapshotsTest-1169672434 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:22:02 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-51978378-c87e-4da1-b0b7-b70a4f8bedb0 tempest-GroupSnapshotsTest-1169672434 None] Delete group completed successfully. Nov 06 15:22:03 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-e2e4164d-b495-4e33-b04f-20b7a3af0dd5 tempest-GroupSnapshotsTest-1169672434 None] Group tempest-GroupSnapshotsTest-Group-163145961: creating Nov 06 15:22:03 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-e2e4164d-b495-4e33-b04f-20b7a3af0dd5 tempest-GroupSnapshotsTest-1169672434 None] Group tempest-GroupSnapshotsTest-Group-163145961: created successfully Nov 06 15:22:03 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-e2e4164d-b495-4e33-b04f-20b7a3af0dd5 tempest-GroupSnapshotsTest-1169672434 None] Create group completed successfully. Nov 06 15:22:04 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-00afe3e9-ca04-4624-98df-1b1ac6bc446f tempest-GroupSnapshotsTest-1169672434 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:22:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-00afe3e9-ca04-4624-98df-1b1ac6bc446f tempest-GroupSnapshotsTest-1169672434 None] Flow 'volume_create_manager' (83235051-a752-45c4-a40c-e1ce94d4f071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:22:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-00afe3e9-ca04-4624-98df-1b1ac6bc446f tempest-GroupSnapshotsTest-1169672434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34cda7ca-d025-49f6-835a-ce4f81b93b22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:22:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-00afe3e9-ca04-4624-98df-1b1ac6bc446f tempest-GroupSnapshotsTest-1169672434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34cda7ca-d025-49f6-835a-ce4f81b93b22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:22:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1720574016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8e1ce5bf-2368-4b67-8c1b-ba3c468be0ee,host='devstack@QuobyteHD#QuobyteHD',id=53c980c7-6b26-4d9f-ae7b-3c563daf1cba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df60dde68c6c4ecb9ae1da55ae49b1d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:22:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:22:05Z,use_quota=True,user_id='5c43bea8dd194538a5806a4085a0a9bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c071660-4003-455e-aff3-0fc13b50daac),volume_type_id=2c071660-4003-455e-aff3-0fc13b50daac)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:22:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-00afe3e9-ca04-4624-98df-1b1ac6bc446f tempest-GroupSnapshotsTest-1169672434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5934cb6b-6dde-4c82-903b-e77150292ab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:22:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-00afe3e9-ca04-4624-98df-1b1ac6bc446f tempest-GroupSnapshotsTest-1169672434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5934cb6b-6dde-4c82-903b-e77150292ab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:22:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-00afe3e9-ca04-4624-98df-1b1ac6bc446f tempest-GroupSnapshotsTest-1169672434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd3a55ad-2530-47bc-961f-9e7d183e9e90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:22:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-00afe3e9-ca04-4624-98df-1b1ac6bc446f tempest-GroupSnapshotsTest-1169672434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd3a55ad-2530-47bc-961f-9e7d183e9e90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53c980c7-6b26-4d9f-ae7b-3c563daf1cba', 'volume_name': 'volume-53c980c7-6b26-4d9f-ae7b-3c563daf1cba', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:22:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-00afe3e9-ca04-4624-98df-1b1ac6bc446f tempest-GroupSnapshotsTest-1169672434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3af0f005-38f6-4367-91c2-71cbf0c99972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:22:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-00afe3e9-ca04-4624-98df-1b1ac6bc446f tempest-GroupSnapshotsTest-1169672434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3af0f005-38f6-4367-91c2-71cbf0c99972) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:22:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-00afe3e9-ca04-4624-98df-1b1ac6bc446f tempest-GroupSnapshotsTest-1169672434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66f254b7-7429-4865-b309-46d9753602b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:22:05 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-00afe3e9-ca04-4624-98df-1b1ac6bc446f tempest-GroupSnapshotsTest-1169672434 None] Volume 53c980c7-6b26-4d9f-ae7b-3c563daf1cba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53c980c7-6b26-4d9f-ae7b-3c563daf1cba', 'volume_size': 1} Nov 06 15:22:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-00afe3e9-ca04-4624-98df-1b1ac6bc446f tempest-GroupSnapshotsTest-1169672434 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:22:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-00afe3e9-ca04-4624-98df-1b1ac6bc446f tempest-GroupSnapshotsTest-1169672434 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:22:05 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-00afe3e9-ca04-4624-98df-1b1ac6bc446f tempest-GroupSnapshotsTest-1169672434 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=8e1ce5bf-2368-4b67-8c1b-ba3c468be0ee,created_at=2026-11-06T14:22:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1720574016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8e1ce5bf-2368-4b67-8c1b-ba3c468be0ee,host='devstack@QuobyteHD#QuobyteHD',id=53c980c7-6b26-4d9f-ae7b-3c563daf1cba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df60dde68c6c4ecb9ae1da55ae49b1d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:22:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:22:05Z,use_quota=True,user_id='5c43bea8dd194538a5806a4085a0a9bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c071660-4003-455e-aff3-0fc13b50daac),volume_type_id=2c071660-4003-455e-aff3-0fc13b50daac)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:22:05 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-00afe3e9-ca04-4624-98df-1b1ac6bc446f tempest-GroupSnapshotsTest-1169672434 None] Creating volume 53c980c7-6b26-4d9f-ae7b-3c563daf1cba {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:22:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-00afe3e9-ca04-4624-98df-1b1ac6bc446f tempest-GroupSnapshotsTest-1169672434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:22:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-00afe3e9-ca04-4624-98df-1b1ac6bc446f tempest-GroupSnapshotsTest-1169672434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:22:05 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-00afe3e9-ca04-4624-98df-1b1ac6bc446f tempest-GroupSnapshotsTest-1169672434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:22:05 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-00afe3e9-ca04-4624-98df-1b1ac6bc446f tempest-GroupSnapshotsTest-1169672434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:22:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-00afe3e9-ca04-4624-98df-1b1ac6bc446f tempest-GroupSnapshotsTest-1169672434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:22:05 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-00afe3e9-ca04-4624-98df-1b1ac6bc446f tempest-GroupSnapshotsTest-1169672434 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:22:05 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-00afe3e9-ca04-4624-98df-1b1ac6bc446f tempest-GroupSnapshotsTest-1169672434 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:22:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-00afe3e9-ca04-4624-98df-1b1ac6bc446f tempest-GroupSnapshotsTest-1169672434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-53c980c7-6b26-4d9f-ae7b-3c563daf1cba 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:22:05 devstack sudo[91653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-53c980c7-6b26-4d9f-ae7b-3c563daf1cba 1073741824 Nov 06 15:22:05 devstack sudo[91653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:22:05 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a0d22f9-4b3e-4712-a059-58f4c71b017a tempest-VolumesActionsTest-1966304339 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:22:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0a0d22f9-4b3e-4712-a059-58f4c71b017a tempest-VolumesActionsTest-1966304339 None] Flow 'volume_create_manager' (cc37fd83-9ecc-4c70-a8fd-697a94fbd82b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:22:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0a0d22f9-4b3e-4712-a059-58f4c71b017a tempest-VolumesActionsTest-1966304339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a3a6cfc-9f58-49a3-91c0-80a7cf09e145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:22:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-b698a41b-efe8-45af-84b5-821c4a5aacaa req-204f66f0-771c-4ac2-86c7-fa3ce94d7805 tempest-ServerActionsTestOtherA-1409404420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:22:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0a0d22f9-4b3e-4712-a059-58f4c71b017a tempest-VolumesActionsTest-1966304339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a3a6cfc-9f58-49a3-91c0-80a7cf09e145) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:22:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-593889784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e885d62-094f-49f5-a31b-783730ab54c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5bc149b04aa4bbcb55485fb3d5bdaf5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:22:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:22:05Z,use_quota=True,user_id='940ace6158a848709709cac7a9565f53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:22:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0a0d22f9-4b3e-4712-a059-58f4c71b017a tempest-VolumesActionsTest-1966304339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b7bcc02-0a40-4ba3-ba96-5dd13283406e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:22:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0a0d22f9-4b3e-4712-a059-58f4c71b017a tempest-VolumesActionsTest-1966304339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b7bcc02-0a40-4ba3-ba96-5dd13283406e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:22:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0a0d22f9-4b3e-4712-a059-58f4c71b017a tempest-VolumesActionsTest-1966304339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8911e7f0-ab96-47ee-9529-ca2cb1d44f18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:22:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0a0d22f9-4b3e-4712-a059-58f4c71b017a tempest-VolumesActionsTest-1966304339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8911e7f0-ab96-47ee-9529-ca2cb1d44f18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e885d62-094f-49f5-a31b-783730ab54c3', 'volume_name': 'volume-9e885d62-094f-49f5-a31b-783730ab54c3', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:22:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0a0d22f9-4b3e-4712-a059-58f4c71b017a tempest-VolumesActionsTest-1966304339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aaeafb09-16fd-494d-8864-4f0147274a78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:22:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0a0d22f9-4b3e-4712-a059-58f4c71b017a tempest-VolumesActionsTest-1966304339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aaeafb09-16fd-494d-8864-4f0147274a78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:22:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0a0d22f9-4b3e-4712-a059-58f4c71b017a tempest-VolumesActionsTest-1966304339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a963e7ac-1c47-4ffe-9ea1-e84662916344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:22:05 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-0a0d22f9-4b3e-4712-a059-58f4c71b017a tempest-VolumesActionsTest-1966304339 None] Volume 9e885d62-094f-49f5-a31b-783730ab54c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e885d62-094f-49f5-a31b-783730ab54c3', 'volume_size': 1} Nov 06 15:22:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0a0d22f9-4b3e-4712-a059-58f4c71b017a tempest-VolumesActionsTest-1966304339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:22:05 devstack sudo[91653]: pam_unix(sudo:session): session closed for user root Nov 06 15:22:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-00afe3e9-ca04-4624-98df-1b1ac6bc446f tempest-GroupSnapshotsTest-1169672434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-53c980c7-6b26-4d9f-ae7b-3c563daf1cba 1073741824" returned: 0 in 0.584s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:22:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-00afe3e9-ca04-4624-98df-1b1ac6bc446f tempest-GroupSnapshotsTest-1169672434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-53c980c7-6b26-4d9f-ae7b-3c563daf1cba {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:22:05 devstack sudo[91661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-53c980c7-6b26-4d9f-ae7b-3c563daf1cba Nov 06 15:22:05 devstack sudo[91661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:22:06 devstack sudo[91661]: pam_unix(sudo:session): session closed for user root Nov 06 15:22:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-00afe3e9-ca04-4624-98df-1b1ac6bc446f tempest-GroupSnapshotsTest-1169672434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-53c980c7-6b26-4d9f-ae7b-3c563daf1cba" returned: 0 in 0.321s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:22:06 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-00afe3e9-ca04-4624-98df-1b1ac6bc446f tempest-GroupSnapshotsTest-1169672434 None] <== create_volume: return (949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:22:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-00afe3e9-ca04-4624-98df-1b1ac6bc446f tempest-GroupSnapshotsTest-1169672434 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.952s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:22:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-b698a41b-efe8-45af-84b5-821c4a5aacaa req-204f66f0-771c-4ac2-86c7-fa3ce94d7805 tempest-ServerActionsTestOtherA-1409404420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.571s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:22:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-00afe3e9-ca04-4624-98df-1b1ac6bc446f tempest-GroupSnapshotsTest-1169672434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66f254b7-7429-4865-b309-46d9753602b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53c980c7-6b26-4d9f-ae7b-3c563daf1cba', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:22:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-00afe3e9-ca04-4624-98df-1b1ac6bc446f tempest-GroupSnapshotsTest-1169672434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f48772ff-4b7c-4892-8aff-f081a6c913b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:22:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-b698a41b-efe8-45af-84b5-821c4a5aacaa req-204f66f0-771c-4ac2-86c7-fa3ce94d7805 tempest-ServerActionsTestOtherA-1409404420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.042s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:22:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0a0d22f9-4b3e-4712-a059-58f4c71b017a tempest-VolumesActionsTest-1966304339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.562s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:22:06 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0a0d22f9-4b3e-4712-a059-58f4c71b017a tempest-VolumesActionsTest-1966304339 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:22:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-593889784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e885d62-094f-49f5-a31b-783730ab54c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5bc149b04aa4bbcb55485fb3d5bdaf5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:22:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:22:05Z,use_quota=True,user_id='940ace6158a848709709cac7a9565f53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:22:06 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-0a0d22f9-4b3e-4712-a059-58f4c71b017a tempest-VolumesActionsTest-1966304339 None] Creating volume 9e885d62-094f-49f5-a31b-783730ab54c3 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:22:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0a0d22f9-4b3e-4712-a059-58f4c71b017a tempest-VolumesActionsTest-1966304339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:22:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0a0d22f9-4b3e-4712-a059-58f4c71b017a tempest-VolumesActionsTest-1966304339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:22:06 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0a0d22f9-4b3e-4712-a059-58f4c71b017a tempest-VolumesActionsTest-1966304339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:22:06 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0a0d22f9-4b3e-4712-a059-58f4c71b017a tempest-VolumesActionsTest-1966304339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:22:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0a0d22f9-4b3e-4712-a059-58f4c71b017a tempest-VolumesActionsTest-1966304339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:22:06 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0a0d22f9-4b3e-4712-a059-58f4c71b017a tempest-VolumesActionsTest-1966304339 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:22:06 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-0a0d22f9-4b3e-4712-a059-58f4c71b017a tempest-VolumesActionsTest-1966304339 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:22:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0a0d22f9-4b3e-4712-a059-58f4c71b017a tempest-VolumesActionsTest-1966304339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-9e885d62-094f-49f5-a31b-783730ab54c3 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:22:06 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-00afe3e9-ca04-4624-98df-1b1ac6bc446f tempest-GroupSnapshotsTest-1169672434 None] Volume volume-53c980c7-6b26-4d9f-ae7b-3c563daf1cba (53c980c7-6b26-4d9f-ae7b-3c563daf1cba): created successfully Nov 06 15:22:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-00afe3e9-ca04-4624-98df-1b1ac6bc446f tempest-GroupSnapshotsTest-1169672434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f48772ff-4b7c-4892-8aff-f081a6c913b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:22:06 devstack sudo[91664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-9e885d62-094f-49f5-a31b-783730ab54c3 1073741824 Nov 06 15:22:06 devstack sudo[91664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:22:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-00afe3e9-ca04-4624-98df-1b1ac6bc446f tempest-GroupSnapshotsTest-1169672434 None] Flow 'volume_create_manager' (83235051-a752-45c4-a40c-e1ce94d4f071) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:22:06 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-00afe3e9-ca04-4624-98df-1b1ac6bc446f tempest-GroupSnapshotsTest-1169672434 None] Created volume successfully. Nov 06 15:22:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-b698a41b-efe8-45af-84b5-821c4a5aacaa req-204f66f0-771c-4ac2-86c7-fa3ce94d7805 tempest-ServerActionsTestOtherA-1409404420 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b', 'name': 'volume-135c21e6-615b-4d80-81f0-bfac6e82d15c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '72202e06-fb99-4013-832d-3cd8c0868fc6', 'enforce_multipath': True} {{(pid=87132) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 15:22:06 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-b698a41b-efe8-45af-84b5-821c4a5aacaa req-204f66f0-771c-4ac2-86c7-fa3ce94d7805 tempest-ServerActionsTestOtherA-1409404420 None] attachment_update completed successfully. Nov 06 15:22:06 devstack sudo[91664]: pam_unix(sudo:session): session closed for user root Nov 06 15:22:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0a0d22f9-4b3e-4712-a059-58f4c71b017a tempest-VolumesActionsTest-1966304339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-9e885d62-094f-49f5-a31b-783730ab54c3 1073741824" returned: 0 in 0.525s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:22:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0a0d22f9-4b3e-4712-a059-58f4c71b017a tempest-VolumesActionsTest-1966304339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-9e885d62-094f-49f5-a31b-783730ab54c3 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:22:06 devstack sudo[92085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-9e885d62-094f-49f5-a31b-783730ab54c3 Nov 06 15:22:06 devstack sudo[92085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:22:07 devstack sudo[92085]: pam_unix(sudo:session): session closed for user root Nov 06 15:22:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0a0d22f9-4b3e-4712-a059-58f4c71b017a tempest-VolumesActionsTest-1966304339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-9e885d62-094f-49f5-a31b-783730ab54c3" returned: 0 in 0.347s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:22:07 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0a0d22f9-4b3e-4712-a059-58f4c71b017a tempest-VolumesActionsTest-1966304339 None] <== create_volume: return (931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:22:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0a0d22f9-4b3e-4712-a059-58f4c71b017a tempest-VolumesActionsTest-1966304339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.936s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:22:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0a0d22f9-4b3e-4712-a059-58f4c71b017a tempest-VolumesActionsTest-1966304339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a963e7ac-1c47-4ffe-9ea1-e84662916344) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e885d62-094f-49f5-a31b-783730ab54c3', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:22:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0a0d22f9-4b3e-4712-a059-58f4c71b017a tempest-VolumesActionsTest-1966304339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21b0b7e3-1566-4576-80ee-ae32fdad00fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:22:07 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-0a0d22f9-4b3e-4712-a059-58f4c71b017a tempest-VolumesActionsTest-1966304339 None] Volume volume-9e885d62-094f-49f5-a31b-783730ab54c3 (9e885d62-094f-49f5-a31b-783730ab54c3): created successfully Nov 06 15:22:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0a0d22f9-4b3e-4712-a059-58f4c71b017a tempest-VolumesActionsTest-1966304339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21b0b7e3-1566-4576-80ee-ae32fdad00fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:22:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0a0d22f9-4b3e-4712-a059-58f4c71b017a tempest-VolumesActionsTest-1966304339 None] Flow 'volume_create_manager' (cc37fd83-9ecc-4c70-a8fd-697a94fbd82b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:22:07 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-0a0d22f9-4b3e-4712-a059-58f4c71b017a tempest-VolumesActionsTest-1966304339 None] Created volume successfully. Nov 06 15:22:07 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-c940a24a-f6bd-4451-98c8-86147ec0bab9 tempest-GroupSnapshotsTest-1169672434 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:22:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c940a24a-f6bd-4451-98c8-86147ec0bab9 tempest-GroupSnapshotsTest-1169672434 None] Flow 'volume_create_manager' (af832698-4891-4d65-bfaa-4ca6ee60812c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:22:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c940a24a-f6bd-4451-98c8-86147ec0bab9 tempest-GroupSnapshotsTest-1169672434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99646f0d-f850-494d-8636-576010d981e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:22:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c940a24a-f6bd-4451-98c8-86147ec0bab9 tempest-GroupSnapshotsTest-1169672434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99646f0d-f850-494d-8636-576010d981e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:22:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-943359244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8e1ce5bf-2368-4b67-8c1b-ba3c468be0ee,host='devstack@QuobyteHD#QuobyteHD',id=7bec5a44-bb91-475e-84c2-d2dfa9ffa391,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df60dde68c6c4ecb9ae1da55ae49b1d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:22:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:22:08Z,use_quota=True,user_id='5c43bea8dd194538a5806a4085a0a9bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c071660-4003-455e-aff3-0fc13b50daac),volume_type_id=2c071660-4003-455e-aff3-0fc13b50daac)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:22:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c940a24a-f6bd-4451-98c8-86147ec0bab9 tempest-GroupSnapshotsTest-1169672434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81102a5b-d7ce-4e85-be64-a1083d9e2175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:22:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c940a24a-f6bd-4451-98c8-86147ec0bab9 tempest-GroupSnapshotsTest-1169672434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81102a5b-d7ce-4e85-be64-a1083d9e2175) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:22:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c940a24a-f6bd-4451-98c8-86147ec0bab9 tempest-GroupSnapshotsTest-1169672434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e23bf51-e987-47c3-a118-d13af6c3eb68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:22:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c940a24a-f6bd-4451-98c8-86147ec0bab9 tempest-GroupSnapshotsTest-1169672434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e23bf51-e987-47c3-a118-d13af6c3eb68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7bec5a44-bb91-475e-84c2-d2dfa9ffa391', 'volume_name': 'volume-7bec5a44-bb91-475e-84c2-d2dfa9ffa391', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:22:08 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c940a24a-f6bd-4451-98c8-86147ec0bab9 tempest-GroupSnapshotsTest-1169672434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5959eb9b-64fe-4114-9734-4caa670d17e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:22:08 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c940a24a-f6bd-4451-98c8-86147ec0bab9 tempest-GroupSnapshotsTest-1169672434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5959eb9b-64fe-4114-9734-4caa670d17e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:22:08 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c940a24a-f6bd-4451-98c8-86147ec0bab9 tempest-GroupSnapshotsTest-1169672434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (436cb2c3-65d4-4a5e-9395-b8a714737627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:22:08 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-c940a24a-f6bd-4451-98c8-86147ec0bab9 tempest-GroupSnapshotsTest-1169672434 None] Volume 7bec5a44-bb91-475e-84c2-d2dfa9ffa391: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7bec5a44-bb91-475e-84c2-d2dfa9ffa391', 'volume_size': 1} Nov 06 15:22:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c940a24a-f6bd-4451-98c8-86147ec0bab9 tempest-GroupSnapshotsTest-1169672434 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:22:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c940a24a-f6bd-4451-98c8-86147ec0bab9 tempest-GroupSnapshotsTest-1169672434 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:22:08 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c940a24a-f6bd-4451-98c8-86147ec0bab9 tempest-GroupSnapshotsTest-1169672434 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=8e1ce5bf-2368-4b67-8c1b-ba3c468be0ee,created_at=2026-11-06T14:22:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-943359244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8e1ce5bf-2368-4b67-8c1b-ba3c468be0ee,host='devstack@QuobyteHD#QuobyteHD',id=7bec5a44-bb91-475e-84c2-d2dfa9ffa391,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df60dde68c6c4ecb9ae1da55ae49b1d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:22:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:22:08Z,use_quota=True,user_id='5c43bea8dd194538a5806a4085a0a9bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c071660-4003-455e-aff3-0fc13b50daac),volume_type_id=2c071660-4003-455e-aff3-0fc13b50daac)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:22:08 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-c940a24a-f6bd-4451-98c8-86147ec0bab9 tempest-GroupSnapshotsTest-1169672434 None] Creating volume 7bec5a44-bb91-475e-84c2-d2dfa9ffa391 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:22:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c940a24a-f6bd-4451-98c8-86147ec0bab9 tempest-GroupSnapshotsTest-1169672434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:22:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c940a24a-f6bd-4451-98c8-86147ec0bab9 tempest-GroupSnapshotsTest-1169672434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:22:08 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c940a24a-f6bd-4451-98c8-86147ec0bab9 tempest-GroupSnapshotsTest-1169672434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:22:08 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c940a24a-f6bd-4451-98c8-86147ec0bab9 tempest-GroupSnapshotsTest-1169672434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:22:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c940a24a-f6bd-4451-98c8-86147ec0bab9 tempest-GroupSnapshotsTest-1169672434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:22:08 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c940a24a-f6bd-4451-98c8-86147ec0bab9 tempest-GroupSnapshotsTest-1169672434 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:22:08 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-c940a24a-f6bd-4451-98c8-86147ec0bab9 tempest-GroupSnapshotsTest-1169672434 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:22:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c940a24a-f6bd-4451-98c8-86147ec0bab9 tempest-GroupSnapshotsTest-1169672434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-7bec5a44-bb91-475e-84c2-d2dfa9ffa391 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:22:08 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 15:22:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:22:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:22:08 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:22:08 devstack sudo[92088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-7bec5a44-bb91-475e-84c2-d2dfa9ffa391 1073741824 Nov 06 15:22:08 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:22:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:22:08 devstack sudo[92088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:22:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:22:08 devstack sudo[92090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:22:08 devstack sudo[92090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:22:08 devstack sudo[92090]: pam_unix(sudo:session): session closed for user root Nov 06 15:22:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.368s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:22:08 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:22:08 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Running periodic task VolumeManager._thread_info {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 15:22:08 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] thread count: 8 {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 15:22:08 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] thread info: [<_MainThread(MainThread, started 140011251929216)>, , , , , , , ] {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 06 15:22:08 devstack sudo[92088]: pam_unix(sudo:session): session closed for user root Nov 06 15:22:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c940a24a-f6bd-4451-98c8-86147ec0bab9 tempest-GroupSnapshotsTest-1169672434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-7bec5a44-bb91-475e-84c2-d2dfa9ffa391 1073741824" returned: 0 in 0.598s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:22:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c940a24a-f6bd-4451-98c8-86147ec0bab9 tempest-GroupSnapshotsTest-1169672434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-7bec5a44-bb91-475e-84c2-d2dfa9ffa391 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:22:08 devstack sudo[92100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-7bec5a44-bb91-475e-84c2-d2dfa9ffa391 Nov 06 15:22:08 devstack sudo[92100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:22:09 devstack sudo[92100]: pam_unix(sudo:session): session closed for user root Nov 06 15:22:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c940a24a-f6bd-4451-98c8-86147ec0bab9 tempest-GroupSnapshotsTest-1169672434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-7bec5a44-bb91-475e-84c2-d2dfa9ffa391" returned: 0 in 0.369s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:22:09 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c940a24a-f6bd-4451-98c8-86147ec0bab9 tempest-GroupSnapshotsTest-1169672434 None] <== create_volume: return (1033ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:22:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c940a24a-f6bd-4451-98c8-86147ec0bab9 tempest-GroupSnapshotsTest-1169672434 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.035s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:22:09 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c940a24a-f6bd-4451-98c8-86147ec0bab9 tempest-GroupSnapshotsTest-1169672434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (436cb2c3-65d4-4a5e-9395-b8a714737627) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7bec5a44-bb91-475e-84c2-d2dfa9ffa391', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:22:09 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c940a24a-f6bd-4451-98c8-86147ec0bab9 tempest-GroupSnapshotsTest-1169672434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cf88ab7-6504-4651-8eb2-91b7f1a27118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:22:09 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-c940a24a-f6bd-4451-98c8-86147ec0bab9 tempest-GroupSnapshotsTest-1169672434 None] Volume volume-7bec5a44-bb91-475e-84c2-d2dfa9ffa391 (7bec5a44-bb91-475e-84c2-d2dfa9ffa391): created successfully Nov 06 15:22:09 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c940a24a-f6bd-4451-98c8-86147ec0bab9 tempest-GroupSnapshotsTest-1169672434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cf88ab7-6504-4651-8eb2-91b7f1a27118) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:22:09 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c940a24a-f6bd-4451-98c8-86147ec0bab9 tempest-GroupSnapshotsTest-1169672434 None] Flow 'volume_create_manager' (af832698-4891-4d65-bfaa-4ca6ee60812c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:22:09 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-c940a24a-f6bd-4451-98c8-86147ec0bab9 tempest-GroupSnapshotsTest-1169672434 None] Created volume successfully. Nov 06 15:22:10 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-840d2cea-818c-4eb6-802d-96c7d35cce5f req-2c4cd65a-c991-4847-b118-b41b26fd13fc tempest-ServerActionsTestOtherA-1409404420 None] Terminate volume connection completed successfully. Nov 06 15:22:10 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-840d2cea-818c-4eb6-802d-96c7d35cce5f req-2c4cd65a-c991-4847-b118-b41b26fd13fc tempest-ServerActionsTestOtherA-1409404420 None] Deleting attachment 72202e06-fb99-4013-832d-3cd8c0868fc6. {{(pid=87132) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 06 15:22:10 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-6be744bb-13b1-4bb0-963b-f2703b66a622 tempest-GroupSnapshotsTest-1169672434 None] Update group completed successfully. Nov 06 15:22:11 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-abf34de4-8829-412e-af4c-fc30046e53d1 tempest-GroupSnapshotsTest-1169672434 None] Update group completed successfully. Nov 06 15:22:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-840d2cea-818c-4eb6-802d-96c7d35cce5f req-e312c225-f30f-4ce2-8918-99df977c7b36 tempest-ServerActionsTestOtherA-1409404420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:22:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-840d2cea-818c-4eb6-802d-96c7d35cce5f req-e312c225-f30f-4ce2-8918-99df977c7b36 tempest-ServerActionsTestOtherA-1409404420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:22:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-840d2cea-818c-4eb6-802d-96c7d35cce5f req-e312c225-f30f-4ce2-8918-99df977c7b36 tempest-ServerActionsTestOtherA-1409404420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.028s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:22:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-840d2cea-818c-4eb6-802d-96c7d35cce5f req-e312c225-f30f-4ce2-8918-99df977c7b36 tempest-ServerActionsTestOtherA-1409404420 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b', 'name': 'volume-135c21e6-615b-4d80-81f0-bfac6e82d15c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c2c2042f-6177-4456-81d9-2027223ad008', 'enforce_multipath': True} {{(pid=87132) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 15:22:12 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-840d2cea-818c-4eb6-802d-96c7d35cce5f req-e312c225-f30f-4ce2-8918-99df977c7b36 tempest-ServerActionsTestOtherA-1409404420 None] attachment_update completed successfully. Nov 06 15:22:13 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-33c0c4a5-410c-420c-9c9e-1d5cc4bed642 tempest-GroupSnapshotsTest-1169672434 None] Update group completed successfully. Nov 06 15:22:14 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-199531f4-a0c5-4d0e-ba0d-e7190043b9f6 tempest-GroupSnapshotsTest-1169672434 None] Update group completed successfully. Nov 06 15:22:17 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-92355543-9c60-4293-8a39-8861b5e7629d tempest-GroupSnapshotsTest-1169672434 None] GroupSnapshot 651721d7-796c-45ed-a082-e6ed3d6e1eef: creating. Nov 06 15:22:17 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-92355543-9c60-4293-8a39-8861b5e7629d tempest-GroupSnapshotsTest-1169672434 None] Group snapshot 651721d7-796c-45ed-a082-e6ed3d6e1eef: creating. {{(pid=87132) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 06 15:22:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-92355543-9c60-4293-8a39-8861b5e7629d tempest-GroupSnapshotsTest-1169672434 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:22:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-92355543-9c60-4293-8a39-8861b5e7629d tempest-GroupSnapshotsTest-1169672434 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:22:17 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-92355543-9c60-4293-8a39-8861b5e7629d tempest-GroupSnapshotsTest-1169672434 None] Creating offline snapshot 11c0d2fa-2f08-42fb-8823-108fdde6a268 of volume 53c980c7-6b26-4d9f-ae7b-3c563daf1cba {{(pid=87132) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 15:22:17 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2f571db-91bb-4e96-bf6b-02f26060b9f3]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:22:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-92355543-9c60-4293-8a39-8861b5e7629d tempest-GroupSnapshotsTest-1169672434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-53c980c7-6b26-4d9f-ae7b-3c563daf1cba {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:22:17 devstack sudo[92721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-53c980c7-6b26-4d9f-ae7b-3c563daf1cba Nov 06 15:22:17 devstack sudo[92721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:22:18 devstack sudo[92721]: pam_unix(sudo:session): session closed for user root Nov 06 15:22:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-92355543-9c60-4293-8a39-8861b5e7629d tempest-GroupSnapshotsTest-1169672434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-53c980c7-6b26-4d9f-ae7b-3c563daf1cba" returned: 0 in 0.958s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:22:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-92355543-9c60-4293-8a39-8861b5e7629d tempest-GroupSnapshotsTest-1169672434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-53c980c7-6b26-4d9f-ae7b-3c563daf1cba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-53c980c7-6b26-4d9f-ae7b-3c563daf1cba.11c0d2fa-2f08-42fb-8823-108fdde6a268 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:22:18 devstack sudo[92736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-53c980c7-6b26-4d9f-ae7b-3c563daf1cba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-53c980c7-6b26-4d9f-ae7b-3c563daf1cba.11c0d2fa-2f08-42fb-8823-108fdde6a268 1G Nov 06 15:22:18 devstack sudo[92736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:22:19 devstack sudo[92736]: pam_unix(sudo:session): session closed for user root Nov 06 15:22:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-92355543-9c60-4293-8a39-8861b5e7629d tempest-GroupSnapshotsTest-1169672434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-53c980c7-6b26-4d9f-ae7b-3c563daf1cba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-53c980c7-6b26-4d9f-ae7b-3c563daf1cba.11c0d2fa-2f08-42fb-8823-108fdde6a268 1G" returned: 0 in 1.060s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:22:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-92355543-9c60-4293-8a39-8861b5e7629d tempest-GroupSnapshotsTest-1169672434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53c980c7-6b26-4d9f-ae7b-3c563daf1cba -F qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-53c980c7-6b26-4d9f-ae7b-3c563daf1cba.11c0d2fa-2f08-42fb-8823-108fdde6a268 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:22:19 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-cc7e9706-d3a2-4a19-9eca-0583848256f8 tempest-VolumesActionsTest-1966304339 None] Acquiring lock "cinder-9e885d62-094f-49f5-a31b-783730ab54c3" by "attach_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:22:19 devstack sudo[92742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53c980c7-6b26-4d9f-ae7b-3c563daf1cba -F qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-53c980c7-6b26-4d9f-ae7b-3c563daf1cba.11c0d2fa-2f08-42fb-8823-108fdde6a268 Nov 06 15:22:19 devstack sudo[92742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:22:19 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-cc7e9706-d3a2-4a19-9eca-0583848256f8 tempest-VolumesActionsTest-1966304339 None] Lock "cinder-9e885d62-094f-49f5-a31b-783730ab54c3" acquired by "attach_volume" :: waited 0.038s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:22:19 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-cc7e9706-d3a2-4a19-9eca-0583848256f8 tempest-VolumesActionsTest-1966304339 None] Attaching volume 9e885d62-094f-49f5-a31b-783730ab54c3 to instance e278f838-17de-4be9-81cc-62a540b22237 at mountpoint /dev/vdb on host None. Nov 06 15:22:19 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-cc7e9706-d3a2-4a19-9eca-0583848256f8 tempest-VolumesActionsTest-1966304339 None] Attach volume completed successfully. Nov 06 15:22:19 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-cc7e9706-d3a2-4a19-9eca-0583848256f8 tempest-VolumesActionsTest-1966304339 None] Lock "cinder-9e885d62-094f-49f5-a31b-783730ab54c3" released by "attach_volume" :: held 0.256s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:22:19 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-bb444cd8-7042-45fa-813e-5506782f964c tempest-VolumesActionsTest-1966304339 None] Acquiring lock "cinder-9e885d62-094f-49f5-a31b-783730ab54c3-detach_volume" by "detach_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:22:19 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-bb444cd8-7042-45fa-813e-5506782f964c tempest-VolumesActionsTest-1966304339 None] Lock "cinder-9e885d62-094f-49f5-a31b-783730ab54c3-detach_volume" acquired by "detach_volume" :: waited 0.051s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:22:19 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-bb444cd8-7042-45fa-813e-5506782f964c tempest-VolumesActionsTest-1966304339 None] Detaching volume 9e885d62-094f-49f5-a31b-783730ab54c3 from instance e278f838-17de-4be9-81cc-62a540b22237. Nov 06 15:22:19 devstack sudo[92742]: pam_unix(sudo:session): session closed for user root Nov 06 15:22:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-92355543-9c60-4293-8a39-8861b5e7629d tempest-GroupSnapshotsTest-1169672434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53c980c7-6b26-4d9f-ae7b-3c563daf1cba -F qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-53c980c7-6b26-4d9f-ae7b-3c563daf1cba.11c0d2fa-2f08-42fb-8823-108fdde6a268" returned: 0 in 0.771s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:22:20 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-92355543-9c60-4293-8a39-8861b5e7629d tempest-GroupSnapshotsTest-1169672434 None] /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-53c980c7-6b26-4d9f-ae7b-3c563daf1cba.11c0d2fa-2f08-42fb-8823-108fdde6a268 is being set with open permissions: ugo+rw: NotImplementedError Nov 06 15:22:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-92355543-9c60-4293-8a39-8861b5e7629d tempest-GroupSnapshotsTest-1169672434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-53c980c7-6b26-4d9f-ae7b-3c563daf1cba.11c0d2fa-2f08-42fb-8823-108fdde6a268 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:22:20 devstack sudo[92748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-53c980c7-6b26-4d9f-ae7b-3c563daf1cba.11c0d2fa-2f08-42fb-8823-108fdde6a268 Nov 06 15:22:20 devstack sudo[92748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:22:20 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-bb444cd8-7042-45fa-813e-5506782f964c tempest-VolumesActionsTest-1966304339 None] Detach volume completed successfully. Nov 06 15:22:20 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-bb444cd8-7042-45fa-813e-5506782f964c tempest-VolumesActionsTest-1966304339 None] Lock "cinder-9e885d62-094f-49f5-a31b-783730ab54c3-detach_volume" released by "detach_volume" :: held 0.215s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:22:20 devstack sudo[92748]: pam_unix(sudo:session): session closed for user root Nov 06 15:22:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-92355543-9c60-4293-8a39-8861b5e7629d tempest-GroupSnapshotsTest-1169672434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-53c980c7-6b26-4d9f-ae7b-3c563daf1cba.11c0d2fa-2f08-42fb-8823-108fdde6a268" returned: 0 in 0.506s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:22:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-92355543-9c60-4293-8a39-8861b5e7629d tempest-GroupSnapshotsTest-1169672434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-53c980c7-6b26-4d9f-ae7b-3c563daf1cba.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:22:20 devstack sudo[92751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-53c980c7-6b26-4d9f-ae7b-3c563daf1cba.info Nov 06 15:22:20 devstack sudo[92751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:22:21 devstack sudo[92751]: pam_unix(sudo:session): session closed for user root Nov 06 15:22:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-92355543-9c60-4293-8a39-8861b5e7629d tempest-GroupSnapshotsTest-1169672434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-53c980c7-6b26-4d9f-ae7b-3c563daf1cba.info" returned: 0 in 0.478s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:22:21 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-92355543-9c60-4293-8a39-8861b5e7629d tempest-GroupSnapshotsTest-1169672434 None] /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-53c980c7-6b26-4d9f-ae7b-3c563daf1cba.info is being set with open permissions: ugo+rw: NotImplementedError Nov 06 15:22:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-92355543-9c60-4293-8a39-8861b5e7629d tempest-GroupSnapshotsTest-1169672434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-53c980c7-6b26-4d9f-ae7b-3c563daf1cba.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:22:21 devstack sudo[92755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-53c980c7-6b26-4d9f-ae7b-3c563daf1cba.info Nov 06 15:22:21 devstack sudo[92755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:22:21 devstack sudo[92755]: pam_unix(sudo:session): session closed for user root Nov 06 15:22:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-92355543-9c60-4293-8a39-8861b5e7629d tempest-GroupSnapshotsTest-1169672434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-53c980c7-6b26-4d9f-ae7b-3c563daf1cba.info" returned: 0 in 0.343s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:22:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-92355543-9c60-4293-8a39-8861b5e7629d tempest-GroupSnapshotsTest-1169672434 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.389s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:22:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-92355543-9c60-4293-8a39-8861b5e7629d tempest-GroupSnapshotsTest-1169672434 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:22:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-92355543-9c60-4293-8a39-8861b5e7629d tempest-GroupSnapshotsTest-1169672434 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:22:21 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-92355543-9c60-4293-8a39-8861b5e7629d tempest-GroupSnapshotsTest-1169672434 None] Creating offline snapshot d628c62b-c81c-418b-8439-08e773cc5d12 of volume 7bec5a44-bb91-475e-84c2-d2dfa9ffa391 {{(pid=87132) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 15:22:21 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[416dc5a3-3c72-4028-8d77-d70bc0bbbe86]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:22:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-92355543-9c60-4293-8a39-8861b5e7629d tempest-GroupSnapshotsTest-1169672434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-7bec5a44-bb91-475e-84c2-d2dfa9ffa391 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:22:21 devstack sudo[92773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-7bec5a44-bb91-475e-84c2-d2dfa9ffa391 Nov 06 15:22:21 devstack sudo[92773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:22:22 devstack sudo[92773]: pam_unix(sudo:session): session closed for user root Nov 06 15:22:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-92355543-9c60-4293-8a39-8861b5e7629d tempest-GroupSnapshotsTest-1169672434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-7bec5a44-bb91-475e-84c2-d2dfa9ffa391" returned: 0 in 0.506s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:22:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-92355543-9c60-4293-8a39-8861b5e7629d tempest-GroupSnapshotsTest-1169672434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-7bec5a44-bb91-475e-84c2-d2dfa9ffa391,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-7bec5a44-bb91-475e-84c2-d2dfa9ffa391.d628c62b-c81c-418b-8439-08e773cc5d12 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:22:22 devstack sudo[92782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-7bec5a44-bb91-475e-84c2-d2dfa9ffa391,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-7bec5a44-bb91-475e-84c2-d2dfa9ffa391.d628c62b-c81c-418b-8439-08e773cc5d12 1G Nov 06 15:22:22 devstack sudo[92782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:22:22 devstack sudo[92782]: pam_unix(sudo:session): session closed for user root Nov 06 15:22:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-92355543-9c60-4293-8a39-8861b5e7629d tempest-GroupSnapshotsTest-1169672434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-7bec5a44-bb91-475e-84c2-d2dfa9ffa391,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-7bec5a44-bb91-475e-84c2-d2dfa9ffa391.d628c62b-c81c-418b-8439-08e773cc5d12 1G" returned: 0 in 0.666s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:22:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-92355543-9c60-4293-8a39-8861b5e7629d tempest-GroupSnapshotsTest-1169672434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7bec5a44-bb91-475e-84c2-d2dfa9ffa391 -F qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-7bec5a44-bb91-475e-84c2-d2dfa9ffa391.d628c62b-c81c-418b-8439-08e773cc5d12 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:22:22 devstack sudo[92789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7bec5a44-bb91-475e-84c2-d2dfa9ffa391 -F qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-7bec5a44-bb91-475e-84c2-d2dfa9ffa391.d628c62b-c81c-418b-8439-08e773cc5d12 Nov 06 15:22:22 devstack sudo[92789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:22:23 devstack sudo[92789]: pam_unix(sudo:session): session closed for user root Nov 06 15:22:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-92355543-9c60-4293-8a39-8861b5e7629d tempest-GroupSnapshotsTest-1169672434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7bec5a44-bb91-475e-84c2-d2dfa9ffa391 -F qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-7bec5a44-bb91-475e-84c2-d2dfa9ffa391.d628c62b-c81c-418b-8439-08e773cc5d12" returned: 0 in 0.546s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:22:23 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-92355543-9c60-4293-8a39-8861b5e7629d tempest-GroupSnapshotsTest-1169672434 None] /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-7bec5a44-bb91-475e-84c2-d2dfa9ffa391.d628c62b-c81c-418b-8439-08e773cc5d12 is being set with open permissions: ugo+rw: NotImplementedError Nov 06 15:22:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-92355543-9c60-4293-8a39-8861b5e7629d tempest-GroupSnapshotsTest-1169672434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-7bec5a44-bb91-475e-84c2-d2dfa9ffa391.d628c62b-c81c-418b-8439-08e773cc5d12 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:22:23 devstack sudo[92794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-7bec5a44-bb91-475e-84c2-d2dfa9ffa391.d628c62b-c81c-418b-8439-08e773cc5d12 Nov 06 15:22:23 devstack sudo[92794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:22:23 devstack sudo[92794]: pam_unix(sudo:session): session closed for user root Nov 06 15:22:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-92355543-9c60-4293-8a39-8861b5e7629d tempest-GroupSnapshotsTest-1169672434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-7bec5a44-bb91-475e-84c2-d2dfa9ffa391.d628c62b-c81c-418b-8439-08e773cc5d12" returned: 0 in 0.493s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:22:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-92355543-9c60-4293-8a39-8861b5e7629d tempest-GroupSnapshotsTest-1169672434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-7bec5a44-bb91-475e-84c2-d2dfa9ffa391.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:22:24 devstack sudo[92799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-7bec5a44-bb91-475e-84c2-d2dfa9ffa391.info Nov 06 15:22:24 devstack sudo[92799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:22:24 devstack sudo[92799]: pam_unix(sudo:session): session closed for user root Nov 06 15:22:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-92355543-9c60-4293-8a39-8861b5e7629d tempest-GroupSnapshotsTest-1169672434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-7bec5a44-bb91-475e-84c2-d2dfa9ffa391.info" returned: 0 in 0.518s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:22:24 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-92355543-9c60-4293-8a39-8861b5e7629d tempest-GroupSnapshotsTest-1169672434 None] /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-7bec5a44-bb91-475e-84c2-d2dfa9ffa391.info is being set with open permissions: ugo+rw: NotImplementedError Nov 06 15:22:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-92355543-9c60-4293-8a39-8861b5e7629d tempest-GroupSnapshotsTest-1169672434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-7bec5a44-bb91-475e-84c2-d2dfa9ffa391.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:22:24 devstack sudo[92802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-7bec5a44-bb91-475e-84c2-d2dfa9ffa391.info Nov 06 15:22:24 devstack sudo[92802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:22:24 devstack sudo[92802]: pam_unix(sudo:session): session closed for user root Nov 06 15:22:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-92355543-9c60-4293-8a39-8861b5e7629d tempest-GroupSnapshotsTest-1169672434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-7bec5a44-bb91-475e-84c2-d2dfa9ffa391.info" returned: 0 in 0.458s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:22:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-92355543-9c60-4293-8a39-8861b5e7629d tempest-GroupSnapshotsTest-1169672434 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.468s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:22:25 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-92355543-9c60-4293-8a39-8861b5e7629d tempest-GroupSnapshotsTest-1169672434 None] group_snapshot 651721d7-796c-45ed-a082-e6ed3d6e1eef: created successfully Nov 06 15:22:26 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-c4c3fec3-09b7-45b6-97e9-c009066d3495 tempest-GroupSnapshotsTest-1169672434 None] group_snapshot 651721d7-796c-45ed-a082-e6ed3d6e1eef: deleting Nov 06 15:22:26 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c4c3fec3-09b7-45b6-97e9-c009066d3495 tempest-GroupSnapshotsTest-1169672434 None] group_snapshot 651721d7-796c-45ed-a082-e6ed3d6e1eef: deleting {{(pid=87132) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 06 15:22:26 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c4c3fec3-09b7-45b6-97e9-c009066d3495 tempest-GroupSnapshotsTest-1169672434 None] Acquiring lock "cinder-quobyte-53c980c7-6b26-4d9f-ae7b-3c563daf1cba" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:22:26 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c4c3fec3-09b7-45b6-97e9-c009066d3495 tempest-GroupSnapshotsTest-1169672434 None] Lock "cinder-quobyte-53c980c7-6b26-4d9f-ae7b-3c563daf1cba" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:22:26 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c4c3fec3-09b7-45b6-97e9-c009066d3495 tempest-GroupSnapshotsTest-1169672434 None] Acquiring lock "cinder-quobyte-11c0d2fa-2f08-42fb-8823-108fdde6a268" by "_delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:22:26 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c4c3fec3-09b7-45b6-97e9-c009066d3495 tempest-GroupSnapshotsTest-1169672434 None] Lock "cinder-quobyte-11c0d2fa-2f08-42fb-8823-108fdde6a268" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:22:26 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-c4c3fec3-09b7-45b6-97e9-c009066d3495 tempest-GroupSnapshotsTest-1169672434 None] Deleting offline snapshot 11c0d2fa-2f08-42fb-8823-108fdde6a268 of volume 53c980c7-6b26-4d9f-ae7b-3c563daf1cba {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 15:22:26 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-c4c3fec3-09b7-45b6-97e9-c009066d3495 tempest-GroupSnapshotsTest-1169672434 None] snapshot_file for this snap is: volume-53c980c7-6b26-4d9f-ae7b-3c563daf1cba.11c0d2fa-2f08-42fb-8823-108fdde6a268 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 15:22:26 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[65d34c25-b764-4184-b82a-a2fb4e6828d9]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:22:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c4c3fec3-09b7-45b6-97e9-c009066d3495 tempest-GroupSnapshotsTest-1169672434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-53c980c7-6b26-4d9f-ae7b-3c563daf1cba.11c0d2fa-2f08-42fb-8823-108fdde6a268 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:22:26 devstack sudo[92807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-53c980c7-6b26-4d9f-ae7b-3c563daf1cba.11c0d2fa-2f08-42fb-8823-108fdde6a268 Nov 06 15:22:26 devstack sudo[92807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:22:27 devstack sudo[92807]: pam_unix(sudo:session): session closed for user root Nov 06 15:22:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c4c3fec3-09b7-45b6-97e9-c009066d3495 tempest-GroupSnapshotsTest-1169672434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-53c980c7-6b26-4d9f-ae7b-3c563daf1cba.11c0d2fa-2f08-42fb-8823-108fdde6a268" returned: 0 in 0.795s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:22:27 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-c4c3fec3-09b7-45b6-97e9-c009066d3495 tempest-GroupSnapshotsTest-1169672434 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-53c980c7-6b26-4d9f-ae7b-3c563daf1cba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 15:22:27 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2b1cdb0-681b-4ad3-bf1e-f0c88612ccfd]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:22:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c4c3fec3-09b7-45b6-97e9-c009066d3495 tempest-GroupSnapshotsTest-1169672434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-53c980c7-6b26-4d9f-ae7b-3c563daf1cba {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:22:27 devstack sudo[92815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-53c980c7-6b26-4d9f-ae7b-3c563daf1cba Nov 06 15:22:27 devstack sudo[92815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:22:27 devstack sudo[92815]: pam_unix(sudo:session): session closed for user root Nov 06 15:22:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c4c3fec3-09b7-45b6-97e9-c009066d3495 tempest-GroupSnapshotsTest-1169672434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-53c980c7-6b26-4d9f-ae7b-3c563daf1cba" returned: 0 in 0.530s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:22:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c4c3fec3-09b7-45b6-97e9-c009066d3495 tempest-GroupSnapshotsTest-1169672434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-53c980c7-6b26-4d9f-ae7b-3c563daf1cba.11c0d2fa-2f08-42fb-8823-108fdde6a268 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:22:27 devstack sudo[92820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-53c980c7-6b26-4d9f-ae7b-3c563daf1cba.11c0d2fa-2f08-42fb-8823-108fdde6a268 Nov 06 15:22:27 devstack sudo[92820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:22:28 devstack sudo[92820]: pam_unix(sudo:session): session closed for user root Nov 06 15:22:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c4c3fec3-09b7-45b6-97e9-c009066d3495 tempest-GroupSnapshotsTest-1169672434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-53c980c7-6b26-4d9f-ae7b-3c563daf1cba.11c0d2fa-2f08-42fb-8823-108fdde6a268" returned: 0 in 0.461s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:22:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c4c3fec3-09b7-45b6-97e9-c009066d3495 tempest-GroupSnapshotsTest-1169672434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-53c980c7-6b26-4d9f-ae7b-3c563daf1cba.11c0d2fa-2f08-42fb-8823-108fdde6a268 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:22:28 devstack sudo[92827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-53c980c7-6b26-4d9f-ae7b-3c563daf1cba.11c0d2fa-2f08-42fb-8823-108fdde6a268 Nov 06 15:22:28 devstack sudo[92827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:22:28 devstack sudo[92827]: pam_unix(sudo:session): session closed for user root Nov 06 15:22:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c4c3fec3-09b7-45b6-97e9-c009066d3495 tempest-GroupSnapshotsTest-1169672434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-53c980c7-6b26-4d9f-ae7b-3c563daf1cba.11c0d2fa-2f08-42fb-8823-108fdde6a268" returned: 0 in 0.377s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:22:28 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c4c3fec3-09b7-45b6-97e9-c009066d3495 tempest-GroupSnapshotsTest-1169672434 None] Lock "cinder-quobyte-11c0d2fa-2f08-42fb-8823-108fdde6a268" released by "_delete_snapshot" :: held 2.347s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:22:28 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c4c3fec3-09b7-45b6-97e9-c009066d3495 tempest-GroupSnapshotsTest-1169672434 None] Lock "cinder-quobyte-53c980c7-6b26-4d9f-ae7b-3c563daf1cba" released by "delete_snapshot" :: held 2.390s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:22:28 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c4c3fec3-09b7-45b6-97e9-c009066d3495 tempest-GroupSnapshotsTest-1169672434 None] Acquiring lock "cinder-quobyte-7bec5a44-bb91-475e-84c2-d2dfa9ffa391" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:22:28 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c4c3fec3-09b7-45b6-97e9-c009066d3495 tempest-GroupSnapshotsTest-1169672434 None] Lock "cinder-quobyte-7bec5a44-bb91-475e-84c2-d2dfa9ffa391" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:22:28 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c4c3fec3-09b7-45b6-97e9-c009066d3495 tempest-GroupSnapshotsTest-1169672434 None] Acquiring lock "cinder-quobyte-d628c62b-c81c-418b-8439-08e773cc5d12" by "_delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:22:28 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c4c3fec3-09b7-45b6-97e9-c009066d3495 tempest-GroupSnapshotsTest-1169672434 None] Lock "cinder-quobyte-d628c62b-c81c-418b-8439-08e773cc5d12" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:22:28 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-c4c3fec3-09b7-45b6-97e9-c009066d3495 tempest-GroupSnapshotsTest-1169672434 None] Deleting offline snapshot d628c62b-c81c-418b-8439-08e773cc5d12 of volume 7bec5a44-bb91-475e-84c2-d2dfa9ffa391 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 15:22:28 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-c4c3fec3-09b7-45b6-97e9-c009066d3495 tempest-GroupSnapshotsTest-1169672434 None] snapshot_file for this snap is: volume-7bec5a44-bb91-475e-84c2-d2dfa9ffa391.d628c62b-c81c-418b-8439-08e773cc5d12 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 15:22:28 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d7e0d76-6438-4c9c-976f-b93899abf3f2]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:22:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c4c3fec3-09b7-45b6-97e9-c009066d3495 tempest-GroupSnapshotsTest-1169672434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-7bec5a44-bb91-475e-84c2-d2dfa9ffa391.d628c62b-c81c-418b-8439-08e773cc5d12 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:22:28 devstack sudo[92830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-7bec5a44-bb91-475e-84c2-d2dfa9ffa391.d628c62b-c81c-418b-8439-08e773cc5d12 Nov 06 15:22:28 devstack sudo[92830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:22:29 devstack sudo[92830]: pam_unix(sudo:session): session closed for user root Nov 06 15:22:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c4c3fec3-09b7-45b6-97e9-c009066d3495 tempest-GroupSnapshotsTest-1169672434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-7bec5a44-bb91-475e-84c2-d2dfa9ffa391.d628c62b-c81c-418b-8439-08e773cc5d12" returned: 0 in 0.625s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:22:29 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-c4c3fec3-09b7-45b6-97e9-c009066d3495 tempest-GroupSnapshotsTest-1169672434 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7bec5a44-bb91-475e-84c2-d2dfa9ffa391(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 15:22:29 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[f066acce-eb9b-4f07-9ba8-ba3afcba47b2]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:22:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c4c3fec3-09b7-45b6-97e9-c009066d3495 tempest-GroupSnapshotsTest-1169672434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-7bec5a44-bb91-475e-84c2-d2dfa9ffa391 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:22:29 devstack sudo[92855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-7bec5a44-bb91-475e-84c2-d2dfa9ffa391 Nov 06 15:22:29 devstack sudo[92855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:22:30 devstack sudo[92855]: pam_unix(sudo:session): session closed for user root Nov 06 15:22:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c4c3fec3-09b7-45b6-97e9-c009066d3495 tempest-GroupSnapshotsTest-1169672434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-7bec5a44-bb91-475e-84c2-d2dfa9ffa391" returned: 0 in 0.800s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:22:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c4c3fec3-09b7-45b6-97e9-c009066d3495 tempest-GroupSnapshotsTest-1169672434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-7bec5a44-bb91-475e-84c2-d2dfa9ffa391.d628c62b-c81c-418b-8439-08e773cc5d12 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:22:30 devstack sudo[92885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-7bec5a44-bb91-475e-84c2-d2dfa9ffa391.d628c62b-c81c-418b-8439-08e773cc5d12 Nov 06 15:22:30 devstack sudo[92885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:22:30 devstack sudo[92885]: pam_unix(sudo:session): session closed for user root Nov 06 15:22:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c4c3fec3-09b7-45b6-97e9-c009066d3495 tempest-GroupSnapshotsTest-1169672434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-7bec5a44-bb91-475e-84c2-d2dfa9ffa391.d628c62b-c81c-418b-8439-08e773cc5d12" returned: 0 in 0.415s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:22:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c4c3fec3-09b7-45b6-97e9-c009066d3495 tempest-GroupSnapshotsTest-1169672434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-7bec5a44-bb91-475e-84c2-d2dfa9ffa391.d628c62b-c81c-418b-8439-08e773cc5d12 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:22:30 devstack sudo[92890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-7bec5a44-bb91-475e-84c2-d2dfa9ffa391.d628c62b-c81c-418b-8439-08e773cc5d12 Nov 06 15:22:30 devstack sudo[92890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:22:31 devstack sudo[92890]: pam_unix(sudo:session): session closed for user root Nov 06 15:22:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c4c3fec3-09b7-45b6-97e9-c009066d3495 tempest-GroupSnapshotsTest-1169672434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-7bec5a44-bb91-475e-84c2-d2dfa9ffa391.d628c62b-c81c-418b-8439-08e773cc5d12" returned: 0 in 0.297s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:22:31 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c4c3fec3-09b7-45b6-97e9-c009066d3495 tempest-GroupSnapshotsTest-1169672434 None] Lock "cinder-quobyte-d628c62b-c81c-418b-8439-08e773cc5d12" released by "_delete_snapshot" :: held 2.276s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:22:31 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c4c3fec3-09b7-45b6-97e9-c009066d3495 tempest-GroupSnapshotsTest-1169672434 None] Lock "cinder-quobyte-7bec5a44-bb91-475e-84c2-d2dfa9ffa391" released by "delete_snapshot" :: held 2.310s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:22:31 devstack cinder-volume[87132]: WARNING cinder.quota [None req-c4c3fec3-09b7-45b6-97e9-c009066d3495 tempest-GroupSnapshotsTest-1169672434 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-619972448 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-619972448, it is now deprecated. Please use the default quota class for default quota. Nov 06 15:22:31 devstack cinder-volume[87132]: WARNING cinder.quota [None req-c4c3fec3-09b7-45b6-97e9-c009066d3495 tempest-GroupSnapshotsTest-1169672434 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-619972448 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-619972448, it is now deprecated. Please use the default quota class for default quota. Nov 06 15:22:31 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-c4c3fec3-09b7-45b6-97e9-c009066d3495 tempest-GroupSnapshotsTest-1169672434 None] Created reservations ['2307e33e-4ac6-4c8b-b994-fdb2e1c1e50a', '62b6812e-6ba5-4d57-98ad-0c25e0b51b89', '54ee98b7-c01a-4308-b54e-f5dde474bf55', 'b855dc1a-b21b-46b0-b8ab-948dfc9e4a83'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:22:31 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-c4c3fec3-09b7-45b6-97e9-c009066d3495 tempest-GroupSnapshotsTest-1169672434 None] Created reservations ['4f8d3969-50ba-4c28-8446-cbc7bb98dc56', 'e3f888e8-c45c-4f91-9a2f-719296092ab2', '98394cd7-e1fc-4b2b-ae85-d15ada9010a3', 'e6f9c1b1-1944-40fe-b9c8-b423b9656dd3'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:22:31 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-c4c3fec3-09b7-45b6-97e9-c009066d3495 tempest-GroupSnapshotsTest-1169672434 None] group_snapshot 651721d7-796c-45ed-a082-e6ed3d6e1eef: deleted successfully Nov 06 15:22:32 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-3f3075e2-6df4-47f8-b4b9-425e19cdecaf tempest-GroupSnapshotsTest-1169672434 None] Acquiring lock "cinder-quobyte-53c980c7-6b26-4d9f-ae7b-3c563daf1cba" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:22:32 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-3f3075e2-6df4-47f8-b4b9-425e19cdecaf tempest-GroupSnapshotsTest-1169672434 None] Lock "cinder-quobyte-53c980c7-6b26-4d9f-ae7b-3c563daf1cba" acquired by "delete_volume" :: waited 0.019s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:22:32 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[1db77969-8fe3-4ed7-b0c0-d0850a61740a]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:22:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3f3075e2-6df4-47f8-b4b9-425e19cdecaf tempest-GroupSnapshotsTest-1169672434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-53c980c7-6b26-4d9f-ae7b-3c563daf1cba {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:22:32 devstack sudo[92895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-53c980c7-6b26-4d9f-ae7b-3c563daf1cba Nov 06 15:22:32 devstack sudo[92895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:22:33 devstack sudo[92895]: pam_unix(sudo:session): session closed for user root Nov 06 15:22:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3f3075e2-6df4-47f8-b4b9-425e19cdecaf tempest-GroupSnapshotsTest-1169672434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-53c980c7-6b26-4d9f-ae7b-3c563daf1cba" returned: 0 in 0.762s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:22:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3f3075e2-6df4-47f8-b4b9-425e19cdecaf tempest-GroupSnapshotsTest-1169672434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-53c980c7-6b26-4d9f-ae7b-3c563daf1cba {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:22:33 devstack sudo[92951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-53c980c7-6b26-4d9f-ae7b-3c563daf1cba Nov 06 15:22:33 devstack sudo[92951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:22:33 devstack sudo[92951]: pam_unix(sudo:session): session closed for user root Nov 06 15:22:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3f3075e2-6df4-47f8-b4b9-425e19cdecaf tempest-GroupSnapshotsTest-1169672434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-53c980c7-6b26-4d9f-ae7b-3c563daf1cba" returned: 0 in 0.476s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:22:33 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-3f3075e2-6df4-47f8-b4b9-425e19cdecaf tempest-GroupSnapshotsTest-1169672434 None] Lock "cinder-quobyte-53c980c7-6b26-4d9f-ae7b-3c563daf1cba" released by "delete_volume" :: held 1.361s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:22:33 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-3f3075e2-6df4-47f8-b4b9-425e19cdecaf tempest-GroupSnapshotsTest-1169672434 None] Acquiring lock "cinder-quobyte-7bec5a44-bb91-475e-84c2-d2dfa9ffa391" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:22:33 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-3f3075e2-6df4-47f8-b4b9-425e19cdecaf tempest-GroupSnapshotsTest-1169672434 None] Lock "cinder-quobyte-7bec5a44-bb91-475e-84c2-d2dfa9ffa391" acquired by "delete_volume" :: waited 0.031s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:22:33 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c76c525-6bae-4bed-96c0-172d8603a0e5]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:22:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3f3075e2-6df4-47f8-b4b9-425e19cdecaf tempest-GroupSnapshotsTest-1169672434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-7bec5a44-bb91-475e-84c2-d2dfa9ffa391 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:22:34 devstack sudo[92994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-7bec5a44-bb91-475e-84c2-d2dfa9ffa391 Nov 06 15:22:34 devstack sudo[92994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:22:34 devstack sudo[92994]: pam_unix(sudo:session): session closed for user root Nov 06 15:22:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3f3075e2-6df4-47f8-b4b9-425e19cdecaf tempest-GroupSnapshotsTest-1169672434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-7bec5a44-bb91-475e-84c2-d2dfa9ffa391" returned: 0 in 0.446s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:22:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3f3075e2-6df4-47f8-b4b9-425e19cdecaf tempest-GroupSnapshotsTest-1169672434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-7bec5a44-bb91-475e-84c2-d2dfa9ffa391 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:22:34 devstack sudo[93001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-7bec5a44-bb91-475e-84c2-d2dfa9ffa391 Nov 06 15:22:34 devstack sudo[93001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:22:34 devstack sudo[93001]: pam_unix(sudo:session): session closed for user root Nov 06 15:22:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3f3075e2-6df4-47f8-b4b9-425e19cdecaf tempest-GroupSnapshotsTest-1169672434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-7bec5a44-bb91-475e-84c2-d2dfa9ffa391" returned: 0 in 0.361s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:22:34 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-3f3075e2-6df4-47f8-b4b9-425e19cdecaf tempest-GroupSnapshotsTest-1169672434 None] Lock "cinder-quobyte-7bec5a44-bb91-475e-84c2-d2dfa9ffa391" released by "delete_volume" :: held 0.950s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:22:35 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-3f3075e2-6df4-47f8-b4b9-425e19cdecaf tempest-GroupSnapshotsTest-1169672434 None] Created reservations ['0dc5b9ff-23c1-483b-b28d-2d76017c0515'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:22:35 devstack cinder-volume[87132]: WARNING cinder.quota [None req-3f3075e2-6df4-47f8-b4b9-425e19cdecaf tempest-GroupSnapshotsTest-1169672434 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-619972448 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-619972448, it is now deprecated. Please use the default quota class for default quota. Nov 06 15:22:35 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-3f3075e2-6df4-47f8-b4b9-425e19cdecaf tempest-GroupSnapshotsTest-1169672434 None] Created reservations ['2a2c1c00-669e-4ef5-9145-5c8f9bc688de', '8e2813f2-2e8e-4635-81d0-87d6171c0f0a', '5cf0a094-4c03-4985-b276-13d455d75b2b', 'da1c2074-65a0-4198-ab45-ec46a5e3d78f'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:22:35 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-3f3075e2-6df4-47f8-b4b9-425e19cdecaf tempest-GroupSnapshotsTest-1169672434 None] Created reservations ['4c553313-1130-4eec-8aa5-59edec6ab8fa', '77ce7ccd-97da-4c9e-b60e-43e929a4c64d', 'cfda71af-10af-4bb6-9fcd-1fcde47ae3d8', '10286d49-bc11-4ae9-8eb4-024c85721f5c'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:22:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3f3075e2-6df4-47f8-b4b9-425e19cdecaf tempest-GroupSnapshotsTest-1169672434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:22:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3f3075e2-6df4-47f8-b4b9-425e19cdecaf tempest-GroupSnapshotsTest-1169672434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:22:35 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3f3075e2-6df4-47f8-b4b9-425e19cdecaf tempest-GroupSnapshotsTest-1169672434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:22:35 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3f3075e2-6df4-47f8-b4b9-425e19cdecaf tempest-GroupSnapshotsTest-1169672434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:22:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3f3075e2-6df4-47f8-b4b9-425e19cdecaf tempest-GroupSnapshotsTest-1169672434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:22:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3f3075e2-6df4-47f8-b4b9-425e19cdecaf tempest-GroupSnapshotsTest-1169672434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:22:35 devstack sudo[93008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:22:35 devstack sudo[93008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:22:35 devstack sudo[93008]: pam_unix(sudo:session): session closed for user root Nov 06 15:22:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3f3075e2-6df4-47f8-b4b9-425e19cdecaf tempest-GroupSnapshotsTest-1169672434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.293s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:22:35 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-3f3075e2-6df4-47f8-b4b9-425e19cdecaf tempest-GroupSnapshotsTest-1169672434 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:22:35 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-3f3075e2-6df4-47f8-b4b9-425e19cdecaf tempest-GroupSnapshotsTest-1169672434 None] Delete group completed successfully. Nov 06 15:22:36 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6d216793-eaed-4675-9925-5cfde3ad6781 tempest-VolumesActionsTest-1966304339 None] Acquiring lock "cinder-9e885d62-094f-49f5-a31b-783730ab54c3" by "attach_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:22:36 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6d216793-eaed-4675-9925-5cfde3ad6781 tempest-VolumesActionsTest-1966304339 None] Lock "cinder-9e885d62-094f-49f5-a31b-783730ab54c3" acquired by "attach_volume" :: waited 0.020s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:22:36 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-6d216793-eaed-4675-9925-5cfde3ad6781 tempest-VolumesActionsTest-1966304339 None] Attaching volume 9e885d62-094f-49f5-a31b-783730ab54c3 to instance 09a8c278-ce66-443b-b8a2-b49f8928da16 at mountpoint /dev/vdb on host None. Nov 06 15:22:36 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-6d216793-eaed-4675-9925-5cfde3ad6781 tempest-VolumesActionsTest-1966304339 None] Attach volume completed successfully. Nov 06 15:22:36 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6d216793-eaed-4675-9925-5cfde3ad6781 tempest-VolumesActionsTest-1966304339 None] Lock "cinder-9e885d62-094f-49f5-a31b-783730ab54c3" released by "attach_volume" :: held 0.153s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:22:37 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-d6504f92-6a5e-40b8-ad67-425786849d33 tempest-GroupSnapshotsTest-1169672434 None] Group tempest-GroupSnapshotsTest-Group-1031723320: creating Nov 06 15:22:37 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-d6504f92-6a5e-40b8-ad67-425786849d33 tempest-GroupSnapshotsTest-1169672434 None] Group tempest-GroupSnapshotsTest-Group-1031723320: created successfully Nov 06 15:22:37 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-d6504f92-6a5e-40b8-ad67-425786849d33 tempest-GroupSnapshotsTest-1169672434 None] Create group completed successfully. Nov 06 15:22:37 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-81f65fae-ba80-48d7-916f-c9dc63a0bdf6 tempest-VolumesActionsTest-1966304339 None] Acquiring lock "cinder-9e885d62-094f-49f5-a31b-783730ab54c3-detach_volume" by "detach_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:22:37 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-81f65fae-ba80-48d7-916f-c9dc63a0bdf6 tempest-VolumesActionsTest-1966304339 None] Lock "cinder-9e885d62-094f-49f5-a31b-783730ab54c3-detach_volume" acquired by "detach_volume" :: waited 0.024s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:22:37 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-81f65fae-ba80-48d7-916f-c9dc63a0bdf6 tempest-VolumesActionsTest-1966304339 None] Detaching volume 9e885d62-094f-49f5-a31b-783730ab54c3 from instance 09a8c278-ce66-443b-b8a2-b49f8928da16. Nov 06 15:22:37 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-81f65fae-ba80-48d7-916f-c9dc63a0bdf6 tempest-VolumesActionsTest-1966304339 None] Detach volume completed successfully. Nov 06 15:22:37 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-81f65fae-ba80-48d7-916f-c9dc63a0bdf6 tempest-VolumesActionsTest-1966304339 None] Lock "cinder-9e885d62-094f-49f5-a31b-783730ab54c3-detach_volume" released by "detach_volume" :: held 0.094s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:22:39 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbdad716-ba5f-4daf-8722-51e7fbb2f6cd tempest-GroupSnapshotsTest-1169672434 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:22:39 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fbdad716-ba5f-4daf-8722-51e7fbb2f6cd tempest-GroupSnapshotsTest-1169672434 None] Flow 'volume_create_manager' (f1ab3099-be8c-4a1e-a202-85ea57c30f0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:22:39 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fbdad716-ba5f-4daf-8722-51e7fbb2f6cd tempest-GroupSnapshotsTest-1169672434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fcdc76e-4ef4-4ec2-a7f2-40f6ae2acedf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:22:39 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fbdad716-ba5f-4daf-8722-51e7fbb2f6cd tempest-GroupSnapshotsTest-1169672434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fcdc76e-4ef4-4ec2-a7f2-40f6ae2acedf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:22:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-259917746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bf62977d-0a67-437d-9d71-73565e83b0ed,host='devstack@QuobyteHD#QuobyteHD',id=66c17603-4b0b-4b0c-ad7d-9ac42b443898,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df60dde68c6c4ecb9ae1da55ae49b1d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:22:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:22:39Z,use_quota=True,user_id='5c43bea8dd194538a5806a4085a0a9bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(851544d8-c9a0-49a3-8a33-1279116767b3),volume_type_id=851544d8-c9a0-49a3-8a33-1279116767b3)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:22:39 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fbdad716-ba5f-4daf-8722-51e7fbb2f6cd tempest-GroupSnapshotsTest-1169672434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83ee5801-060d-4df7-bafa-77a5b39d79dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:22:39 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fbdad716-ba5f-4daf-8722-51e7fbb2f6cd tempest-GroupSnapshotsTest-1169672434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83ee5801-060d-4df7-bafa-77a5b39d79dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:22:39 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fbdad716-ba5f-4daf-8722-51e7fbb2f6cd tempest-GroupSnapshotsTest-1169672434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6c3c50d-88a3-4ba3-9c52-8ba499d6b046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:22:39 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fbdad716-ba5f-4daf-8722-51e7fbb2f6cd tempest-GroupSnapshotsTest-1169672434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6c3c50d-88a3-4ba3-9c52-8ba499d6b046) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66c17603-4b0b-4b0c-ad7d-9ac42b443898', 'volume_name': 'volume-66c17603-4b0b-4b0c-ad7d-9ac42b443898', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:22:39 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fbdad716-ba5f-4daf-8722-51e7fbb2f6cd tempest-GroupSnapshotsTest-1169672434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e96eca4-ae25-4cd2-8dc4-fc6a9b02bc1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:22:39 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fbdad716-ba5f-4daf-8722-51e7fbb2f6cd tempest-GroupSnapshotsTest-1169672434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e96eca4-ae25-4cd2-8dc4-fc6a9b02bc1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:22:39 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fbdad716-ba5f-4daf-8722-51e7fbb2f6cd tempest-GroupSnapshotsTest-1169672434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2eed696f-b5d4-4d68-a130-8e0fda8b41f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:22:39 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-fbdad716-ba5f-4daf-8722-51e7fbb2f6cd tempest-GroupSnapshotsTest-1169672434 None] Volume 66c17603-4b0b-4b0c-ad7d-9ac42b443898: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66c17603-4b0b-4b0c-ad7d-9ac42b443898', 'volume_size': 1} Nov 06 15:22:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-fbdad716-ba5f-4daf-8722-51e7fbb2f6cd tempest-GroupSnapshotsTest-1169672434 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:22:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-fbdad716-ba5f-4daf-8722-51e7fbb2f6cd tempest-GroupSnapshotsTest-1169672434 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:22:39 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-fbdad716-ba5f-4daf-8722-51e7fbb2f6cd tempest-GroupSnapshotsTest-1169672434 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=bf62977d-0a67-437d-9d71-73565e83b0ed,created_at=2026-11-06T14:22:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-259917746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bf62977d-0a67-437d-9d71-73565e83b0ed,host='devstack@QuobyteHD#QuobyteHD',id=66c17603-4b0b-4b0c-ad7d-9ac42b443898,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df60dde68c6c4ecb9ae1da55ae49b1d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:22:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:22:39Z,use_quota=True,user_id='5c43bea8dd194538a5806a4085a0a9bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(851544d8-c9a0-49a3-8a33-1279116767b3),volume_type_id=851544d8-c9a0-49a3-8a33-1279116767b3)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:22:39 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-fbdad716-ba5f-4daf-8722-51e7fbb2f6cd tempest-GroupSnapshotsTest-1169672434 None] Creating volume 66c17603-4b0b-4b0c-ad7d-9ac42b443898 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:22:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-fbdad716-ba5f-4daf-8722-51e7fbb2f6cd tempest-GroupSnapshotsTest-1169672434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:22:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-fbdad716-ba5f-4daf-8722-51e7fbb2f6cd tempest-GroupSnapshotsTest-1169672434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:22:39 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-fbdad716-ba5f-4daf-8722-51e7fbb2f6cd tempest-GroupSnapshotsTest-1169672434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:22:39 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-fbdad716-ba5f-4daf-8722-51e7fbb2f6cd tempest-GroupSnapshotsTest-1169672434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:22:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-fbdad716-ba5f-4daf-8722-51e7fbb2f6cd tempest-GroupSnapshotsTest-1169672434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:22:39 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-fbdad716-ba5f-4daf-8722-51e7fbb2f6cd tempest-GroupSnapshotsTest-1169672434 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:22:39 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-fbdad716-ba5f-4daf-8722-51e7fbb2f6cd tempest-GroupSnapshotsTest-1169672434 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:22:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-fbdad716-ba5f-4daf-8722-51e7fbb2f6cd tempest-GroupSnapshotsTest-1169672434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-66c17603-4b0b-4b0c-ad7d-9ac42b443898 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:22:39 devstack sudo[93033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-66c17603-4b0b-4b0c-ad7d-9ac42b443898 1073741824 Nov 06 15:22:39 devstack sudo[93033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:22:40 devstack sudo[93033]: pam_unix(sudo:session): session closed for user root Nov 06 15:22:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-fbdad716-ba5f-4daf-8722-51e7fbb2f6cd tempest-GroupSnapshotsTest-1169672434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-66c17603-4b0b-4b0c-ad7d-9ac42b443898 1073741824" returned: 0 in 0.742s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:22:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-fbdad716-ba5f-4daf-8722-51e7fbb2f6cd tempest-GroupSnapshotsTest-1169672434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-66c17603-4b0b-4b0c-ad7d-9ac42b443898 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:22:40 devstack sudo[93042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-66c17603-4b0b-4b0c-ad7d-9ac42b443898 Nov 06 15:22:40 devstack sudo[93042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:22:40 devstack sudo[93042]: pam_unix(sudo:session): session closed for user root Nov 06 15:22:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-fbdad716-ba5f-4daf-8722-51e7fbb2f6cd tempest-GroupSnapshotsTest-1169672434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-66c17603-4b0b-4b0c-ad7d-9ac42b443898" returned: 0 in 0.263s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:22:40 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-fbdad716-ba5f-4daf-8722-51e7fbb2f6cd tempest-GroupSnapshotsTest-1169672434 None] <== create_volume: return (1075ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:22:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-fbdad716-ba5f-4daf-8722-51e7fbb2f6cd tempest-GroupSnapshotsTest-1169672434 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.079s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:22:40 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fbdad716-ba5f-4daf-8722-51e7fbb2f6cd tempest-GroupSnapshotsTest-1169672434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2eed696f-b5d4-4d68-a130-8e0fda8b41f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66c17603-4b0b-4b0c-ad7d-9ac42b443898', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:22:40 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fbdad716-ba5f-4daf-8722-51e7fbb2f6cd tempest-GroupSnapshotsTest-1169672434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76b5f521-aeaf-4e5f-8c02-74cdfa76630a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:22:40 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-fbdad716-ba5f-4daf-8722-51e7fbb2f6cd tempest-GroupSnapshotsTest-1169672434 None] Volume volume-66c17603-4b0b-4b0c-ad7d-9ac42b443898 (66c17603-4b0b-4b0c-ad7d-9ac42b443898): created successfully Nov 06 15:22:40 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fbdad716-ba5f-4daf-8722-51e7fbb2f6cd tempest-GroupSnapshotsTest-1169672434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76b5f521-aeaf-4e5f-8c02-74cdfa76630a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:22:40 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fbdad716-ba5f-4daf-8722-51e7fbb2f6cd tempest-GroupSnapshotsTest-1169672434 None] Flow 'volume_create_manager' (f1ab3099-be8c-4a1e-a202-85ea57c30f0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:22:40 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-fbdad716-ba5f-4daf-8722-51e7fbb2f6cd tempest-GroupSnapshotsTest-1169672434 None] Created volume successfully. Nov 06 15:22:42 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-12113e71-9989-4e8f-87ef-a49bf9a95702 tempest-GroupSnapshotsTest-1169672434 None] GroupSnapshot 387ea5d8-cdf4-48d7-a71a-4207370059e1: creating. Nov 06 15:22:42 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-12113e71-9989-4e8f-87ef-a49bf9a95702 tempest-GroupSnapshotsTest-1169672434 None] Group snapshot 387ea5d8-cdf4-48d7-a71a-4207370059e1: creating. {{(pid=87132) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 06 15:22:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-12113e71-9989-4e8f-87ef-a49bf9a95702 tempest-GroupSnapshotsTest-1169672434 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:22:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-12113e71-9989-4e8f-87ef-a49bf9a95702 tempest-GroupSnapshotsTest-1169672434 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:22:42 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-12113e71-9989-4e8f-87ef-a49bf9a95702 tempest-GroupSnapshotsTest-1169672434 None] Creating offline snapshot 01e4dd15-9b3b-4f5d-85a3-1c69964a6678 of volume 66c17603-4b0b-4b0c-ad7d-9ac42b443898 {{(pid=87132) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 15:22:42 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca40c360-4843-44b2-8a32-f43d9a2e1e9f]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:22:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-12113e71-9989-4e8f-87ef-a49bf9a95702 tempest-GroupSnapshotsTest-1169672434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-66c17603-4b0b-4b0c-ad7d-9ac42b443898 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:22:42 devstack sudo[93050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-66c17603-4b0b-4b0c-ad7d-9ac42b443898 Nov 06 15:22:42 devstack sudo[93050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:22:42 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-162434ed-cc89-47c2-a2a7-20b7a5ffcdeb req-21b4109e-2b42-42e1-b71b-c9901ec889bb tempest-ServerActionsTestOtherA-1409404420 None] Terminate volume connection completed successfully. Nov 06 15:22:42 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-162434ed-cc89-47c2-a2a7-20b7a5ffcdeb req-21b4109e-2b42-42e1-b71b-c9901ec889bb tempest-ServerActionsTestOtherA-1409404420 None] Deleting attachment c2c2042f-6177-4456-81d9-2027223ad008. {{(pid=87132) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 06 15:22:42 devstack sudo[93050]: pam_unix(sudo:session): session closed for user root Nov 06 15:22:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-12113e71-9989-4e8f-87ef-a49bf9a95702 tempest-GroupSnapshotsTest-1169672434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-66c17603-4b0b-4b0c-ad7d-9ac42b443898" returned: 0 in 0.557s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:22:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-12113e71-9989-4e8f-87ef-a49bf9a95702 tempest-GroupSnapshotsTest-1169672434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-66c17603-4b0b-4b0c-ad7d-9ac42b443898,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-66c17603-4b0b-4b0c-ad7d-9ac42b443898.01e4dd15-9b3b-4f5d-85a3-1c69964a6678 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:22:42 devstack sudo[93058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-66c17603-4b0b-4b0c-ad7d-9ac42b443898,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-66c17603-4b0b-4b0c-ad7d-9ac42b443898.01e4dd15-9b3b-4f5d-85a3-1c69964a6678 1G Nov 06 15:22:42 devstack sudo[93058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:22:43 devstack sudo[93058]: pam_unix(sudo:session): session closed for user root Nov 06 15:22:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-12113e71-9989-4e8f-87ef-a49bf9a95702 tempest-GroupSnapshotsTest-1169672434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-66c17603-4b0b-4b0c-ad7d-9ac42b443898,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-66c17603-4b0b-4b0c-ad7d-9ac42b443898.01e4dd15-9b3b-4f5d-85a3-1c69964a6678 1G" returned: 0 in 0.591s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:22:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-12113e71-9989-4e8f-87ef-a49bf9a95702 tempest-GroupSnapshotsTest-1169672434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66c17603-4b0b-4b0c-ad7d-9ac42b443898 -F qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-66c17603-4b0b-4b0c-ad7d-9ac42b443898.01e4dd15-9b3b-4f5d-85a3-1c69964a6678 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:22:43 devstack sudo[93064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66c17603-4b0b-4b0c-ad7d-9ac42b443898 -F qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-66c17603-4b0b-4b0c-ad7d-9ac42b443898.01e4dd15-9b3b-4f5d-85a3-1c69964a6678 Nov 06 15:22:43 devstack sudo[93064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:22:43 devstack sudo[93064]: pam_unix(sudo:session): session closed for user root Nov 06 15:22:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-12113e71-9989-4e8f-87ef-a49bf9a95702 tempest-GroupSnapshotsTest-1169672434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66c17603-4b0b-4b0c-ad7d-9ac42b443898 -F qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-66c17603-4b0b-4b0c-ad7d-9ac42b443898.01e4dd15-9b3b-4f5d-85a3-1c69964a6678" returned: 0 in 0.393s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:22:43 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-12113e71-9989-4e8f-87ef-a49bf9a95702 tempest-GroupSnapshotsTest-1169672434 None] /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-66c17603-4b0b-4b0c-ad7d-9ac42b443898.01e4dd15-9b3b-4f5d-85a3-1c69964a6678 is being set with open permissions: ugo+rw: NotImplementedError Nov 06 15:22:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-12113e71-9989-4e8f-87ef-a49bf9a95702 tempest-GroupSnapshotsTest-1169672434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-66c17603-4b0b-4b0c-ad7d-9ac42b443898.01e4dd15-9b3b-4f5d-85a3-1c69964a6678 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:22:43 devstack sudo[93070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-66c17603-4b0b-4b0c-ad7d-9ac42b443898.01e4dd15-9b3b-4f5d-85a3-1c69964a6678 Nov 06 15:22:43 devstack sudo[93070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:22:44 devstack sudo[93070]: pam_unix(sudo:session): session closed for user root Nov 06 15:22:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-12113e71-9989-4e8f-87ef-a49bf9a95702 tempest-GroupSnapshotsTest-1169672434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-66c17603-4b0b-4b0c-ad7d-9ac42b443898.01e4dd15-9b3b-4f5d-85a3-1c69964a6678" returned: 0 in 0.383s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:22:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-12113e71-9989-4e8f-87ef-a49bf9a95702 tempest-GroupSnapshotsTest-1169672434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-66c17603-4b0b-4b0c-ad7d-9ac42b443898.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:22:44 devstack sudo[93091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-66c17603-4b0b-4b0c-ad7d-9ac42b443898.info Nov 06 15:22:44 devstack sudo[93091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:22:44 devstack sudo[93091]: pam_unix(sudo:session): session closed for user root Nov 06 15:22:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-12113e71-9989-4e8f-87ef-a49bf9a95702 tempest-GroupSnapshotsTest-1169672434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-66c17603-4b0b-4b0c-ad7d-9ac42b443898.info" returned: 0 in 0.358s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:22:44 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-12113e71-9989-4e8f-87ef-a49bf9a95702 tempest-GroupSnapshotsTest-1169672434 None] /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-66c17603-4b0b-4b0c-ad7d-9ac42b443898.info is being set with open permissions: ugo+rw: NotImplementedError Nov 06 15:22:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-12113e71-9989-4e8f-87ef-a49bf9a95702 tempest-GroupSnapshotsTest-1169672434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-66c17603-4b0b-4b0c-ad7d-9ac42b443898.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:22:44 devstack sudo[93098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-66c17603-4b0b-4b0c-ad7d-9ac42b443898.info Nov 06 15:22:44 devstack sudo[93098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:22:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f727e5a1-119e-4845-b594-a15a00b0370c tempest-VolumesActionsTest-1966304339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:22:45 devstack sudo[93098]: pam_unix(sudo:session): session closed for user root Nov 06 15:22:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-12113e71-9989-4e8f-87ef-a49bf9a95702 tempest-GroupSnapshotsTest-1169672434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-66c17603-4b0b-4b0c-ad7d-9ac42b443898.info" returned: 0 in 0.462s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:22:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-12113e71-9989-4e8f-87ef-a49bf9a95702 tempest-GroupSnapshotsTest-1169672434 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.886s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:22:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f727e5a1-119e-4845-b594-a15a00b0370c tempest-VolumesActionsTest-1966304339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.264s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:22:45 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[b273fa6d-b05f-4406-a6a7-e7140465f50e]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:22:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f727e5a1-119e-4845-b594-a15a00b0370c tempest-VolumesActionsTest-1966304339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-9e885d62-094f-49f5-a31b-783730ab54c3 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:22:45 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-12113e71-9989-4e8f-87ef-a49bf9a95702 tempest-GroupSnapshotsTest-1169672434 None] group_snapshot 387ea5d8-cdf4-48d7-a71a-4207370059e1: created successfully Nov 06 15:22:45 devstack sudo[93103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-9e885d62-094f-49f5-a31b-783730ab54c3 Nov 06 15:22:45 devstack sudo[93103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:22:45 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-23b55f45-95f0-484a-9930-1f3b04682412 tempest-GroupSnapshotsTest-1169672434 None] group_snapshot 387ea5d8-cdf4-48d7-a71a-4207370059e1: deleting Nov 06 15:22:45 devstack sudo[93103]: pam_unix(sudo:session): session closed for user root Nov 06 15:22:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f727e5a1-119e-4845-b594-a15a00b0370c tempest-VolumesActionsTest-1966304339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-9e885d62-094f-49f5-a31b-783730ab54c3" returned: 0 in 0.601s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:22:45 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-23b55f45-95f0-484a-9930-1f3b04682412 tempest-GroupSnapshotsTest-1169672434 None] group_snapshot 387ea5d8-cdf4-48d7-a71a-4207370059e1: deleting {{(pid=87132) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 06 15:22:45 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-23b55f45-95f0-484a-9930-1f3b04682412 tempest-GroupSnapshotsTest-1169672434 None] Acquiring lock "cinder-quobyte-66c17603-4b0b-4b0c-ad7d-9ac42b443898" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:22:45 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fc31eb5-6a3c-42f7-8e3e-d4fe8151e816]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:22:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f727e5a1-119e-4845-b594-a15a00b0370c tempest-VolumesActionsTest-1966304339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-9e885d62-094f-49f5-a31b-783730ab54c3 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:22:45 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-23b55f45-95f0-484a-9930-1f3b04682412 tempest-GroupSnapshotsTest-1169672434 None] Lock "cinder-quobyte-66c17603-4b0b-4b0c-ad7d-9ac42b443898" acquired by "delete_snapshot" :: waited 0.046s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:22:45 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-23b55f45-95f0-484a-9930-1f3b04682412 tempest-GroupSnapshotsTest-1169672434 None] Acquiring lock "cinder-quobyte-01e4dd15-9b3b-4f5d-85a3-1c69964a6678" by "_delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:22:45 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-23b55f45-95f0-484a-9930-1f3b04682412 tempest-GroupSnapshotsTest-1169672434 None] Lock "cinder-quobyte-01e4dd15-9b3b-4f5d-85a3-1c69964a6678" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:22:45 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-23b55f45-95f0-484a-9930-1f3b04682412 tempest-GroupSnapshotsTest-1169672434 None] Deleting offline snapshot 01e4dd15-9b3b-4f5d-85a3-1c69964a6678 of volume 66c17603-4b0b-4b0c-ad7d-9ac42b443898 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 15:22:45 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-23b55f45-95f0-484a-9930-1f3b04682412 tempest-GroupSnapshotsTest-1169672434 None] snapshot_file for this snap is: volume-66c17603-4b0b-4b0c-ad7d-9ac42b443898.01e4dd15-9b3b-4f5d-85a3-1c69964a6678 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 15:22:45 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa3e2e71-15e4-46c6-b3a1-b708bcc1b5f2]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:22:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-23b55f45-95f0-484a-9930-1f3b04682412 tempest-GroupSnapshotsTest-1169672434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-66c17603-4b0b-4b0c-ad7d-9ac42b443898.01e4dd15-9b3b-4f5d-85a3-1c69964a6678 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:22:45 devstack sudo[93110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-9e885d62-094f-49f5-a31b-783730ab54c3 Nov 06 15:22:45 devstack sudo[93110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:22:46 devstack sudo[93112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-66c17603-4b0b-4b0c-ad7d-9ac42b443898.01e4dd15-9b3b-4f5d-85a3-1c69964a6678 Nov 06 15:22:46 devstack sudo[93112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:22:46 devstack sudo[93110]: pam_unix(sudo:session): session closed for user root Nov 06 15:22:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f727e5a1-119e-4845-b594-a15a00b0370c tempest-VolumesActionsTest-1966304339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-9e885d62-094f-49f5-a31b-783730ab54c3" returned: 0 in 0.480s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:22:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f727e5a1-119e-4845-b594-a15a00b0370c tempest-VolumesActionsTest-1966304339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-9e885d62-094f-49f5-a31b-783730ab54c3 /opt/stack/data/cinder/conversion/9e885d62-094f-49f5-a31b-783730ab54c3.temp_image.3e91a966-2337-435a-bb67-e630b7f74e4al5mk8fel.img {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:22:46 devstack sudo[93117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-9e885d62-094f-49f5-a31b-783730ab54c3 /opt/stack/data/cinder/conversion/9e885d62-094f-49f5-a31b-783730ab54c3.temp_image.3e91a966-2337-435a-bb67-e630b7f74e4al5mk8fel.img Nov 06 15:22:46 devstack sudo[93117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:22:46 devstack sudo[93112]: pam_unix(sudo:session): session closed for user root Nov 06 15:22:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-23b55f45-95f0-484a-9930-1f3b04682412 tempest-GroupSnapshotsTest-1169672434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-66c17603-4b0b-4b0c-ad7d-9ac42b443898.01e4dd15-9b3b-4f5d-85a3-1c69964a6678" returned: 0 in 0.510s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:22:46 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-23b55f45-95f0-484a-9930-1f3b04682412 tempest-GroupSnapshotsTest-1169672434 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-66c17603-4b0b-4b0c-ad7d-9ac42b443898(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 15:22:46 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[acf11c6c-a8da-4a7c-9704-486f6a245bd7]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:22:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-23b55f45-95f0-484a-9930-1f3b04682412 tempest-GroupSnapshotsTest-1169672434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-66c17603-4b0b-4b0c-ad7d-9ac42b443898 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:22:46 devstack sudo[93123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-66c17603-4b0b-4b0c-ad7d-9ac42b443898 Nov 06 15:22:46 devstack sudo[93123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:22:47 devstack sudo[93123]: pam_unix(sudo:session): session closed for user root Nov 06 15:22:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-23b55f45-95f0-484a-9930-1f3b04682412 tempest-GroupSnapshotsTest-1169672434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-66c17603-4b0b-4b0c-ad7d-9ac42b443898" returned: 0 in 0.915s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:22:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-23b55f45-95f0-484a-9930-1f3b04682412 tempest-GroupSnapshotsTest-1169672434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-66c17603-4b0b-4b0c-ad7d-9ac42b443898.01e4dd15-9b3b-4f5d-85a3-1c69964a6678 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:22:47 devstack sudo[93139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-66c17603-4b0b-4b0c-ad7d-9ac42b443898.01e4dd15-9b3b-4f5d-85a3-1c69964a6678 Nov 06 15:22:47 devstack sudo[93139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:22:48 devstack sudo[93139]: pam_unix(sudo:session): session closed for user root Nov 06 15:22:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-23b55f45-95f0-484a-9930-1f3b04682412 tempest-GroupSnapshotsTest-1169672434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-66c17603-4b0b-4b0c-ad7d-9ac42b443898.01e4dd15-9b3b-4f5d-85a3-1c69964a6678" returned: 0 in 0.817s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:22:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-23b55f45-95f0-484a-9930-1f3b04682412 tempest-GroupSnapshotsTest-1169672434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-66c17603-4b0b-4b0c-ad7d-9ac42b443898.01e4dd15-9b3b-4f5d-85a3-1c69964a6678 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:22:48 devstack sudo[93145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-66c17603-4b0b-4b0c-ad7d-9ac42b443898.01e4dd15-9b3b-4f5d-85a3-1c69964a6678 Nov 06 15:22:48 devstack sudo[93145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:22:48 devstack sudo[93145]: pam_unix(sudo:session): session closed for user root Nov 06 15:22:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-23b55f45-95f0-484a-9930-1f3b04682412 tempest-GroupSnapshotsTest-1169672434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-66c17603-4b0b-4b0c-ad7d-9ac42b443898.01e4dd15-9b3b-4f5d-85a3-1c69964a6678" returned: 0 in 0.577s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:22:48 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-23b55f45-95f0-484a-9930-1f3b04682412 tempest-GroupSnapshotsTest-1169672434 None] Lock "cinder-quobyte-01e4dd15-9b3b-4f5d-85a3-1c69964a6678" released by "_delete_snapshot" :: held 3.072s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:22:48 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-23b55f45-95f0-484a-9930-1f3b04682412 tempest-GroupSnapshotsTest-1169672434 None] Lock "cinder-quobyte-66c17603-4b0b-4b0c-ad7d-9ac42b443898" released by "delete_snapshot" :: held 3.126s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:22:49 devstack cinder-volume[87132]: WARNING cinder.quota [None req-23b55f45-95f0-484a-9930-1f3b04682412 tempest-GroupSnapshotsTest-1169672434 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1690130761 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1690130761, it is now deprecated. Please use the default quota class for default quota. Nov 06 15:22:49 devstack cinder-volume[87132]: WARNING cinder.quota [None req-23b55f45-95f0-484a-9930-1f3b04682412 tempest-GroupSnapshotsTest-1169672434 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1690130761 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1690130761, it is now deprecated. Please use the default quota class for default quota. Nov 06 15:22:49 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-23b55f45-95f0-484a-9930-1f3b04682412 tempest-GroupSnapshotsTest-1169672434 None] Created reservations ['5a156b13-e826-4744-ba61-8ed4792a4132', '4b346a0f-787a-404b-8438-d004a238d71d', '4096f816-bcfb-45bd-953f-7f20c1309b03', '73e0a042-08d4-4ff3-92af-058fcf64a34f'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:22:49 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-23b55f45-95f0-484a-9930-1f3b04682412 tempest-GroupSnapshotsTest-1169672434 None] group_snapshot 387ea5d8-cdf4-48d7-a71a-4207370059e1: deleted successfully Nov 06 15:22:51 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a7101e0f-40bc-4da0-bd57-ccdee880cc72 tempest-GroupSnapshotsTest-1169672434 None] Acquiring lock "cinder-quobyte-66c17603-4b0b-4b0c-ad7d-9ac42b443898" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:22:51 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a7101e0f-40bc-4da0-bd57-ccdee880cc72 tempest-GroupSnapshotsTest-1169672434 None] Lock "cinder-quobyte-66c17603-4b0b-4b0c-ad7d-9ac42b443898" acquired by "delete_volume" :: waited 0.028s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:22:51 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[7421e8ce-d30e-4d76-a555-648191acf89b]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:22:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a7101e0f-40bc-4da0-bd57-ccdee880cc72 tempest-GroupSnapshotsTest-1169672434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-66c17603-4b0b-4b0c-ad7d-9ac42b443898 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:22:51 devstack sudo[93186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-66c17603-4b0b-4b0c-ad7d-9ac42b443898 Nov 06 15:22:51 devstack sudo[93186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:22:52 devstack sudo[93186]: pam_unix(sudo:session): session closed for user root Nov 06 15:22:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a7101e0f-40bc-4da0-bd57-ccdee880cc72 tempest-GroupSnapshotsTest-1169672434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-66c17603-4b0b-4b0c-ad7d-9ac42b443898" returned: 0 in 0.944s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:22:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a7101e0f-40bc-4da0-bd57-ccdee880cc72 tempest-GroupSnapshotsTest-1169672434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-66c17603-4b0b-4b0c-ad7d-9ac42b443898 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:22:52 devstack sudo[93193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-66c17603-4b0b-4b0c-ad7d-9ac42b443898 Nov 06 15:22:52 devstack sudo[93193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:22:52 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:SELECT=130,cinder:UPDATE=105,cinder:INSERT=26,cinder:DELETE=2 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 15:22:52 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:SELECT=126,cinder:UPDATE=117,cinder:DELETE=4,cinder:INSERT=26 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 15:22:52 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-99f7a67e-549f-4429-97b0-48dba5545d77 tempest-TestInstancesWithCinderVolumes-1896526329 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:22:52 devstack sudo[93193]: pam_unix(sudo:session): session closed for user root Nov 06 15:22:52 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-99f7a67e-549f-4429-97b0-48dba5545d77 tempest-TestInstancesWithCinderVolumes-1896526329 None] Flow 'volume_create_manager' (8a2cd502-0349-4f59-9220-695fc17bbbda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:22:52 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-99f7a67e-549f-4429-97b0-48dba5545d77 tempest-TestInstancesWithCinderVolumes-1896526329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d897808-5826-4d83-bd7f-b96d921ef29d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:22:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a7101e0f-40bc-4da0-bd57-ccdee880cc72 tempest-GroupSnapshotsTest-1169672434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-66c17603-4b0b-4b0c-ad7d-9ac42b443898" returned: 0 in 0.720s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:22:53 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-99f7a67e-549f-4429-97b0-48dba5545d77 tempest-TestInstancesWithCinderVolumes-1896526329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d897808-5826-4d83-bd7f-b96d921ef29d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:22:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-841809767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70211137-3d04-47b2-99ef-1e2f66c9f1c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='414d4bf92dd4408b85015bd6432ca1df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:22:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:22:53Z,use_quota=True,user_id='c27aea9057cd41d180d14d2028db4984',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5441f1ad-be2b-40f9-926d-8b85d9ab0ff1),volume_type_id=5441f1ad-be2b-40f9-926d-8b85d9ab0ff1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:22:53 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-99f7a67e-549f-4429-97b0-48dba5545d77 tempest-TestInstancesWithCinderVolumes-1896526329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d606cfab-d3bb-46ec-8164-2d4a5f50c447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:22:53 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-99f7a67e-549f-4429-97b0-48dba5545d77 tempest-TestInstancesWithCinderVolumes-1896526329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d606cfab-d3bb-46ec-8164-2d4a5f50c447) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:22:53 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-99f7a67e-549f-4429-97b0-48dba5545d77 tempest-TestInstancesWithCinderVolumes-1896526329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2a7b7be-1a2b-463c-99fc-5b6bf8445752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:22:53 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-99f7a67e-549f-4429-97b0-48dba5545d77 tempest-TestInstancesWithCinderVolumes-1896526329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2a7b7be-1a2b-463c-99fc-5b6bf8445752) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70211137-3d04-47b2-99ef-1e2f66c9f1c6', 'volume_name': 'volume-70211137-3d04-47b2-99ef-1e2f66c9f1c6', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:22:53 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-99f7a67e-549f-4429-97b0-48dba5545d77 tempest-TestInstancesWithCinderVolumes-1896526329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32f72575-652e-4603-9716-3d0eda9baca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:22:53 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-99f7a67e-549f-4429-97b0-48dba5545d77 tempest-TestInstancesWithCinderVolumes-1896526329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32f72575-652e-4603-9716-3d0eda9baca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:22:53 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-99f7a67e-549f-4429-97b0-48dba5545d77 tempest-TestInstancesWithCinderVolumes-1896526329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bef38892-e068-42de-bbb7-7b2b2b5e78e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:22:53 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-99f7a67e-549f-4429-97b0-48dba5545d77 tempest-TestInstancesWithCinderVolumes-1896526329 None] Volume 70211137-3d04-47b2-99ef-1e2f66c9f1c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70211137-3d04-47b2-99ef-1e2f66c9f1c6', 'volume_size': 1} Nov 06 15:22:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-99f7a67e-549f-4429-97b0-48dba5545d77 tempest-TestInstancesWithCinderVolumes-1896526329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:22:53 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a7101e0f-40bc-4da0-bd57-ccdee880cc72 tempest-GroupSnapshotsTest-1169672434 None] Lock "cinder-quobyte-66c17603-4b0b-4b0c-ad7d-9ac42b443898" released by "delete_volume" :: held 1.999s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:22:53 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-a7101e0f-40bc-4da0-bd57-ccdee880cc72 tempest-GroupSnapshotsTest-1169672434 None] Created reservations ['3aab440f-85ad-45a9-a5bf-0682fc330d2e'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:22:53 devstack cinder-volume[87132]: WARNING cinder.quota [None req-a7101e0f-40bc-4da0-bd57-ccdee880cc72 tempest-GroupSnapshotsTest-1169672434 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1690130761 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1690130761, it is now deprecated. Please use the default quota class for default quota. Nov 06 15:22:53 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-a7101e0f-40bc-4da0-bd57-ccdee880cc72 tempest-GroupSnapshotsTest-1169672434 None] Created reservations ['96ebfa45-3dae-48e1-8520-76344f18be28', 'aef9018e-2fbf-45a2-9ecb-24612154154d', 'b8fde37e-c248-4ee0-9128-42c46990a5ab', '467f7c99-08f6-48cf-bff8-48da5c1ec72c'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:22:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a7101e0f-40bc-4da0-bd57-ccdee880cc72 tempest-GroupSnapshotsTest-1169672434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:22:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a7101e0f-40bc-4da0-bd57-ccdee880cc72 tempest-GroupSnapshotsTest-1169672434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:22:53 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-a7101e0f-40bc-4da0-bd57-ccdee880cc72 tempest-GroupSnapshotsTest-1169672434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:22:53 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-a7101e0f-40bc-4da0-bd57-ccdee880cc72 tempest-GroupSnapshotsTest-1169672434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:22:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a7101e0f-40bc-4da0-bd57-ccdee880cc72 tempest-GroupSnapshotsTest-1169672434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:22:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a7101e0f-40bc-4da0-bd57-ccdee880cc72 tempest-GroupSnapshotsTest-1169672434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:22:53 devstack sudo[93197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:22:53 devstack sudo[93197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:22:54 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-4aa79d68-56a1-4363-afa7-f20fe4468ed2 tempest-ServerActionsTestOtherA-1409404420 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:22:54 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4aa79d68-56a1-4363-afa7-f20fe4468ed2 tempest-ServerActionsTestOtherA-1409404420 None] Flow 'volume_create_manager' (09d665a0-a889-4407-b707-a0f0750d6f51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:22:54 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4aa79d68-56a1-4363-afa7-f20fe4468ed2 tempest-ServerActionsTestOtherA-1409404420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6538c582-5c16-4a2d-a508-5efe5ba57e9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:22:54 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4aa79d68-56a1-4363-afa7-f20fe4468ed2 tempest-ServerActionsTestOtherA-1409404420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6538c582-5c16-4a2d-a508-5efe5ba57e9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:22:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-871179875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a321d18-d577-47b6-b042-a4bf84eb92a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4c45cbd16f1414ba252851d8d5359a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:22:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:22:54Z,use_quota=True,user_id='95de706326aa49ae829d0ac2fbb07e4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:22:54 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4aa79d68-56a1-4363-afa7-f20fe4468ed2 tempest-ServerActionsTestOtherA-1409404420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49eef524-7dee-44f1-8dfd-7119e95992c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:22:54 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4aa79d68-56a1-4363-afa7-f20fe4468ed2 tempest-ServerActionsTestOtherA-1409404420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49eef524-7dee-44f1-8dfd-7119e95992c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:22:54 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4aa79d68-56a1-4363-afa7-f20fe4468ed2 tempest-ServerActionsTestOtherA-1409404420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d74edde-fcc7-4cee-a163-e441d2faa76e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:22:54 devstack cinder-volume[87132]: DEBUG cinder.image.glance [None req-4aa79d68-56a1-4363-afa7-f20fe4468ed2 tempest-ServerActionsTestOtherA-1409404420 None] Creating Keystone auth plugin from conf {{(pid=87132) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 06 15:22:54 devstack sudo[93197]: pam_unix(sudo:session): session closed for user root Nov 06 15:22:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a7101e0f-40bc-4da0-bd57-ccdee880cc72 tempest-GroupSnapshotsTest-1169672434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.710s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:22:54 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-a7101e0f-40bc-4da0-bd57-ccdee880cc72 tempest-GroupSnapshotsTest-1169672434 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:22:54 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-a7101e0f-40bc-4da0-bd57-ccdee880cc72 tempest-GroupSnapshotsTest-1169672434 None] Delete group completed successfully. Nov 06 15:22:54 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-37a9bdbd-3274-481f-9861-baf6e5dfc943 tempest-TestInstancesWithCinderVolumes-1896526329 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:22:54 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-37a9bdbd-3274-481f-9861-baf6e5dfc943 tempest-TestInstancesWithCinderVolumes-1896526329 None] Flow 'volume_create_manager' (1178ce89-b203-400e-a9b2-53d353c61f55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:22:54 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-37a9bdbd-3274-481f-9861-baf6e5dfc943 tempest-TestInstancesWithCinderVolumes-1896526329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2cef797-d34c-41ca-8d95-7bbeb9f1f91d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:22:54 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-37a9bdbd-3274-481f-9861-baf6e5dfc943 tempest-TestInstancesWithCinderVolumes-1896526329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2cef797-d34c-41ca-8d95-7bbeb9f1f91d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:22:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1271214228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6e34394-758c-4448-9f2e-14209069c77f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='414d4bf92dd4408b85015bd6432ca1df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:22:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:22:54Z,use_quota=True,user_id='c27aea9057cd41d180d14d2028db4984',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a815e94-8549-4bb0-b88e-6804369d5ab8),volume_type_id=1a815e94-8549-4bb0-b88e-6804369d5ab8)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:22:54 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-37a9bdbd-3274-481f-9861-baf6e5dfc943 tempest-TestInstancesWithCinderVolumes-1896526329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ff5f2dc-66f8-414d-bd81-5febd19e1f15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:22:54 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-37a9bdbd-3274-481f-9861-baf6e5dfc943 tempest-TestInstancesWithCinderVolumes-1896526329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ff5f2dc-66f8-414d-bd81-5febd19e1f15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:22:54 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-37a9bdbd-3274-481f-9861-baf6e5dfc943 tempest-TestInstancesWithCinderVolumes-1896526329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e19149a-482c-4224-8d5c-3cce9951312c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:22:54 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-37a9bdbd-3274-481f-9861-baf6e5dfc943 tempest-TestInstancesWithCinderVolumes-1896526329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e19149a-482c-4224-8d5c-3cce9951312c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6e34394-758c-4448-9f2e-14209069c77f', 'volume_name': 'volume-f6e34394-758c-4448-9f2e-14209069c77f', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:22:54 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-37a9bdbd-3274-481f-9861-baf6e5dfc943 tempest-TestInstancesWithCinderVolumes-1896526329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5c2665f-24b0-4456-822a-4942a050be58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:22:54 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-37a9bdbd-3274-481f-9861-baf6e5dfc943 tempest-TestInstancesWithCinderVolumes-1896526329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5c2665f-24b0-4456-822a-4942a050be58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:22:54 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-37a9bdbd-3274-481f-9861-baf6e5dfc943 tempest-TestInstancesWithCinderVolumes-1896526329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45241e29-6a68-4094-84af-331faabd865e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:22:54 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-37a9bdbd-3274-481f-9861-baf6e5dfc943 tempest-TestInstancesWithCinderVolumes-1896526329 None] Volume f6e34394-758c-4448-9f2e-14209069c77f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6e34394-758c-4448-9f2e-14209069c77f', 'volume_size': 1} Nov 06 15:22:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-37a9bdbd-3274-481f-9861-baf6e5dfc943 tempest-TestInstancesWithCinderVolumes-1896526329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:22:55 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-cdff87cb-08db-4ea0-b9a6-93e68e541d33 tempest-TestInstancesWithCinderVolumes-1896526329 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:22:55 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-cdff87cb-08db-4ea0-b9a6-93e68e541d33 tempest-TestInstancesWithCinderVolumes-1896526329 None] Flow 'volume_create_manager' (369bc18f-1ce6-40ef-9117-85eeb969c3e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:22:55 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-cdff87cb-08db-4ea0-b9a6-93e68e541d33 tempest-TestInstancesWithCinderVolumes-1896526329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4084cae7-9977-4a93-93a5-f479034ed5e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:22:55 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-cdff87cb-08db-4ea0-b9a6-93e68e541d33 tempest-TestInstancesWithCinderVolumes-1896526329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4084cae7-9977-4a93-93a5-f479034ed5e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:22:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1954516067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15eac778-7ea0-42b0-b76a-69e0b9496376,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='414d4bf92dd4408b85015bd6432ca1df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:22:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:22:55Z,use_quota=True,user_id='c27aea9057cd41d180d14d2028db4984',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81654d1f-a64b-4a76-b4ab-6941a86b343f),volume_type_id=81654d1f-a64b-4a76-b4ab-6941a86b343f)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:22:55 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-cdff87cb-08db-4ea0-b9a6-93e68e541d33 tempest-TestInstancesWithCinderVolumes-1896526329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1014dcb3-a87a-4821-9841-90e29275cda5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:22:55 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-cdff87cb-08db-4ea0-b9a6-93e68e541d33 tempest-TestInstancesWithCinderVolumes-1896526329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1014dcb3-a87a-4821-9841-90e29275cda5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:22:55 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-cdff87cb-08db-4ea0-b9a6-93e68e541d33 tempest-TestInstancesWithCinderVolumes-1896526329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f52dde3-abcc-4599-88af-225a3e4c8d98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:22:55 devstack cinder-volume[87132]: DEBUG cinder.image.glance [None req-cdff87cb-08db-4ea0-b9a6-93e68e541d33 tempest-TestInstancesWithCinderVolumes-1896526329 None] Creating Keystone auth plugin from conf {{(pid=87132) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 06 15:22:55 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4aa79d68-56a1-4363-afa7-f20fe4468ed2 tempest-ServerActionsTestOtherA-1409404420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d74edde-fcc7-4cee-a163-e441d2faa76e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9a321d18-d577-47b6-b042-a4bf84eb92a7', 'volume_name': 'volume-9a321d18-d577-47b6-b042-a4bf84eb92a7', 'volume_size': 1, 'image_id': '3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c02e84193ee841ccb304f909f5951fd0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83', 'created_at': datetime.datetime(2026, 11, 6, 14, 12, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 14, 12, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:22:55 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4aa79d68-56a1-4363-afa7-f20fe4468ed2 tempest-ServerActionsTestOtherA-1409404420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b559cfe8-231e-417f-aded-c7a24389c47b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:22:55 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4aa79d68-56a1-4363-afa7-f20fe4468ed2 tempest-ServerActionsTestOtherA-1409404420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b559cfe8-231e-417f-aded-c7a24389c47b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:22:55 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4aa79d68-56a1-4363-afa7-f20fe4468ed2 tempest-ServerActionsTestOtherA-1409404420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8042c44e-6fc2-4bf3-9b0c-bcefaa233f44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:22:55 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-4aa79d68-56a1-4363-afa7-f20fe4468ed2 tempest-ServerActionsTestOtherA-1409404420 None] Volume 9a321d18-d577-47b6-b042-a4bf84eb92a7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9a321d18-d577-47b6-b042-a4bf84eb92a7', 'volume_size': 1, 'image_id': '3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c02e84193ee841ccb304f909f5951fd0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83', 'created_at': datetime.datetime(2026, 11, 6, 14, 12, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 14, 12, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 06 15:22:55 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-4aa79d68-56a1-4363-afa7-f20fe4468ed2 tempest-ServerActionsTestOtherA-1409404420 None] Trying to clone 9a321d18-d577-47b6-b042-a4bf84eb92a7 from image 3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83 at location (None, [{'url': 'file:///opt/stack/data/glance/images/3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83', 'metadata': {}}]). {{(pid=87132) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 06 15:22:55 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-cdff87cb-08db-4ea0-b9a6-93e68e541d33 tempest-TestInstancesWithCinderVolumes-1896526329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f52dde3-abcc-4599-88af-225a3e4c8d98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '15eac778-7ea0-42b0-b76a-69e0b9496376', 'volume_name': 'volume-15eac778-7ea0-42b0-b76a-69e0b9496376', 'volume_size': 1, 'image_id': '476fcb6c-e548-451e-89b7-244633d2ddb2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/476fcb6c-e548-451e-89b7-244633d2ddb2', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--821294848', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '414d4bf92dd4408b85015bd6432ca1df', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '476fcb6c-e548-451e-89b7-244633d2ddb2', 'created_at': datetime.datetime(2026, 11, 6, 14, 22, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 14, 22, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/476fcb6c-e548-451e-89b7-244633d2ddb2/file', 'properties': {}}, 'image_service': }' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:22:55 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-cdff87cb-08db-4ea0-b9a6-93e68e541d33 tempest-TestInstancesWithCinderVolumes-1896526329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25e28e84-ea2d-4b7d-9be8-bdebc9e5afea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:22:55 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-cdff87cb-08db-4ea0-b9a6-93e68e541d33 tempest-TestInstancesWithCinderVolumes-1896526329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25e28e84-ea2d-4b7d-9be8-bdebc9e5afea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:22:55 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-cdff87cb-08db-4ea0-b9a6-93e68e541d33 tempest-TestInstancesWithCinderVolumes-1896526329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7bcf0d6-53b2-4b1f-a735-e463576489a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:22:55 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-cdff87cb-08db-4ea0-b9a6-93e68e541d33 tempest-TestInstancesWithCinderVolumes-1896526329 None] Volume 15eac778-7ea0-42b0-b76a-69e0b9496376: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-15eac778-7ea0-42b0-b76a-69e0b9496376', 'volume_size': 1, 'image_id': '476fcb6c-e548-451e-89b7-244633d2ddb2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/476fcb6c-e548-451e-89b7-244633d2ddb2', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--821294848', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '414d4bf92dd4408b85015bd6432ca1df', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '476fcb6c-e548-451e-89b7-244633d2ddb2', 'created_at': datetime.datetime(2026, 11, 6, 14, 22, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 14, 22, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/476fcb6c-e548-451e-89b7-244633d2ddb2/file', 'properties': {}}, 'image_service': } Nov 06 15:22:55 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-cdff87cb-08db-4ea0-b9a6-93e68e541d33 tempest-TestInstancesWithCinderVolumes-1896526329 None] Trying to clone 15eac778-7ea0-42b0-b76a-69e0b9496376 from image 476fcb6c-e548-451e-89b7-244633d2ddb2 at location (None, [{'url': 'file:///opt/stack/data/glance/images/476fcb6c-e548-451e-89b7-244633d2ddb2', 'metadata': {}}]). {{(pid=87132) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 06 15:22:56 devstack sudo[93117]: pam_unix(sudo:session): session closed for user root Nov 06 15:22:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f727e5a1-119e-4845-b594-a15a00b0370c tempest-VolumesActionsTest-1966304339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-9e885d62-094f-49f5-a31b-783730ab54c3 /opt/stack/data/cinder/conversion/9e885d62-094f-49f5-a31b-783730ab54c3.temp_image.3e91a966-2337-435a-bb67-e630b7f74e4al5mk8fel.img" returned: 0 in 9.781s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:22:56 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a2e255e-2567-49c2-8162-754f5aa0454f]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:22:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f727e5a1-119e-4845-b594-a15a00b0370c tempest-VolumesActionsTest-1966304339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-9e885d62-094f-49f5-a31b-783730ab54c3 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:22:56 devstack sudo[93235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-9e885d62-094f-49f5-a31b-783730ab54c3 Nov 06 15:22:56 devstack sudo[93235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:22:56 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-4aa79d68-56a1-4363-afa7-f20fe4468ed2 tempest-ServerActionsTestOtherA-1409404420 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83_f8_vk41ldevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87132) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 06 15:22:56 devstack cinder-volume[87132]: INFO cinder.image.image_utils [None req-4aa79d68-56a1-4363-afa7-f20fe4468ed2 tempest-ServerActionsTestOtherA-1409404420 None] Image download 20.69 MB at 20.69 MB/s Nov 06 15:22:56 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[7322eba9-df9e-451c-9ab7-2b5fb3b3cf75]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:22:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4aa79d68-56a1-4363-afa7-f20fe4468ed2 tempest-ServerActionsTestOtherA-1409404420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83_f8_vk41ldevstack@QuobyteHD {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:22:56 devstack sudo[93238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83_f8_vk41ldevstack@QuobyteHD Nov 06 15:22:56 devstack sudo[93238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:22:56 devstack sudo[93238]: pam_unix(sudo:session): session closed for user root Nov 06 15:22:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4aa79d68-56a1-4363-afa7-f20fe4468ed2 tempest-ServerActionsTestOtherA-1409404420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83_f8_vk41ldevstack@QuobyteHD" returned: 0 in 0.405s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:22:56 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-4aa79d68-56a1-4363-afa7-f20fe4468ed2 tempest-ServerActionsTestOtherA-1409404420 None] Temporary image 3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83 is fetched for user 95de706326aa49ae829d0ac2fbb07e4f. {{(pid=87132) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 06 15:22:56 devstack sudo[93235]: pam_unix(sudo:session): session closed for user root Nov 06 15:22:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f727e5a1-119e-4845-b594-a15a00b0370c tempest-VolumesActionsTest-1966304339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-9e885d62-094f-49f5-a31b-783730ab54c3" returned: 0 in 0.695s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:22:56 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-f727e5a1-119e-4845-b594-a15a00b0370c tempest-VolumesActionsTest-1966304339 None] Image conversion details: src /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-9e885d62-094f-49f5-a31b-783730ab54c3, size 1024.00 MB, duration 9.78 sec, destination /opt/stack/data/cinder/conversion/9e885d62-094f-49f5-a31b-783730ab54c3.temp_image.3e91a966-2337-435a-bb67-e630b7f74e4al5mk8fel.img {{(pid=87132) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 06 15:22:56 devstack cinder-volume[87132]: INFO cinder.image.image_utils [None req-f727e5a1-119e-4845-b594-a15a00b0370c tempest-VolumesActionsTest-1966304339 None] Converted 1024.00 MB image at 104.68 MB/s Nov 06 15:22:56 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-f727e5a1-119e-4845-b594-a15a00b0370c tempest-VolumesActionsTest-1966304339 None] 3e91a966-2337-435a-bb67-e630b7f74e4a was raw, no need to convert to raw {{(pid=87132) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Nov 06 15:22:58 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[7107b32f-9ec7-418d-9e99-3efd91345b3b]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:22:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4aa79d68-56a1-4363-afa7-f20fe4468ed2 tempest-ServerActionsTestOtherA-1409404420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83_f8_vk41ldevstack@QuobyteHD {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:22:58 devstack sudo[93253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83_f8_vk41ldevstack@QuobyteHD Nov 06 15:22:58 devstack sudo[93253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:22:59 devstack sudo[93253]: pam_unix(sudo:session): session closed for user root Nov 06 15:22:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4aa79d68-56a1-4363-afa7-f20fe4468ed2 tempest-ServerActionsTestOtherA-1409404420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83_f8_vk41ldevstack@QuobyteHD" returned: 0 in 0.514s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:22:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4aa79d68-56a1-4363-afa7-f20fe4468ed2 tempest-ServerActionsTestOtherA-1409404420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:23:00 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-cdff87cb-08db-4ea0-b9a6-93e68e541d33 tempest-TestInstancesWithCinderVolumes-1896526329 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_476fcb6c-e548-451e-89b7-244633d2ddb2_1fepuvr9devstack@QuobyteHD, size 20.69 MB, duration 4.61 sec {{(pid=87132) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 06 15:23:00 devstack cinder-volume[87132]: INFO cinder.image.image_utils [None req-cdff87cb-08db-4ea0-b9a6-93e68e541d33 tempest-TestInstancesWithCinderVolumes-1896526329 None] Image download 20.69 MB at 4.49 MB/s Nov 06 15:23:00 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8bc404c-d228-4536-930e-16cc6bf50a95]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:23:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-cdff87cb-08db-4ea0-b9a6-93e68e541d33 tempest-TestInstancesWithCinderVolumes-1896526329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_476fcb6c-e548-451e-89b7-244633d2ddb2_1fepuvr9devstack@QuobyteHD {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:23:00 devstack sudo[93258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_476fcb6c-e548-451e-89b7-244633d2ddb2_1fepuvr9devstack@QuobyteHD Nov 06 15:23:00 devstack sudo[93258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:23:00 devstack sudo[93258]: pam_unix(sudo:session): session closed for user root Nov 06 15:23:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-cdff87cb-08db-4ea0-b9a6-93e68e541d33 tempest-TestInstancesWithCinderVolumes-1896526329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_476fcb6c-e548-451e-89b7-244633d2ddb2_1fepuvr9devstack@QuobyteHD" returned: 0 in 0.395s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:23:00 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-cdff87cb-08db-4ea0-b9a6-93e68e541d33 tempest-TestInstancesWithCinderVolumes-1896526329 None] Temporary image 476fcb6c-e548-451e-89b7-244633d2ddb2 is fetched for user c27aea9057cd41d180d14d2028db4984. {{(pid=87132) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 06 15:23:01 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dc51e29-abd6-4af8-ae2f-01b45431a4cf]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:23:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-cdff87cb-08db-4ea0-b9a6-93e68e541d33 tempest-TestInstancesWithCinderVolumes-1896526329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_476fcb6c-e548-451e-89b7-244633d2ddb2_1fepuvr9devstack@QuobyteHD {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:23:01 devstack sudo[93263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_476fcb6c-e548-451e-89b7-244633d2ddb2_1fepuvr9devstack@QuobyteHD Nov 06 15:23:01 devstack sudo[93263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:23:01 devstack sudo[93263]: pam_unix(sudo:session): session closed for user root Nov 06 15:23:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-cdff87cb-08db-4ea0-b9a6-93e68e541d33 tempest-TestInstancesWithCinderVolumes-1896526329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_476fcb6c-e548-451e-89b7-244633d2ddb2_1fepuvr9devstack@QuobyteHD" returned: 0 in 0.478s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:23:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-cdff87cb-08db-4ea0-b9a6-93e68e541d33 tempest-TestInstancesWithCinderVolumes-1896526329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:23:08 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 15:23:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:23:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:23:08 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:23:08 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:23:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:23:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:23:08 devstack sudo[93271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:23:08 devstack sudo[93271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:23:08 devstack sudo[93271]: pam_unix(sudo:session): session closed for user root Nov 06 15:23:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.315s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:23:08 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:23:08 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Running periodic task VolumeManager._thread_info {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 15:23:08 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] thread count: 28 {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 15:23:08 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] thread info: [<_MainThread(MainThread, started 140011251929216)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 06 15:23:09 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-37c98e27-ee13-4a04-ace6-0bad4b31cb60 tempest-GroupsTest-114780873 None] Group tempest-Group1-89802139: creating Nov 06 15:23:09 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-37c98e27-ee13-4a04-ace6-0bad4b31cb60 tempest-GroupsTest-114780873 None] Group tempest-Group1-89802139: created successfully Nov 06 15:23:09 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-37c98e27-ee13-4a04-ace6-0bad4b31cb60 tempest-GroupsTest-114780873 None] Create group completed successfully. Nov 06 15:23:10 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-7627bb0e-af69-4aae-8cdb-b412daef2d42 tempest-GroupsTest-114780873 None] Group tempest-Group2-193146012: creating Nov 06 15:23:10 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-7627bb0e-af69-4aae-8cdb-b412daef2d42 tempest-GroupsTest-114780873 None] Group tempest-Group2-193146012: created successfully Nov 06 15:23:10 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-7627bb0e-af69-4aae-8cdb-b412daef2d42 tempest-GroupsTest-114780873 None] Create group completed successfully. Nov 06 15:23:12 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0177621-25a4-44e2-b6ea-322d7b4934e4 tempest-GroupsTest-114780873 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:23:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a0177621-25a4-44e2-b6ea-322d7b4934e4 tempest-GroupsTest-114780873 None] Flow 'volume_create_manager' (7e1ba238-1421-4500-b347-74dbac4d48f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:23:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a0177621-25a4-44e2-b6ea-322d7b4934e4 tempest-GroupsTest-114780873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bddd7fc7-0d21-46c4-af24-913d8a833913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:23:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a0177621-25a4-44e2-b6ea-322d7b4934e4 tempest-GroupsTest-114780873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bddd7fc7-0d21-46c4-af24-913d8a833913) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:23:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-890090560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=53efbaa8-97d5-41ed-8801-9fb8132b3af8,host='devstack@QuobyteHD#QuobyteHD',id=ed7872e5-1740-49e6-a5ec-9a33934426e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e03ad5d06f9449cba2c90eb41d27bde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:23:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:23:12Z,use_quota=True,user_id='bd82d66b15404b188f761bbb06955d71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ff619c14-b0b8-429a-91e5-45b3a7d3bf5d),volume_type_id=ff619c14-b0b8-429a-91e5-45b3a7d3bf5d)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:23:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a0177621-25a4-44e2-b6ea-322d7b4934e4 tempest-GroupsTest-114780873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5586325-382b-4e21-9d45-50d5cbdec548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:23:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a0177621-25a4-44e2-b6ea-322d7b4934e4 tempest-GroupsTest-114780873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5586325-382b-4e21-9d45-50d5cbdec548) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:23:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a0177621-25a4-44e2-b6ea-322d7b4934e4 tempest-GroupsTest-114780873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6b4aa45-336d-4600-9ea3-541dd09156e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:23:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a0177621-25a4-44e2-b6ea-322d7b4934e4 tempest-GroupsTest-114780873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6b4aa45-336d-4600-9ea3-541dd09156e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed7872e5-1740-49e6-a5ec-9a33934426e1', 'volume_name': 'volume-ed7872e5-1740-49e6-a5ec-9a33934426e1', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:23:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a0177621-25a4-44e2-b6ea-322d7b4934e4 tempest-GroupsTest-114780873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ee68e33-7e82-4f8a-b36d-6825522b6f9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:23:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a0177621-25a4-44e2-b6ea-322d7b4934e4 tempest-GroupsTest-114780873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ee68e33-7e82-4f8a-b36d-6825522b6f9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:23:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a0177621-25a4-44e2-b6ea-322d7b4934e4 tempest-GroupsTest-114780873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b10b3a5-2039-45be-9bf7-60bfcb0cf97b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:23:12 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-a0177621-25a4-44e2-b6ea-322d7b4934e4 tempest-GroupsTest-114780873 None] Volume ed7872e5-1740-49e6-a5ec-9a33934426e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed7872e5-1740-49e6-a5ec-9a33934426e1', 'volume_size': 1} Nov 06 15:23:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a0177621-25a4-44e2-b6ea-322d7b4934e4 tempest-GroupsTest-114780873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:23:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f727e5a1-119e-4845-b594-a15a00b0370c tempest-VolumesActionsTest-1966304339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 32.321s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:23:17 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f727e5a1-119e-4845-b594-a15a00b0370c tempest-VolumesActionsTest-1966304339 None] Uploaded volume to glance image-id: 3e91a966-2337-435a-bb67-e630b7f74e4a. {{(pid=87132) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 06 15:23:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-99f7a67e-549f-4429-97b0-48dba5545d77 tempest-TestInstancesWithCinderVolumes-1896526329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 24.310s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:23:17 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-99f7a67e-549f-4429-97b0-48dba5545d77 tempest-TestInstancesWithCinderVolumes-1896526329 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:22:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-841809767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70211137-3d04-47b2-99ef-1e2f66c9f1c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='414d4bf92dd4408b85015bd6432ca1df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:22:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:22:53Z,use_quota=True,user_id='c27aea9057cd41d180d14d2028db4984',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5441f1ad-be2b-40f9-926d-8b85d9ab0ff1),volume_type_id=5441f1ad-be2b-40f9-926d-8b85d9ab0ff1)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:23:17 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-99f7a67e-549f-4429-97b0-48dba5545d77 tempest-TestInstancesWithCinderVolumes-1896526329 None] Creating volume 70211137-3d04-47b2-99ef-1e2f66c9f1c6 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:23:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-99f7a67e-549f-4429-97b0-48dba5545d77 tempest-TestInstancesWithCinderVolumes-1896526329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:23:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-99f7a67e-549f-4429-97b0-48dba5545d77 tempest-TestInstancesWithCinderVolumes-1896526329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:23:17 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-99f7a67e-549f-4429-97b0-48dba5545d77 tempest-TestInstancesWithCinderVolumes-1896526329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:23:17 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-99f7a67e-549f-4429-97b0-48dba5545d77 tempest-TestInstancesWithCinderVolumes-1896526329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:23:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-99f7a67e-549f-4429-97b0-48dba5545d77 tempest-TestInstancesWithCinderVolumes-1896526329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:23:17 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-99f7a67e-549f-4429-97b0-48dba5545d77 tempest-TestInstancesWithCinderVolumes-1896526329 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:23:17 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-99f7a67e-549f-4429-97b0-48dba5545d77 tempest-TestInstancesWithCinderVolumes-1896526329 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:23:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-99f7a67e-549f-4429-97b0-48dba5545d77 tempest-TestInstancesWithCinderVolumes-1896526329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-70211137-3d04-47b2-99ef-1e2f66c9f1c6 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:23:17 devstack sudo[93276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-70211137-3d04-47b2-99ef-1e2f66c9f1c6 1073741824 Nov 06 15:23:17 devstack sudo[93276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:23:17 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-f727e5a1-119e-4845-b594-a15a00b0370c tempest-VolumesActionsTest-1966304339 None] Copy volume to image completed successfully. Nov 06 15:23:17 devstack sudo[93276]: pam_unix(sudo:session): session closed for user root Nov 06 15:23:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-99f7a67e-549f-4429-97b0-48dba5545d77 tempest-TestInstancesWithCinderVolumes-1896526329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-70211137-3d04-47b2-99ef-1e2f66c9f1c6 1073741824" returned: 0 in 0.409s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:23:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-99f7a67e-549f-4429-97b0-48dba5545d77 tempest-TestInstancesWithCinderVolumes-1896526329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-70211137-3d04-47b2-99ef-1e2f66c9f1c6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:23:17 devstack sudo[93282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-70211137-3d04-47b2-99ef-1e2f66c9f1c6 Nov 06 15:23:17 devstack sudo[93282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:23:18 devstack sudo[93282]: pam_unix(sudo:session): session closed for user root Nov 06 15:23:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-99f7a67e-549f-4429-97b0-48dba5545d77 tempest-TestInstancesWithCinderVolumes-1896526329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-70211137-3d04-47b2-99ef-1e2f66c9f1c6" returned: 0 in 0.253s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:23:18 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-99f7a67e-549f-4429-97b0-48dba5545d77 tempest-TestInstancesWithCinderVolumes-1896526329 None] <== create_volume: return (703ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:23:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-99f7a67e-549f-4429-97b0-48dba5545d77 tempest-TestInstancesWithCinderVolumes-1896526329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.707s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:23:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-37a9bdbd-3274-481f-9861-baf6e5dfc943 tempest-TestInstancesWithCinderVolumes-1896526329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 23.385s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:23:18 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-37a9bdbd-3274-481f-9861-baf6e5dfc943 tempest-TestInstancesWithCinderVolumes-1896526329 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:22:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1271214228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6e34394-758c-4448-9f2e-14209069c77f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='414d4bf92dd4408b85015bd6432ca1df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:22:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:22:54Z,use_quota=True,user_id='c27aea9057cd41d180d14d2028db4984',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a815e94-8549-4bb0-b88e-6804369d5ab8),volume_type_id=1a815e94-8549-4bb0-b88e-6804369d5ab8)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:23:18 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-37a9bdbd-3274-481f-9861-baf6e5dfc943 tempest-TestInstancesWithCinderVolumes-1896526329 None] Creating volume f6e34394-758c-4448-9f2e-14209069c77f {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:23:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-37a9bdbd-3274-481f-9861-baf6e5dfc943 tempest-TestInstancesWithCinderVolumes-1896526329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:23:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-37a9bdbd-3274-481f-9861-baf6e5dfc943 tempest-TestInstancesWithCinderVolumes-1896526329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:23:18 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-37a9bdbd-3274-481f-9861-baf6e5dfc943 tempest-TestInstancesWithCinderVolumes-1896526329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:23:18 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-37a9bdbd-3274-481f-9861-baf6e5dfc943 tempest-TestInstancesWithCinderVolumes-1896526329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:23:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-37a9bdbd-3274-481f-9861-baf6e5dfc943 tempest-TestInstancesWithCinderVolumes-1896526329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:23:18 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-37a9bdbd-3274-481f-9861-baf6e5dfc943 tempest-TestInstancesWithCinderVolumes-1896526329 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:23:18 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-37a9bdbd-3274-481f-9861-baf6e5dfc943 tempest-TestInstancesWithCinderVolumes-1896526329 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:23:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-37a9bdbd-3274-481f-9861-baf6e5dfc943 tempest-TestInstancesWithCinderVolumes-1896526329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f6e34394-758c-4448-9f2e-14209069c77f 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:23:18 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-99f7a67e-549f-4429-97b0-48dba5545d77 tempest-TestInstancesWithCinderVolumes-1896526329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bef38892-e068-42de-bbb7-7b2b2b5e78e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70211137-3d04-47b2-99ef-1e2f66c9f1c6', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:23:18 devstack sudo[93285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f6e34394-758c-4448-9f2e-14209069c77f 1073741824 Nov 06 15:23:18 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-99f7a67e-549f-4429-97b0-48dba5545d77 tempest-TestInstancesWithCinderVolumes-1896526329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d1d05f1-2c0e-4bb8-bcca-b57460e0cb42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:23:18 devstack sudo[93285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:23:18 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-99f7a67e-549f-4429-97b0-48dba5545d77 tempest-TestInstancesWithCinderVolumes-1896526329 None] Volume volume-70211137-3d04-47b2-99ef-1e2f66c9f1c6 (70211137-3d04-47b2-99ef-1e2f66c9f1c6): created successfully Nov 06 15:23:18 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-99f7a67e-549f-4429-97b0-48dba5545d77 tempest-TestInstancesWithCinderVolumes-1896526329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d1d05f1-2c0e-4bb8-bcca-b57460e0cb42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:23:18 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-99f7a67e-549f-4429-97b0-48dba5545d77 tempest-TestInstancesWithCinderVolumes-1896526329 None] Flow 'volume_create_manager' (8a2cd502-0349-4f59-9220-695fc17bbbda) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:23:18 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-99f7a67e-549f-4429-97b0-48dba5545d77 tempest-TestInstancesWithCinderVolumes-1896526329 None] Created volume successfully. Nov 06 15:23:18 devstack sudo[93285]: pam_unix(sudo:session): session closed for user root Nov 06 15:23:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-37a9bdbd-3274-481f-9861-baf6e5dfc943 tempest-TestInstancesWithCinderVolumes-1896526329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f6e34394-758c-4448-9f2e-14209069c77f 1073741824" returned: 0 in 0.475s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:23:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-37a9bdbd-3274-481f-9861-baf6e5dfc943 tempest-TestInstancesWithCinderVolumes-1896526329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f6e34394-758c-4448-9f2e-14209069c77f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:23:18 devstack sudo[93291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f6e34394-758c-4448-9f2e-14209069c77f Nov 06 15:23:18 devstack sudo[93291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:23:18 devstack sudo[93291]: pam_unix(sudo:session): session closed for user root Nov 06 15:23:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-37a9bdbd-3274-481f-9861-baf6e5dfc943 tempest-TestInstancesWithCinderVolumes-1896526329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f6e34394-758c-4448-9f2e-14209069c77f" returned: 0 in 0.246s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:23:18 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-37a9bdbd-3274-481f-9861-baf6e5dfc943 tempest-TestInstancesWithCinderVolumes-1896526329 None] <== create_volume: return (762ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:23:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-37a9bdbd-3274-481f-9861-baf6e5dfc943 tempest-TestInstancesWithCinderVolumes-1896526329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.765s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:23:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4aa79d68-56a1-4363-afa7-f20fe4468ed2 tempest-ServerActionsTestOtherA-1409404420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 19.736s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:23:18 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-4aa79d68-56a1-4363-afa7-f20fe4468ed2 tempest-ServerActionsTestOtherA-1409404420 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:22:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-871179875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a321d18-d577-47b6-b042-a4bf84eb92a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4c45cbd16f1414ba252851d8d5359a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:22:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:22:54Z,use_quota=True,user_id='95de706326aa49ae829d0ac2fbb07e4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:23:18 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-4aa79d68-56a1-4363-afa7-f20fe4468ed2 tempest-ServerActionsTestOtherA-1409404420 None] Creating volume 9a321d18-d577-47b6-b042-a4bf84eb92a7 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:23:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4aa79d68-56a1-4363-afa7-f20fe4468ed2 tempest-ServerActionsTestOtherA-1409404420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:23:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4aa79d68-56a1-4363-afa7-f20fe4468ed2 tempest-ServerActionsTestOtherA-1409404420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:23:18 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-4aa79d68-56a1-4363-afa7-f20fe4468ed2 tempest-ServerActionsTestOtherA-1409404420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:23:18 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-4aa79d68-56a1-4363-afa7-f20fe4468ed2 tempest-ServerActionsTestOtherA-1409404420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:23:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4aa79d68-56a1-4363-afa7-f20fe4468ed2 tempest-ServerActionsTestOtherA-1409404420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:23:18 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-4aa79d68-56a1-4363-afa7-f20fe4468ed2 tempest-ServerActionsTestOtherA-1409404420 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:23:18 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-4aa79d68-56a1-4363-afa7-f20fe4468ed2 tempest-ServerActionsTestOtherA-1409404420 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:23:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4aa79d68-56a1-4363-afa7-f20fe4468ed2 tempest-ServerActionsTestOtherA-1409404420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-9a321d18-d577-47b6-b042-a4bf84eb92a7 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:23:18 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-37a9bdbd-3274-481f-9861-baf6e5dfc943 tempest-TestInstancesWithCinderVolumes-1896526329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45241e29-6a68-4094-84af-331faabd865e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6e34394-758c-4448-9f2e-14209069c77f', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:23:18 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-37a9bdbd-3274-481f-9861-baf6e5dfc943 tempest-TestInstancesWithCinderVolumes-1896526329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f1a0b18-71ac-46bd-b378-5416a7c748fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:23:18 devstack sudo[93294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-9a321d18-d577-47b6-b042-a4bf84eb92a7 1073741824 Nov 06 15:23:18 devstack sudo[93294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:23:18 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-37a9bdbd-3274-481f-9861-baf6e5dfc943 tempest-TestInstancesWithCinderVolumes-1896526329 None] Volume volume-f6e34394-758c-4448-9f2e-14209069c77f (f6e34394-758c-4448-9f2e-14209069c77f): created successfully Nov 06 15:23:18 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-37a9bdbd-3274-481f-9861-baf6e5dfc943 tempest-TestInstancesWithCinderVolumes-1896526329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f1a0b18-71ac-46bd-b378-5416a7c748fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:23:18 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-37a9bdbd-3274-481f-9861-baf6e5dfc943 tempest-TestInstancesWithCinderVolumes-1896526329 None] Flow 'volume_create_manager' (1178ce89-b203-400e-a9b2-53d353c61f55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:23:18 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-37a9bdbd-3274-481f-9861-baf6e5dfc943 tempest-TestInstancesWithCinderVolumes-1896526329 None] Created volume successfully. Nov 06 15:23:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-034890de-c1c7-4bc9-894e-6467547561ec tempest-VolumesActionsTest-1966304339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:23:19 devstack sudo[93294]: pam_unix(sudo:session): session closed for user root Nov 06 15:23:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4aa79d68-56a1-4363-afa7-f20fe4468ed2 tempest-ServerActionsTestOtherA-1409404420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-9a321d18-d577-47b6-b042-a4bf84eb92a7 1073741824" returned: 0 in 0.441s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:23:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4aa79d68-56a1-4363-afa7-f20fe4468ed2 tempest-ServerActionsTestOtherA-1409404420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-9a321d18-d577-47b6-b042-a4bf84eb92a7 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:23:19 devstack sudo[93300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-9a321d18-d577-47b6-b042-a4bf84eb92a7 Nov 06 15:23:19 devstack sudo[93300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:23:19 devstack sudo[93300]: pam_unix(sudo:session): session closed for user root Nov 06 15:23:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4aa79d68-56a1-4363-afa7-f20fe4468ed2 tempest-ServerActionsTestOtherA-1409404420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-9a321d18-d577-47b6-b042-a4bf84eb92a7" returned: 0 in 0.239s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:23:19 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-4aa79d68-56a1-4363-afa7-f20fe4468ed2 tempest-ServerActionsTestOtherA-1409404420 None] <== create_volume: return (719ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:23:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4aa79d68-56a1-4363-afa7-f20fe4468ed2 tempest-ServerActionsTestOtherA-1409404420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.724s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:23:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-cdff87cb-08db-4ea0-b9a6-93e68e541d33 tempest-TestInstancesWithCinderVolumes-1896526329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 18.128s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:23:19 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-cdff87cb-08db-4ea0-b9a6-93e68e541d33 tempest-TestInstancesWithCinderVolumes-1896526329 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:22:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1954516067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15eac778-7ea0-42b0-b76a-69e0b9496376,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='414d4bf92dd4408b85015bd6432ca1df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:22:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:22:55Z,use_quota=True,user_id='c27aea9057cd41d180d14d2028db4984',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81654d1f-a64b-4a76-b4ab-6941a86b343f),volume_type_id=81654d1f-a64b-4a76-b4ab-6941a86b343f)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:23:19 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-cdff87cb-08db-4ea0-b9a6-93e68e541d33 tempest-TestInstancesWithCinderVolumes-1896526329 None] Creating volume 15eac778-7ea0-42b0-b76a-69e0b9496376 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:23:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-cdff87cb-08db-4ea0-b9a6-93e68e541d33 tempest-TestInstancesWithCinderVolumes-1896526329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:23:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-cdff87cb-08db-4ea0-b9a6-93e68e541d33 tempest-TestInstancesWithCinderVolumes-1896526329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:23:19 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-cdff87cb-08db-4ea0-b9a6-93e68e541d33 tempest-TestInstancesWithCinderVolumes-1896526329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:23:19 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-cdff87cb-08db-4ea0-b9a6-93e68e541d33 tempest-TestInstancesWithCinderVolumes-1896526329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:23:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-cdff87cb-08db-4ea0-b9a6-93e68e541d33 tempest-TestInstancesWithCinderVolumes-1896526329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:23:19 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-cdff87cb-08db-4ea0-b9a6-93e68e541d33 tempest-TestInstancesWithCinderVolumes-1896526329 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:23:19 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-cdff87cb-08db-4ea0-b9a6-93e68e541d33 tempest-TestInstancesWithCinderVolumes-1896526329 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:23:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-cdff87cb-08db-4ea0-b9a6-93e68e541d33 tempest-TestInstancesWithCinderVolumes-1896526329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-15eac778-7ea0-42b0-b76a-69e0b9496376 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:23:19 devstack sudo[93303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-15eac778-7ea0-42b0-b76a-69e0b9496376 1073741824 Nov 06 15:23:19 devstack sudo[93303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:23:19 devstack cinder-volume[87132]: DEBUG cinder.volume.volume_utils [None req-4aa79d68-56a1-4363-afa7-f20fe4468ed2 tempest-ServerActionsTestOtherA-1409404420 None] Attempting download of 3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83 ((None, [{'url': 'file:///opt/stack/data/glance/images/3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83', 'metadata': {}}])) to volume 9a321d18-d577-47b6-b042-a4bf84eb92a7. {{(pid=87132) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 06 15:23:19 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[aba8588b-4c9d-43a8-8c3b-c21d13289d42]: (4, 'raw') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:23:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4aa79d68-56a1-4363-afa7-f20fe4468ed2 tempest-ServerActionsTestOtherA-1409404420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83_zoz5tr9k {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:23:19 devstack sudo[93305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83_zoz5tr9k Nov 06 15:23:19 devstack sudo[93305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:23:20 devstack sudo[93303]: pam_unix(sudo:session): session closed for user root Nov 06 15:23:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-cdff87cb-08db-4ea0-b9a6-93e68e541d33 tempest-TestInstancesWithCinderVolumes-1896526329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-15eac778-7ea0-42b0-b76a-69e0b9496376 1073741824" returned: 0 in 0.411s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:23:20 devstack sudo[93305]: pam_unix(sudo:session): session closed for user root Nov 06 15:23:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4aa79d68-56a1-4363-afa7-f20fe4468ed2 tempest-ServerActionsTestOtherA-1409404420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83_zoz5tr9k" returned: 0 in 0.340s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:23:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4aa79d68-56a1-4363-afa7-f20fe4468ed2 tempest-ServerActionsTestOtherA-1409404420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83_zoz5tr9k {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:23:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-cdff87cb-08db-4ea0-b9a6-93e68e541d33 tempest-TestInstancesWithCinderVolumes-1896526329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-15eac778-7ea0-42b0-b76a-69e0b9496376 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:23:20 devstack sudo[93313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-15eac778-7ea0-42b0-b76a-69e0b9496376 Nov 06 15:23:20 devstack sudo[93313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:23:20 devstack sudo[93312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83_zoz5tr9k Nov 06 15:23:20 devstack sudo[93312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:23:20 devstack sudo[93313]: pam_unix(sudo:session): session closed for user root Nov 06 15:23:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-cdff87cb-08db-4ea0-b9a6-93e68e541d33 tempest-TestInstancesWithCinderVolumes-1896526329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-15eac778-7ea0-42b0-b76a-69e0b9496376" returned: 0 in 0.279s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:23:20 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-cdff87cb-08db-4ea0-b9a6-93e68e541d33 tempest-TestInstancesWithCinderVolumes-1896526329 None] <== create_volume: return (744ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:23:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-cdff87cb-08db-4ea0-b9a6-93e68e541d33 tempest-TestInstancesWithCinderVolumes-1896526329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.747s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:23:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a0177621-25a4-44e2-b6ea-322d7b4934e4 tempest-GroupsTest-114780873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.073s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:23:20 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-a0177621-25a4-44e2-b6ea-322d7b4934e4 tempest-GroupsTest-114780873 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=53efbaa8-97d5-41ed-8801-9fb8132b3af8,created_at=2026-11-06T14:23:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-890090560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=53efbaa8-97d5-41ed-8801-9fb8132b3af8,host='devstack@QuobyteHD#QuobyteHD',id=ed7872e5-1740-49e6-a5ec-9a33934426e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e03ad5d06f9449cba2c90eb41d27bde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:23:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:23:12Z,use_quota=True,user_id='bd82d66b15404b188f761bbb06955d71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ff619c14-b0b8-429a-91e5-45b3a7d3bf5d),volume_type_id=ff619c14-b0b8-429a-91e5-45b3a7d3bf5d)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:23:20 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-a0177621-25a4-44e2-b6ea-322d7b4934e4 tempest-GroupsTest-114780873 None] Creating volume ed7872e5-1740-49e6-a5ec-9a33934426e1 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:23:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a0177621-25a4-44e2-b6ea-322d7b4934e4 tempest-GroupsTest-114780873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:23:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a0177621-25a4-44e2-b6ea-322d7b4934e4 tempest-GroupsTest-114780873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:23:20 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-a0177621-25a4-44e2-b6ea-322d7b4934e4 tempest-GroupsTest-114780873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:23:20 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-a0177621-25a4-44e2-b6ea-322d7b4934e4 tempest-GroupsTest-114780873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:23:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a0177621-25a4-44e2-b6ea-322d7b4934e4 tempest-GroupsTest-114780873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:23:20 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-a0177621-25a4-44e2-b6ea-322d7b4934e4 tempest-GroupsTest-114780873 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:23:20 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-a0177621-25a4-44e2-b6ea-322d7b4934e4 tempest-GroupsTest-114780873 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:23:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a0177621-25a4-44e2-b6ea-322d7b4934e4 tempest-GroupsTest-114780873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ed7872e5-1740-49e6-a5ec-9a33934426e1 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:23:20 devstack sudo[93312]: pam_unix(sudo:session): session closed for user root Nov 06 15:23:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4aa79d68-56a1-4363-afa7-f20fe4468ed2 tempest-ServerActionsTestOtherA-1409404420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83_zoz5tr9k" returned: 1 in 0.360s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:23:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4aa79d68-56a1-4363-afa7-f20fe4468ed2 tempest-ServerActionsTestOtherA-1409404420 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83_zoz5tr9k' failed. Not Retrying. {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 15:23:20 devstack sudo[93319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ed7872e5-1740-49e6-a5ec-9a33934426e1 1073741824 Nov 06 15:23:20 devstack sudo[93319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:23:20 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[df59fe67-22c3-457c-9cf6-05bac327d2d9]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:23:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4aa79d68-56a1-4363-afa7-f20fe4468ed2 tempest-ServerActionsTestOtherA-1409404420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83_f8_vk41ldevstack@QuobyteHD {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:23:20 devstack cinder-volume[87132]: DEBUG cinder.volume.volume_utils [None req-cdff87cb-08db-4ea0-b9a6-93e68e541d33 tempest-TestInstancesWithCinderVolumes-1896526329 None] Attempting download of 476fcb6c-e548-451e-89b7-244633d2ddb2 ((None, [{'url': 'file:///opt/stack/data/glance/images/476fcb6c-e548-451e-89b7-244633d2ddb2', 'metadata': {}}])) to volume 15eac778-7ea0-42b0-b76a-69e0b9496376. {{(pid=87132) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 06 15:23:20 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[32aed2a9-1a33-4ab2-97da-f1f3cf818113]: (4, 'raw') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:23:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-cdff87cb-08db-4ea0-b9a6-93e68e541d33 tempest-TestInstancesWithCinderVolumes-1896526329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_476fcb6c-e548-451e-89b7-244633d2ddb2_yt081idu {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:23:20 devstack sudo[93321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83_f8_vk41ldevstack@QuobyteHD Nov 06 15:23:20 devstack sudo[93321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:23:20 devstack sudo[93322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_476fcb6c-e548-451e-89b7-244633d2ddb2_yt081idu Nov 06 15:23:20 devstack sudo[93322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:23:20 devstack sudo[93321]: pam_unix(sudo:session): session closed for user root Nov 06 15:23:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4aa79d68-56a1-4363-afa7-f20fe4468ed2 tempest-ServerActionsTestOtherA-1409404420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83_f8_vk41ldevstack@QuobyteHD" returned: 0 in 0.371s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:23:20 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-4aa79d68-56a1-4363-afa7-f20fe4468ed2 tempest-ServerActionsTestOtherA-1409404420 None] 3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83 was qcow2, converting to qcow2 {{(pid=87132) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 06 15:23:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4aa79d68-56a1-4363-afa7-f20fe4468ed2 tempest-ServerActionsTestOtherA-1409404420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83_f8_vk41ldevstack@QuobyteHD /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-9a321d18-d577-47b6-b042-a4bf84eb92a7 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:23:20 devstack sudo[93331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83_f8_vk41ldevstack@QuobyteHD /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-9a321d18-d577-47b6-b042-a4bf84eb92a7 Nov 06 15:23:20 devstack sudo[93331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:23:20 devstack sudo[93322]: pam_unix(sudo:session): session closed for user root Nov 06 15:23:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-cdff87cb-08db-4ea0-b9a6-93e68e541d33 tempest-TestInstancesWithCinderVolumes-1896526329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_476fcb6c-e548-451e-89b7-244633d2ddb2_yt081idu" returned: 0 in 0.387s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:23:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-cdff87cb-08db-4ea0-b9a6-93e68e541d33 tempest-TestInstancesWithCinderVolumes-1896526329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_476fcb6c-e548-451e-89b7-244633d2ddb2_yt081idu {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:23:20 devstack sudo[93319]: pam_unix(sudo:session): session closed for user root Nov 06 15:23:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a0177621-25a4-44e2-b6ea-322d7b4934e4 tempest-GroupsTest-114780873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ed7872e5-1740-49e6-a5ec-9a33934426e1 1073741824" returned: 0 in 0.504s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:23:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a0177621-25a4-44e2-b6ea-322d7b4934e4 tempest-GroupsTest-114780873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ed7872e5-1740-49e6-a5ec-9a33934426e1 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:23:20 devstack sudo[93336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ed7872e5-1740-49e6-a5ec-9a33934426e1 Nov 06 15:23:20 devstack sudo[93336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:23:21 devstack sudo[93335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_476fcb6c-e548-451e-89b7-244633d2ddb2_yt081idu Nov 06 15:23:21 devstack sudo[93335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:23:21 devstack sudo[93336]: pam_unix(sudo:session): session closed for user root Nov 06 15:23:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a0177621-25a4-44e2-b6ea-322d7b4934e4 tempest-GroupsTest-114780873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ed7872e5-1740-49e6-a5ec-9a33934426e1" returned: 0 in 0.273s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:23:21 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-a0177621-25a4-44e2-b6ea-322d7b4934e4 tempest-GroupsTest-114780873 None] <== create_volume: return (823ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:23:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a0177621-25a4-44e2-b6ea-322d7b4934e4 tempest-GroupsTest-114780873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.827s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:23:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-034890de-c1c7-4bc9-894e-6467547561ec tempest-VolumesActionsTest-1966304339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 1.982s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:23:21 devstack sudo[93335]: pam_unix(sudo:session): session closed for user root Nov 06 15:23:21 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a0177621-25a4-44e2-b6ea-322d7b4934e4 tempest-GroupsTest-114780873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b10b3a5-2039-45be-9bf7-60bfcb0cf97b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed7872e5-1740-49e6-a5ec-9a33934426e1', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:23:21 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a0177621-25a4-44e2-b6ea-322d7b4934e4 tempest-GroupsTest-114780873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d7b1530-1263-4028-ad72-e9731f01324e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:23:21 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[fec87aea-0112-4aa5-9984-0dcbe2e59272]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:23:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-034890de-c1c7-4bc9-894e-6467547561ec tempest-VolumesActionsTest-1966304339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-9e885d62-094f-49f5-a31b-783730ab54c3 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:23:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-cdff87cb-08db-4ea0-b9a6-93e68e541d33 tempest-TestInstancesWithCinderVolumes-1896526329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_476fcb6c-e548-451e-89b7-244633d2ddb2_yt081idu" returned: 1 in 0.379s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:23:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-cdff87cb-08db-4ea0-b9a6-93e68e541d33 tempest-TestInstancesWithCinderVolumes-1896526329 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_476fcb6c-e548-451e-89b7-244633d2ddb2_yt081idu' failed. Not Retrying. {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 15:23:21 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-a0177621-25a4-44e2-b6ea-322d7b4934e4 tempest-GroupsTest-114780873 None] Volume volume-ed7872e5-1740-49e6-a5ec-9a33934426e1 (ed7872e5-1740-49e6-a5ec-9a33934426e1): created successfully Nov 06 15:23:21 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a0177621-25a4-44e2-b6ea-322d7b4934e4 tempest-GroupsTest-114780873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d7b1530-1263-4028-ad72-e9731f01324e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:23:21 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a0177621-25a4-44e2-b6ea-322d7b4934e4 tempest-GroupsTest-114780873 None] Flow 'volume_create_manager' (7e1ba238-1421-4500-b347-74dbac4d48f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:23:21 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbf8ef71-bd8b-4e44-a007-f609ecc113ef]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:23:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-cdff87cb-08db-4ea0-b9a6-93e68e541d33 tempest-TestInstancesWithCinderVolumes-1896526329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_476fcb6c-e548-451e-89b7-244633d2ddb2_1fepuvr9devstack@QuobyteHD {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:23:21 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-a0177621-25a4-44e2-b6ea-322d7b4934e4 tempest-GroupsTest-114780873 None] Created volume successfully. Nov 06 15:23:21 devstack sudo[93349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-9e885d62-094f-49f5-a31b-783730ab54c3 Nov 06 15:23:21 devstack sudo[93349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:23:21 devstack sudo[93350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_476fcb6c-e548-451e-89b7-244633d2ddb2_1fepuvr9devstack@QuobyteHD Nov 06 15:23:21 devstack sudo[93350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:23:21 devstack sudo[93349]: pam_unix(sudo:session): session closed for user root Nov 06 15:23:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-034890de-c1c7-4bc9-894e-6467547561ec tempest-VolumesActionsTest-1966304339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-9e885d62-094f-49f5-a31b-783730ab54c3" returned: 0 in 0.526s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:23:21 devstack sudo[93350]: pam_unix(sudo:session): session closed for user root Nov 06 15:23:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-cdff87cb-08db-4ea0-b9a6-93e68e541d33 tempest-TestInstancesWithCinderVolumes-1896526329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_476fcb6c-e548-451e-89b7-244633d2ddb2_1fepuvr9devstack@QuobyteHD" returned: 0 in 0.513s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:23:21 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-cdff87cb-08db-4ea0-b9a6-93e68e541d33 tempest-TestInstancesWithCinderVolumes-1896526329 None] 476fcb6c-e548-451e-89b7-244633d2ddb2 was qcow2, converting to qcow2 {{(pid=87132) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 06 15:23:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-cdff87cb-08db-4ea0-b9a6-93e68e541d33 tempest-TestInstancesWithCinderVolumes-1896526329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_476fcb6c-e548-451e-89b7-244633d2ddb2_1fepuvr9devstack@QuobyteHD /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-15eac778-7ea0-42b0-b76a-69e0b9496376 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:23:21 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1442f2e-90eb-46a3-9bc0-44f89eed411e]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:23:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-034890de-c1c7-4bc9-894e-6467547561ec tempest-VolumesActionsTest-1966304339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-9e885d62-094f-49f5-a31b-783730ab54c3 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:23:21 devstack sudo[93359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_476fcb6c-e548-451e-89b7-244633d2ddb2_1fepuvr9devstack@QuobyteHD /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-15eac778-7ea0-42b0-b76a-69e0b9496376 Nov 06 15:23:21 devstack sudo[93359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:23:21 devstack sudo[93361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-9e885d62-094f-49f5-a31b-783730ab54c3 Nov 06 15:23:21 devstack sudo[93361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:23:22 devstack sudo[93361]: pam_unix(sudo:session): session closed for user root Nov 06 15:23:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-034890de-c1c7-4bc9-894e-6467547561ec tempest-VolumesActionsTest-1966304339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-9e885d62-094f-49f5-a31b-783730ab54c3" returned: 0 in 0.464s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:23:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-034890de-c1c7-4bc9-894e-6467547561ec tempest-VolumesActionsTest-1966304339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-9e885d62-094f-49f5-a31b-783730ab54c3 /opt/stack/data/cinder/conversion/9e885d62-094f-49f5-a31b-783730ab54c3.temp_image.96b3b77c-1042-4ef4-ab8c-792865823530xrwtn89p.img {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:23:22 devstack sudo[93369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-9e885d62-094f-49f5-a31b-783730ab54c3 /opt/stack/data/cinder/conversion/9e885d62-094f-49f5-a31b-783730ab54c3.temp_image.96b3b77c-1042-4ef4-ab8c-792865823530xrwtn89p.img Nov 06 15:23:22 devstack sudo[93369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:23:22 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-4ddfd261-0fef-49c2-b6da-415322ac0829 tempest-GroupsTest-114780873 None] Acquiring lock "cinder-quobyte-ed7872e5-1740-49e6-a5ec-9a33934426e1" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:23:22 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-4ddfd261-0fef-49c2-b6da-415322ac0829 tempest-GroupsTest-114780873 None] Lock "cinder-quobyte-ed7872e5-1740-49e6-a5ec-9a33934426e1" acquired by "delete_volume" :: waited 0.036s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:23:22 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1779a09-addb-4532-9cc4-5db06144d4a7]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:23:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4ddfd261-0fef-49c2-b6da-415322ac0829 tempest-GroupsTest-114780873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ed7872e5-1740-49e6-a5ec-9a33934426e1 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:23:23 devstack sudo[93383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ed7872e5-1740-49e6-a5ec-9a33934426e1 Nov 06 15:23:23 devstack sudo[93383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:23:23 devstack sudo[93383]: pam_unix(sudo:session): session closed for user root Nov 06 15:23:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4ddfd261-0fef-49c2-b6da-415322ac0829 tempest-GroupsTest-114780873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ed7872e5-1740-49e6-a5ec-9a33934426e1" returned: 0 in 0.676s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:23:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4ddfd261-0fef-49c2-b6da-415322ac0829 tempest-GroupsTest-114780873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ed7872e5-1740-49e6-a5ec-9a33934426e1 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:23:23 devstack sudo[93388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ed7872e5-1740-49e6-a5ec-9a33934426e1 Nov 06 15:23:23 devstack sudo[93388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:23:23 devstack sudo[93331]: pam_unix(sudo:session): session closed for user root Nov 06 15:23:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4aa79d68-56a1-4363-afa7-f20fe4468ed2 tempest-ServerActionsTestOtherA-1409404420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83_f8_vk41ldevstack@QuobyteHD /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-9a321d18-d577-47b6-b042-a4bf84eb92a7" returned: 0 in 3.004s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:23:23 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-4aa79d68-56a1-4363-afa7-f20fe4468ed2 tempest-ServerActionsTestOtherA-1409404420 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83_f8_vk41ldevstack@QuobyteHD, size 112.00 MB, duration 3.01 sec, destination /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-9a321d18-d577-47b6-b042-a4bf84eb92a7 {{(pid=87132) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 06 15:23:23 devstack cinder-volume[87132]: INFO cinder.image.image_utils [None req-4aa79d68-56a1-4363-afa7-f20fe4468ed2 tempest-ServerActionsTestOtherA-1409404420 None] Converted 112.00 MB image at 37.26 MB/s Nov 06 15:23:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4aa79d68-56a1-4363-afa7-f20fe4468ed2 tempest-ServerActionsTestOtherA-1409404420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-9a321d18-d577-47b6-b042-a4bf84eb92a7 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:23:23 devstack sudo[93390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-9a321d18-d577-47b6-b042-a4bf84eb92a7 1G Nov 06 15:23:23 devstack sudo[93390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:23:24 devstack sudo[93388]: pam_unix(sudo:session): session closed for user root Nov 06 15:23:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4ddfd261-0fef-49c2-b6da-415322ac0829 tempest-GroupsTest-114780873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ed7872e5-1740-49e6-a5ec-9a33934426e1" returned: 0 in 0.617s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:23:24 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-4ddfd261-0fef-49c2-b6da-415322ac0829 tempest-GroupsTest-114780873 None] Lock "cinder-quobyte-ed7872e5-1740-49e6-a5ec-9a33934426e1" released by "delete_volume" :: held 1.381s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:23:24 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-4ddfd261-0fef-49c2-b6da-415322ac0829 tempest-GroupsTest-114780873 None] Created reservations ['0892e087-eedc-428c-9ea8-8ee43d35f837'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:23:24 devstack cinder-volume[87132]: WARNING cinder.quota [None req-4ddfd261-0fef-49c2-b6da-415322ac0829 tempest-GroupsTest-114780873 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1590225256 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1590225256, it is now deprecated. Please use the default quota class for default quota. Nov 06 15:23:24 devstack cinder-volume[87132]: WARNING cinder.quota [None req-4ddfd261-0fef-49c2-b6da-415322ac0829 tempest-GroupsTest-114780873 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1590225256 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1590225256, it is now deprecated. Please use the default quota class for default quota. Nov 06 15:23:24 devstack sudo[93390]: pam_unix(sudo:session): session closed for user root Nov 06 15:23:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4aa79d68-56a1-4363-afa7-f20fe4468ed2 tempest-ServerActionsTestOtherA-1409404420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-9a321d18-d577-47b6-b042-a4bf84eb92a7 1G" returned: 0 in 0.741s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:23:24 devstack cinder-volume[87132]: DEBUG cinder.volume.volume_utils [None req-4aa79d68-56a1-4363-afa7-f20fe4468ed2 tempest-ServerActionsTestOtherA-1409404420 None] Downloaded image 3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83 ((None, [{'url': 'file:///opt/stack/data/glance/images/3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83', 'metadata': {}}])) to volume 9a321d18-d577-47b6-b042-a4bf84eb92a7 successfully. {{(pid=87132) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 06 15:23:24 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-4aa79d68-56a1-4363-afa7-f20fe4468ed2 tempest-ServerActionsTestOtherA-1409404420 None] Temporary image 3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83 for user 95de706326aa49ae829d0ac2fbb07e4f is deleted. {{(pid=87132) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 06 15:23:24 devstack cinder-volume[87132]: DEBUG cinder.volume.volume_utils [None req-4aa79d68-56a1-4363-afa7-f20fe4468ed2 tempest-ServerActionsTestOtherA-1409404420 None] Marking volume 9a321d18-d577-47b6-b042-a4bf84eb92a7 as bootable. {{(pid=87132) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 06 15:23:24 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-4ddfd261-0fef-49c2-b6da-415322ac0829 tempest-GroupsTest-114780873 None] Created reservations ['2ba880e3-b259-4456-93d5-c9e560a14c6f', '28c3f1d2-0f77-4108-baf7-b32134927dbf', 'a1066b82-5eae-4662-93d5-32aa3d2140e5', 'a9be4d19-61a6-4056-958f-202ceab016ff'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:23:24 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-4aa79d68-56a1-4363-afa7-f20fe4468ed2 tempest-ServerActionsTestOtherA-1409404420 None] Copying metadata from image 3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83 to 9a321d18-d577-47b6-b042-a4bf84eb92a7. {{(pid=87132) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 06 15:23:24 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-4aa79d68-56a1-4363-afa7-f20fe4468ed2 tempest-ServerActionsTestOtherA-1409404420 None] Creating volume glance metadata for volume 9a321d18-d577-47b6-b042-a4bf84eb92a7 backed by image 3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87132) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 06 15:23:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4ddfd261-0fef-49c2-b6da-415322ac0829 tempest-GroupsTest-114780873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:23:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4ddfd261-0fef-49c2-b6da-415322ac0829 tempest-GroupsTest-114780873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:23:24 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-4ddfd261-0fef-49c2-b6da-415322ac0829 tempest-GroupsTest-114780873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:23:24 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-4ddfd261-0fef-49c2-b6da-415322ac0829 tempest-GroupsTest-114780873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:23:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4ddfd261-0fef-49c2-b6da-415322ac0829 tempest-GroupsTest-114780873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:23:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4ddfd261-0fef-49c2-b6da-415322ac0829 tempest-GroupsTest-114780873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:23:24 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4aa79d68-56a1-4363-afa7-f20fe4468ed2 tempest-ServerActionsTestOtherA-1409404420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8042c44e-6fc2-4bf3-9b0c-bcefaa233f44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a321d18-d577-47b6-b042-a4bf84eb92a7', 'volume_size': 1, 'image_id': '3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c02e84193ee841ccb304f909f5951fd0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83', 'created_at': datetime.datetime(2026, 11, 6, 14, 12, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 14, 12, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:23:24 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4aa79d68-56a1-4363-afa7-f20fe4468ed2 tempest-ServerActionsTestOtherA-1409404420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7caee9d3-93ec-4712-8ac2-15add4f511cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:23:24 devstack sudo[93397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:23:24 devstack sudo[93397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:23:24 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-4aa79d68-56a1-4363-afa7-f20fe4468ed2 tempest-ServerActionsTestOtherA-1409404420 None] Volume volume-9a321d18-d577-47b6-b042-a4bf84eb92a7 (9a321d18-d577-47b6-b042-a4bf84eb92a7): created successfully Nov 06 15:23:24 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4aa79d68-56a1-4363-afa7-f20fe4468ed2 tempest-ServerActionsTestOtherA-1409404420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7caee9d3-93ec-4712-8ac2-15add4f511cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:23:24 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4aa79d68-56a1-4363-afa7-f20fe4468ed2 tempest-ServerActionsTestOtherA-1409404420 None] Flow 'volume_create_manager' (09d665a0-a889-4407-b707-a0f0750d6f51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:23:24 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-4aa79d68-56a1-4363-afa7-f20fe4468ed2 tempest-ServerActionsTestOtherA-1409404420 None] Created volume successfully. Nov 06 15:23:25 devstack sudo[93397]: pam_unix(sudo:session): session closed for user root Nov 06 15:23:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4ddfd261-0fef-49c2-b6da-415322ac0829 tempest-GroupsTest-114780873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.481s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:23:25 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-4ddfd261-0fef-49c2-b6da-415322ac0829 tempest-GroupsTest-114780873 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:23:25 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-4ddfd261-0fef-49c2-b6da-415322ac0829 tempest-GroupsTest-114780873 None] Delete group completed successfully. Nov 06 15:23:25 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-4034730d-23ca-42cf-b016-ff21a131d1cc tempest-GroupsTest-114780873 None] Created reservations ['1e9b8ac9-1dae-48d1-afa2-d0f6ed0b6ee8'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:23:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4034730d-23ca-42cf-b016-ff21a131d1cc tempest-GroupsTest-114780873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:23:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4034730d-23ca-42cf-b016-ff21a131d1cc tempest-GroupsTest-114780873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:23:25 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-4034730d-23ca-42cf-b016-ff21a131d1cc tempest-GroupsTest-114780873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:23:25 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-4034730d-23ca-42cf-b016-ff21a131d1cc tempest-GroupsTest-114780873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:23:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4034730d-23ca-42cf-b016-ff21a131d1cc tempest-GroupsTest-114780873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:23:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4034730d-23ca-42cf-b016-ff21a131d1cc tempest-GroupsTest-114780873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:23:25 devstack sudo[93400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:23:25 devstack sudo[93400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:23:26 devstack sudo[93400]: pam_unix(sudo:session): session closed for user root Nov 06 15:23:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4034730d-23ca-42cf-b016-ff21a131d1cc tempest-GroupsTest-114780873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.392s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:23:26 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-4034730d-23ca-42cf-b016-ff21a131d1cc tempest-GroupsTest-114780873 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:23:26 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-4034730d-23ca-42cf-b016-ff21a131d1cc tempest-GroupsTest-114780873 None] Delete group completed successfully. Nov 06 15:23:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-cdff87cb-08db-4ea0-b9a6-93e68e541d33 tempest-TestInstancesWithCinderVolumes-1896526329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_476fcb6c-e548-451e-89b7-244633d2ddb2_1fepuvr9devstack@QuobyteHD /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-15eac778-7ea0-42b0-b76a-69e0b9496376" returned: 0 in 5.147s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:23:26 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-cdff87cb-08db-4ea0-b9a6-93e68e541d33 tempest-TestInstancesWithCinderVolumes-1896526329 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_476fcb6c-e548-451e-89b7-244633d2ddb2_1fepuvr9devstack@QuobyteHD, size 112.00 MB, duration 5.15 sec, destination /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-15eac778-7ea0-42b0-b76a-69e0b9496376 {{(pid=87132) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 06 15:23:26 devstack cinder-volume[87132]: INFO cinder.image.image_utils [None req-cdff87cb-08db-4ea0-b9a6-93e68e541d33 tempest-TestInstancesWithCinderVolumes-1896526329 None] Converted 112.00 MB image at 21.74 MB/s Nov 06 15:23:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-cdff87cb-08db-4ea0-b9a6-93e68e541d33 tempest-TestInstancesWithCinderVolumes-1896526329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-15eac778-7ea0-42b0-b76a-69e0b9496376 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:23:27 devstack sudo[93406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-15eac778-7ea0-42b0-b76a-69e0b9496376 1G Nov 06 15:23:27 devstack sudo[93406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:23:27 devstack sudo[93406]: pam_unix(sudo:session): session closed for user root Nov 06 15:23:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-cdff87cb-08db-4ea0-b9a6-93e68e541d33 tempest-TestInstancesWithCinderVolumes-1896526329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-15eac778-7ea0-42b0-b76a-69e0b9496376 1G" returned: 0 in 0.784s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:23:27 devstack cinder-volume[87132]: DEBUG cinder.volume.volume_utils [None req-cdff87cb-08db-4ea0-b9a6-93e68e541d33 tempest-TestInstancesWithCinderVolumes-1896526329 None] Downloaded image 476fcb6c-e548-451e-89b7-244633d2ddb2 ((None, [{'url': 'file:///opt/stack/data/glance/images/476fcb6c-e548-451e-89b7-244633d2ddb2', 'metadata': {}}])) to volume 15eac778-7ea0-42b0-b76a-69e0b9496376 successfully. {{(pid=87132) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 06 15:23:27 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-cdff87cb-08db-4ea0-b9a6-93e68e541d33 tempest-TestInstancesWithCinderVolumes-1896526329 None] Temporary image 476fcb6c-e548-451e-89b7-244633d2ddb2 for user c27aea9057cd41d180d14d2028db4984 is deleted. {{(pid=87132) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 06 15:23:27 devstack cinder-volume[87132]: DEBUG cinder.volume.volume_utils [None req-cdff87cb-08db-4ea0-b9a6-93e68e541d33 tempest-TestInstancesWithCinderVolumes-1896526329 None] Marking volume 15eac778-7ea0-42b0-b76a-69e0b9496376 as bootable. {{(pid=87132) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 06 15:23:27 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-cdff87cb-08db-4ea0-b9a6-93e68e541d33 tempest-TestInstancesWithCinderVolumes-1896526329 None] Copying metadata from image 476fcb6c-e548-451e-89b7-244633d2ddb2 to 15eac778-7ea0-42b0-b76a-69e0b9496376. {{(pid=87132) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 06 15:23:27 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-cdff87cb-08db-4ea0-b9a6-93e68e541d33 tempest-TestInstancesWithCinderVolumes-1896526329 None] Creating volume glance metadata for volume 15eac778-7ea0-42b0-b76a-69e0b9496376 backed by image 476fcb6c-e548-451e-89b7-244633d2ddb2 with: {'image_id': '476fcb6c-e548-451e-89b7-244633d2ddb2', 'image_name': 'tempest-scenario-img--821294848', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87132) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 06 15:23:27 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-24356b2e-6cb7-4395-93aa-ef6855b170b4 tempest-GroupsTest-114780873 None] Group tempest-GroupsTest-Group-881861696: creating Nov 06 15:23:27 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-24356b2e-6cb7-4395-93aa-ef6855b170b4 tempest-GroupsTest-114780873 None] Group tempest-GroupsTest-Group-881861696: created successfully Nov 06 15:23:27 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-24356b2e-6cb7-4395-93aa-ef6855b170b4 tempest-GroupsTest-114780873 None] Create group completed successfully. Nov 06 15:23:28 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-cdff87cb-08db-4ea0-b9a6-93e68e541d33 tempest-TestInstancesWithCinderVolumes-1896526329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7bcf0d6-53b2-4b1f-a735-e463576489a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15eac778-7ea0-42b0-b76a-69e0b9496376', 'volume_size': 1, 'image_id': '476fcb6c-e548-451e-89b7-244633d2ddb2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/476fcb6c-e548-451e-89b7-244633d2ddb2', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--821294848', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '414d4bf92dd4408b85015bd6432ca1df', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '476fcb6c-e548-451e-89b7-244633d2ddb2', 'created_at': datetime.datetime(2026, 11, 6, 14, 22, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 14, 22, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/476fcb6c-e548-451e-89b7-244633d2ddb2/file', 'properties': {}}, 'image_service': }' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:23:28 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-cdff87cb-08db-4ea0-b9a6-93e68e541d33 tempest-TestInstancesWithCinderVolumes-1896526329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2adf51d-83cb-4f65-b07e-49383e8cecdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:23:28 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-cdff87cb-08db-4ea0-b9a6-93e68e541d33 tempest-TestInstancesWithCinderVolumes-1896526329 None] Volume volume-15eac778-7ea0-42b0-b76a-69e0b9496376 (15eac778-7ea0-42b0-b76a-69e0b9496376): created successfully Nov 06 15:23:28 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-cdff87cb-08db-4ea0-b9a6-93e68e541d33 tempest-TestInstancesWithCinderVolumes-1896526329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2adf51d-83cb-4f65-b07e-49383e8cecdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:23:28 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-cdff87cb-08db-4ea0-b9a6-93e68e541d33 tempest-TestInstancesWithCinderVolumes-1896526329 None] Flow 'volume_create_manager' (369bc18f-1ce6-40ef-9117-85eeb969c3e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:23:28 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-cdff87cb-08db-4ea0-b9a6-93e68e541d33 tempest-TestInstancesWithCinderVolumes-1896526329 None] Created volume successfully. Nov 06 15:23:30 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-5dcda971-6b17-40c1-b2b0-c21ad75096b3 tempest-GroupsTest-114780873 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:23:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5dcda971-6b17-40c1-b2b0-c21ad75096b3 tempest-GroupsTest-114780873 None] Flow 'volume_create_manager' (fc733dc4-8161-41d1-a0ea-41112855ad90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:23:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5dcda971-6b17-40c1-b2b0-c21ad75096b3 tempest-GroupsTest-114780873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43733441-d3c7-4a56-b7a0-7093b4cb41ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:23:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5dcda971-6b17-40c1-b2b0-c21ad75096b3 tempest-GroupsTest-114780873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43733441-d3c7-4a56-b7a0-7093b4cb41ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:23:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1983394354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ab48446d-614b-4b82-b18b-a4252d90e85e,host='devstack@QuobyteHD#QuobyteHD',id=92230118-0666-4026-b2f9-7ad9042eb8aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e03ad5d06f9449cba2c90eb41d27bde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:23:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:23:30Z,use_quota=True,user_id='bd82d66b15404b188f761bbb06955d71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9acb214a-9863-477f-8348-0b1576e814d8),volume_type_id=9acb214a-9863-477f-8348-0b1576e814d8)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:23:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5dcda971-6b17-40c1-b2b0-c21ad75096b3 tempest-GroupsTest-114780873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (754f518a-c2d7-47ea-8e2a-b3c76df813d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:23:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5dcda971-6b17-40c1-b2b0-c21ad75096b3 tempest-GroupsTest-114780873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (754f518a-c2d7-47ea-8e2a-b3c76df813d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:23:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5dcda971-6b17-40c1-b2b0-c21ad75096b3 tempest-GroupsTest-114780873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46d77089-06d7-4196-85a2-ced36e678a5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:23:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5dcda971-6b17-40c1-b2b0-c21ad75096b3 tempest-GroupsTest-114780873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46d77089-06d7-4196-85a2-ced36e678a5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92230118-0666-4026-b2f9-7ad9042eb8aa', 'volume_name': 'volume-92230118-0666-4026-b2f9-7ad9042eb8aa', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:23:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5dcda971-6b17-40c1-b2b0-c21ad75096b3 tempest-GroupsTest-114780873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06f48148-e714-425c-86c2-c966cef5a615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:23:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5dcda971-6b17-40c1-b2b0-c21ad75096b3 tempest-GroupsTest-114780873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06f48148-e714-425c-86c2-c966cef5a615) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:23:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5dcda971-6b17-40c1-b2b0-c21ad75096b3 tempest-GroupsTest-114780873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (046b446c-792b-40d0-8320-61cf547195af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:23:30 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-5dcda971-6b17-40c1-b2b0-c21ad75096b3 tempest-GroupsTest-114780873 None] Volume 92230118-0666-4026-b2f9-7ad9042eb8aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92230118-0666-4026-b2f9-7ad9042eb8aa', 'volume_size': 1} Nov 06 15:23:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5dcda971-6b17-40c1-b2b0-c21ad75096b3 tempest-GroupsTest-114780873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:23:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-ceeb72f6-d025-471a-a5c6-25774d13699f req-47575a20-06c3-4072-bd27-c136a913b9a9 tempest-ServerActionsTestOtherA-1409404420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:23:31 devstack sudo[93369]: pam_unix(sudo:session): session closed for user root Nov 06 15:23:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-034890de-c1c7-4bc9-894e-6467547561ec tempest-VolumesActionsTest-1966304339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-9e885d62-094f-49f5-a31b-783730ab54c3 /opt/stack/data/cinder/conversion/9e885d62-094f-49f5-a31b-783730ab54c3.temp_image.96b3b77c-1042-4ef4-ab8c-792865823530xrwtn89p.img" returned: 0 in 9.291s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:23:31 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b022ca9-5b24-46a3-aaa7-224e86def3dc]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:23:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-034890de-c1c7-4bc9-894e-6467547561ec tempest-VolumesActionsTest-1966304339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-9e885d62-094f-49f5-a31b-783730ab54c3 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:23:31 devstack sudo[93424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-9e885d62-094f-49f5-a31b-783730ab54c3 Nov 06 15:23:31 devstack sudo[93424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:23:32 devstack sudo[93424]: pam_unix(sudo:session): session closed for user root Nov 06 15:23:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-034890de-c1c7-4bc9-894e-6467547561ec tempest-VolumesActionsTest-1966304339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-9e885d62-094f-49f5-a31b-783730ab54c3" returned: 0 in 0.675s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:23:32 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-034890de-c1c7-4bc9-894e-6467547561ec tempest-VolumesActionsTest-1966304339 None] Image conversion details: src /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-9e885d62-094f-49f5-a31b-783730ab54c3, size 1024.00 MB, duration 9.29 sec, destination /opt/stack/data/cinder/conversion/9e885d62-094f-49f5-a31b-783730ab54c3.temp_image.96b3b77c-1042-4ef4-ab8c-792865823530xrwtn89p.img {{(pid=87132) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 06 15:23:32 devstack cinder-volume[87132]: INFO cinder.image.image_utils [None req-034890de-c1c7-4bc9-894e-6467547561ec tempest-VolumesActionsTest-1966304339 None] Converted 1024.00 MB image at 110.20 MB/s Nov 06 15:23:32 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-034890de-c1c7-4bc9-894e-6467547561ec tempest-VolumesActionsTest-1966304339 None] 96b3b77c-1042-4ef4-ab8c-792865823530 was raw, converting to qcow2 {{(pid=87132) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}} Nov 06 15:23:32 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[88098241-840d-47e5-8bfa-4e85d6f43334]: (4, 'raw') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:23:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-034890de-c1c7-4bc9-894e-6467547561ec tempest-VolumesActionsTest-1966304339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/9e885d62-094f-49f5-a31b-783730ab54c3.temp_image.96b3b77c-1042-4ef4-ab8c-792865823530xrwtn89p.img {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:23:32 devstack sudo[93430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/9e885d62-094f-49f5-a31b-783730ab54c3.temp_image.96b3b77c-1042-4ef4-ab8c-792865823530xrwtn89p.img Nov 06 15:23:32 devstack sudo[93430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:23:32 devstack sudo[93430]: pam_unix(sudo:session): session closed for user root Nov 06 15:23:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-034890de-c1c7-4bc9-894e-6467547561ec tempest-VolumesActionsTest-1966304339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/9e885d62-094f-49f5-a31b-783730ab54c3.temp_image.96b3b77c-1042-4ef4-ab8c-792865823530xrwtn89p.img" returned: 0 in 0.391s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:23:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-034890de-c1c7-4bc9-894e-6467547561ec tempest-VolumesActionsTest-1966304339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/9e885d62-094f-49f5-a31b-783730ab54c3.temp_image.96b3b77c-1042-4ef4-ab8c-792865823530xrwtn89p.img {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:23:32 devstack sudo[93434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/9e885d62-094f-49f5-a31b-783730ab54c3.temp_image.96b3b77c-1042-4ef4-ab8c-792865823530xrwtn89p.img Nov 06 15:23:32 devstack sudo[93434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:23:33 devstack sudo[93434]: pam_unix(sudo:session): session closed for user root Nov 06 15:23:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-034890de-c1c7-4bc9-894e-6467547561ec tempest-VolumesActionsTest-1966304339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/9e885d62-094f-49f5-a31b-783730ab54c3.temp_image.96b3b77c-1042-4ef4-ab8c-792865823530xrwtn89p.img" returned: 1 in 0.480s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:23:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-034890de-c1c7-4bc9-894e-6467547561ec tempest-VolumesActionsTest-1966304339 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/9e885d62-094f-49f5-a31b-783730ab54c3.temp_image.96b3b77c-1042-4ef4-ab8c-792865823530xrwtn89p.img' failed. Not Retrying. {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 15:23:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-034890de-c1c7-4bc9-894e-6467547561ec tempest-VolumesActionsTest-1966304339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/9e885d62-094f-49f5-a31b-783730ab54c3.temp_image.96b3b77c-1042-4ef4-ab8c-792865823530xrwtn89p.img /opt/stack/data/cinder/conversion/vol_upload_licdoqcl {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:23:33 devstack sudo[93448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/9e885d62-094f-49f5-a31b-783730ab54c3.temp_image.96b3b77c-1042-4ef4-ab8c-792865823530xrwtn89p.img /opt/stack/data/cinder/conversion/vol_upload_licdoqcl Nov 06 15:23:33 devstack sudo[93448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:23:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-0c6e9d83-d2d8-48d6-bee2-5709383c1787 req-31ce8f0c-ec2d-411a-a0a7-e8577e88160d tempest-TestInstancesWithCinderVolumes-1896526329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:23:33 devstack sudo[93448]: pam_unix(sudo:session): session closed for user root Nov 06 15:23:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-034890de-c1c7-4bc9-894e-6467547561ec tempest-VolumesActionsTest-1966304339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/9e885d62-094f-49f5-a31b-783730ab54c3.temp_image.96b3b77c-1042-4ef4-ab8c-792865823530xrwtn89p.img /opt/stack/data/cinder/conversion/vol_upload_licdoqcl" returned: 0 in 0.355s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:23:33 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-034890de-c1c7-4bc9-894e-6467547561ec tempest-VolumesActionsTest-1966304339 None] Image conversion details: src /opt/stack/data/cinder/conversion/9e885d62-094f-49f5-a31b-783730ab54c3.temp_image.96b3b77c-1042-4ef4-ab8c-792865823530xrwtn89p.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_licdoqcl {{(pid=87132) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 06 15:23:33 devstack cinder-volume[87132]: INFO cinder.image.image_utils [None req-034890de-c1c7-4bc9-894e-6467547561ec tempest-VolumesActionsTest-1966304339 None] Converted 1024.00 MB image at 1024.00 MB/s Nov 06 15:23:33 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[16c0fca9-5f21-4ae0-980b-cdae29acac34]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:23:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-034890de-c1c7-4bc9-894e-6467547561ec tempest-VolumesActionsTest-1966304339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_licdoqcl {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:23:33 devstack sudo[93454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_licdoqcl Nov 06 15:23:33 devstack sudo[93454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:23:33 devstack sudo[93454]: pam_unix(sudo:session): session closed for user root Nov 06 15:23:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-034890de-c1c7-4bc9-894e-6467547561ec tempest-VolumesActionsTest-1966304339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_licdoqcl" returned: 0 in 0.382s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:23:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-034890de-c1c7-4bc9-894e-6467547561ec tempest-VolumesActionsTest-1966304339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 14.264s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:23:35 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-034890de-c1c7-4bc9-894e-6467547561ec tempest-VolumesActionsTest-1966304339 None] Uploaded volume to glance image-id: 96b3b77c-1042-4ef4-ab8c-792865823530. {{(pid=87132) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 06 15:23:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5dcda971-6b17-40c1-b2b0-c21ad75096b3 tempest-GroupsTest-114780873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.170s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:23:35 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-5dcda971-6b17-40c1-b2b0-c21ad75096b3 tempest-GroupsTest-114780873 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=ab48446d-614b-4b82-b18b-a4252d90e85e,created_at=2026-11-06T14:23:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1983394354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ab48446d-614b-4b82-b18b-a4252d90e85e,host='devstack@QuobyteHD#QuobyteHD',id=92230118-0666-4026-b2f9-7ad9042eb8aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e03ad5d06f9449cba2c90eb41d27bde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:23:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:23:30Z,use_quota=True,user_id='bd82d66b15404b188f761bbb06955d71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9acb214a-9863-477f-8348-0b1576e814d8),volume_type_id=9acb214a-9863-477f-8348-0b1576e814d8)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:23:35 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-5dcda971-6b17-40c1-b2b0-c21ad75096b3 tempest-GroupsTest-114780873 None] Creating volume 92230118-0666-4026-b2f9-7ad9042eb8aa {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:23:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5dcda971-6b17-40c1-b2b0-c21ad75096b3 tempest-GroupsTest-114780873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:23:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5dcda971-6b17-40c1-b2b0-c21ad75096b3 tempest-GroupsTest-114780873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:23:35 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-5dcda971-6b17-40c1-b2b0-c21ad75096b3 tempest-GroupsTest-114780873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:23:35 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-5dcda971-6b17-40c1-b2b0-c21ad75096b3 tempest-GroupsTest-114780873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:23:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5dcda971-6b17-40c1-b2b0-c21ad75096b3 tempest-GroupsTest-114780873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:23:35 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-5dcda971-6b17-40c1-b2b0-c21ad75096b3 tempest-GroupsTest-114780873 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:23:35 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-5dcda971-6b17-40c1-b2b0-c21ad75096b3 tempest-GroupsTest-114780873 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:23:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5dcda971-6b17-40c1-b2b0-c21ad75096b3 tempest-GroupsTest-114780873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-92230118-0666-4026-b2f9-7ad9042eb8aa 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:23:35 devstack sudo[93462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-92230118-0666-4026-b2f9-7ad9042eb8aa 1073741824 Nov 06 15:23:35 devstack sudo[93462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:23:35 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-034890de-c1c7-4bc9-894e-6467547561ec tempest-VolumesActionsTest-1966304339 None] Copy volume to image completed successfully. Nov 06 15:23:35 devstack sudo[93462]: pam_unix(sudo:session): session closed for user root Nov 06 15:23:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5dcda971-6b17-40c1-b2b0-c21ad75096b3 tempest-GroupsTest-114780873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-92230118-0666-4026-b2f9-7ad9042eb8aa 1073741824" returned: 0 in 0.449s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:23:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5dcda971-6b17-40c1-b2b0-c21ad75096b3 tempest-GroupsTest-114780873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-92230118-0666-4026-b2f9-7ad9042eb8aa {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:23:36 devstack sudo[93468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-92230118-0666-4026-b2f9-7ad9042eb8aa Nov 06 15:23:36 devstack sudo[93468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:23:36 devstack sudo[93468]: pam_unix(sudo:session): session closed for user root Nov 06 15:23:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5dcda971-6b17-40c1-b2b0-c21ad75096b3 tempest-GroupsTest-114780873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-92230118-0666-4026-b2f9-7ad9042eb8aa" returned: 0 in 0.250s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:23:36 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-5dcda971-6b17-40c1-b2b0-c21ad75096b3 tempest-GroupsTest-114780873 None] <== create_volume: return (748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:23:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5dcda971-6b17-40c1-b2b0-c21ad75096b3 tempest-GroupsTest-114780873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.752s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:23:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-ceeb72f6-d025-471a-a5c6-25774d13699f req-47575a20-06c3-4072-bd27-c136a913b9a9 tempest-ServerActionsTestOtherA-1409404420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 5.419s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:23:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5dcda971-6b17-40c1-b2b0-c21ad75096b3 tempest-GroupsTest-114780873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (046b446c-792b-40d0-8320-61cf547195af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92230118-0666-4026-b2f9-7ad9042eb8aa', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:23:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5dcda971-6b17-40c1-b2b0-c21ad75096b3 tempest-GroupsTest-114780873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfa40ec0-ddb9-48cf-bc88-cfe42b243fbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:23:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-ceeb72f6-d025-471a-a5c6-25774d13699f req-47575a20-06c3-4072-bd27-c136a913b9a9 tempest-ServerActionsTestOtherA-1409404420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:23:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-0c6e9d83-d2d8-48d6-bee2-5709383c1787 req-31ce8f0c-ec2d-411a-a0a7-e8577e88160d tempest-TestInstancesWithCinderVolumes-1896526329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.886s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:23:36 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-5dcda971-6b17-40c1-b2b0-c21ad75096b3 tempest-GroupsTest-114780873 None] Volume volume-92230118-0666-4026-b2f9-7ad9042eb8aa (92230118-0666-4026-b2f9-7ad9042eb8aa): created successfully Nov 06 15:23:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5dcda971-6b17-40c1-b2b0-c21ad75096b3 tempest-GroupsTest-114780873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfa40ec0-ddb9-48cf-bc88-cfe42b243fbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:23:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5dcda971-6b17-40c1-b2b0-c21ad75096b3 tempest-GroupsTest-114780873 None] Flow 'volume_create_manager' (fc733dc4-8161-41d1-a0ea-41112855ad90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:23:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-0c6e9d83-d2d8-48d6-bee2-5709383c1787 req-31ce8f0c-ec2d-411a-a0a7-e8577e88160d tempest-TestInstancesWithCinderVolumes-1896526329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.029s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:23:36 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-5dcda971-6b17-40c1-b2b0-c21ad75096b3 tempest-GroupsTest-114780873 None] Created volume successfully. Nov 06 15:23:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-ceeb72f6-d025-471a-a5c6-25774d13699f req-47575a20-06c3-4072-bd27-c136a913b9a9 tempest-ServerActionsTestOtherA-1409404420 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b', 'name': 'volume-9a321d18-d577-47b6-b042-a4bf84eb92a7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '196e91f2-1482-4b9e-adc8-a6f7b6cc859f', 'enforce_multipath': True} {{(pid=87132) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 15:23:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-0c6e9d83-d2d8-48d6-bee2-5709383c1787 req-31ce8f0c-ec2d-411a-a0a7-e8577e88160d tempest-TestInstancesWithCinderVolumes-1896526329 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b', 'name': 'volume-15eac778-7ea0-42b0-b76a-69e0b9496376', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '297bd5e9-4d46-4a9d-890f-5ace482252fd', 'enforce_multipath': True} {{(pid=87132) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 15:23:36 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-ceeb72f6-d025-471a-a5c6-25774d13699f req-47575a20-06c3-4072-bd27-c136a913b9a9 tempest-ServerActionsTestOtherA-1409404420 None] attachment_update completed successfully. Nov 06 15:23:36 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-0c6e9d83-d2d8-48d6-bee2-5709383c1787 req-31ce8f0c-ec2d-411a-a0a7-e8577e88160d tempest-TestInstancesWithCinderVolumes-1896526329 None] attachment_update completed successfully. Nov 06 15:23:37 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-47f823b1-d418-4c7d-992c-25791561f178 tempest-VolumesActionsTest-1966304339 None] Acquiring lock "cinder-9e885d62-094f-49f5-a31b-783730ab54c3-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:23:37 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-47f823b1-d418-4c7d-992c-25791561f178 tempest-VolumesActionsTest-1966304339 None] Lock "cinder-9e885d62-094f-49f5-a31b-783730ab54c3-delete_volume" acquired by "delete_volume" :: waited 0.099s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:23:37 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-2920e77d-cfec-4480-aa0b-84c27f3fbc05 tempest-GroupsTest-114780873 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:23:37 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2920e77d-cfec-4480-aa0b-84c27f3fbc05 tempest-GroupsTest-114780873 None] Flow 'volume_create_manager' (19cdc1ba-9614-43ef-8fb0-410bfe1998e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:23:37 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2920e77d-cfec-4480-aa0b-84c27f3fbc05 tempest-GroupsTest-114780873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0079f7d2-e618-447d-9f6d-519b81551c90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:23:37 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-47f823b1-d418-4c7d-992c-25791561f178 tempest-VolumesActionsTest-1966304339 None] Acquiring lock "cinder-quobyte-9e885d62-094f-49f5-a31b-783730ab54c3" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:23:37 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2920e77d-cfec-4480-aa0b-84c27f3fbc05 tempest-GroupsTest-114780873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0079f7d2-e618-447d-9f6d-519b81551c90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:23:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-59480275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ab48446d-614b-4b82-b18b-a4252d90e85e,host='devstack@QuobyteHD#QuobyteHD',id=3b67c241-74ee-42b9-be7f-ccee4c13f574,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e03ad5d06f9449cba2c90eb41d27bde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:23:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:23:37Z,use_quota=True,user_id='bd82d66b15404b188f761bbb06955d71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9acb214a-9863-477f-8348-0b1576e814d8),volume_type_id=9acb214a-9863-477f-8348-0b1576e814d8)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:23:37 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2920e77d-cfec-4480-aa0b-84c27f3fbc05 tempest-GroupsTest-114780873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9f09deb-bf37-4fce-8259-5bd2faa24d2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:23:37 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2920e77d-cfec-4480-aa0b-84c27f3fbc05 tempest-GroupsTest-114780873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9f09deb-bf37-4fce-8259-5bd2faa24d2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:23:37 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2920e77d-cfec-4480-aa0b-84c27f3fbc05 tempest-GroupsTest-114780873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (def67892-a69f-475a-a55e-a8342c3f250f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:23:37 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2920e77d-cfec-4480-aa0b-84c27f3fbc05 tempest-GroupsTest-114780873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (def67892-a69f-475a-a55e-a8342c3f250f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b67c241-74ee-42b9-be7f-ccee4c13f574', 'volume_name': 'volume-3b67c241-74ee-42b9-be7f-ccee4c13f574', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:23:37 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2920e77d-cfec-4480-aa0b-84c27f3fbc05 tempest-GroupsTest-114780873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43a58bc5-5a02-47bf-be03-503f0d369c41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:23:37 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2920e77d-cfec-4480-aa0b-84c27f3fbc05 tempest-GroupsTest-114780873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43a58bc5-5a02-47bf-be03-503f0d369c41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:23:37 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2920e77d-cfec-4480-aa0b-84c27f3fbc05 tempest-GroupsTest-114780873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6b5946b-4d84-41d2-a434-e8d754ed8cbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:23:37 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-2920e77d-cfec-4480-aa0b-84c27f3fbc05 tempest-GroupsTest-114780873 None] Volume 3b67c241-74ee-42b9-be7f-ccee4c13f574: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b67c241-74ee-42b9-be7f-ccee4c13f574', 'volume_size': 1} Nov 06 15:23:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-2920e77d-cfec-4480-aa0b-84c27f3fbc05 tempest-GroupsTest-114780873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:23:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-2920e77d-cfec-4480-aa0b-84c27f3fbc05 tempest-GroupsTest-114780873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:23:37 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-2920e77d-cfec-4480-aa0b-84c27f3fbc05 tempest-GroupsTest-114780873 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=ab48446d-614b-4b82-b18b-a4252d90e85e,created_at=2026-11-06T14:23:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-59480275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ab48446d-614b-4b82-b18b-a4252d90e85e,host='devstack@QuobyteHD#QuobyteHD',id=3b67c241-74ee-42b9-be7f-ccee4c13f574,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e03ad5d06f9449cba2c90eb41d27bde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:23:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:23:37Z,use_quota=True,user_id='bd82d66b15404b188f761bbb06955d71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9acb214a-9863-477f-8348-0b1576e814d8),volume_type_id=9acb214a-9863-477f-8348-0b1576e814d8)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:23:37 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-2920e77d-cfec-4480-aa0b-84c27f3fbc05 tempest-GroupsTest-114780873 None] Creating volume 3b67c241-74ee-42b9-be7f-ccee4c13f574 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:23:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-2920e77d-cfec-4480-aa0b-84c27f3fbc05 tempest-GroupsTest-114780873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:23:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-2920e77d-cfec-4480-aa0b-84c27f3fbc05 tempest-GroupsTest-114780873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:23:37 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-2920e77d-cfec-4480-aa0b-84c27f3fbc05 tempest-GroupsTest-114780873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:23:37 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-2920e77d-cfec-4480-aa0b-84c27f3fbc05 tempest-GroupsTest-114780873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:23:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-2920e77d-cfec-4480-aa0b-84c27f3fbc05 tempest-GroupsTest-114780873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:23:37 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-2920e77d-cfec-4480-aa0b-84c27f3fbc05 tempest-GroupsTest-114780873 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:23:37 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-2920e77d-cfec-4480-aa0b-84c27f3fbc05 tempest-GroupsTest-114780873 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:23:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2920e77d-cfec-4480-aa0b-84c27f3fbc05 tempest-GroupsTest-114780873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-3b67c241-74ee-42b9-be7f-ccee4c13f574 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:23:38 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-47f823b1-d418-4c7d-992c-25791561f178 tempest-VolumesActionsTest-1966304339 None] Lock "cinder-quobyte-9e885d62-094f-49f5-a31b-783730ab54c3" acquired by "delete_volume" :: waited 0.203s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:23:38 devstack sudo[93700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-3b67c241-74ee-42b9-be7f-ccee4c13f574 1073741824 Nov 06 15:23:38 devstack sudo[93700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:23:38 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c67cc08-6bcb-4f37-aff3-0f188b26a8fc]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:23:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-47f823b1-d418-4c7d-992c-25791561f178 tempest-VolumesActionsTest-1966304339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-9e885d62-094f-49f5-a31b-783730ab54c3 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:23:38 devstack sudo[93929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-9e885d62-094f-49f5-a31b-783730ab54c3 Nov 06 15:23:38 devstack sudo[93929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:23:38 devstack sudo[93929]: pam_unix(sudo:session): session closed for user root Nov 06 15:23:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-47f823b1-d418-4c7d-992c-25791561f178 tempest-VolumesActionsTest-1966304339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-9e885d62-094f-49f5-a31b-783730ab54c3" returned: 0 in 0.776s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:23:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-47f823b1-d418-4c7d-992c-25791561f178 tempest-VolumesActionsTest-1966304339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-9e885d62-094f-49f5-a31b-783730ab54c3 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:23:39 devstack sudo[93989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-9e885d62-094f-49f5-a31b-783730ab54c3 Nov 06 15:23:39 devstack sudo[93989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:23:39 devstack sudo[93700]: pam_unix(sudo:session): session closed for user root Nov 06 15:23:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2920e77d-cfec-4480-aa0b-84c27f3fbc05 tempest-GroupsTest-114780873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-3b67c241-74ee-42b9-be7f-ccee4c13f574 1073741824" returned: 0 in 1.176s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:23:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2920e77d-cfec-4480-aa0b-84c27f3fbc05 tempest-GroupsTest-114780873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-3b67c241-74ee-42b9-be7f-ccee4c13f574 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:23:39 devstack sudo[93995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-3b67c241-74ee-42b9-be7f-ccee4c13f574 Nov 06 15:23:39 devstack sudo[93995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:23:39 devstack sudo[93989]: pam_unix(sudo:session): session closed for user root Nov 06 15:23:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-47f823b1-d418-4c7d-992c-25791561f178 tempest-VolumesActionsTest-1966304339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-9e885d62-094f-49f5-a31b-783730ab54c3" returned: 0 in 0.627s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:23:39 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-47f823b1-d418-4c7d-992c-25791561f178 tempest-VolumesActionsTest-1966304339 None] Lock "cinder-quobyte-9e885d62-094f-49f5-a31b-783730ab54c3" released by "delete_volume" :: held 1.585s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:23:39 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-47f823b1-d418-4c7d-992c-25791561f178 tempest-VolumesActionsTest-1966304339 None] Created reservations ['a5536174-ba46-40de-a9c8-98171110978d', '2b388270-4b02-4cde-8745-9f30521e29eb', 'd81cb7d4-90ab-4ec1-a58f-287eb67d5361', 'ffd7f115-eb22-47a0-be37-704d7dcdab4d'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:23:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-47f823b1-d418-4c7d-992c-25791561f178 tempest-VolumesActionsTest-1966304339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:23:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-47f823b1-d418-4c7d-992c-25791561f178 tempest-VolumesActionsTest-1966304339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:23:39 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-47f823b1-d418-4c7d-992c-25791561f178 tempest-VolumesActionsTest-1966304339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:23:39 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-47f823b1-d418-4c7d-992c-25791561f178 tempest-VolumesActionsTest-1966304339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:23:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-47f823b1-d418-4c7d-992c-25791561f178 tempest-VolumesActionsTest-1966304339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:23:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-47f823b1-d418-4c7d-992c-25791561f178 tempest-VolumesActionsTest-1966304339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:23:39 devstack sudo[94007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:23:39 devstack sudo[94007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:23:39 devstack sudo[93995]: pam_unix(sudo:session): session closed for user root Nov 06 15:23:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2920e77d-cfec-4480-aa0b-84c27f3fbc05 tempest-GroupsTest-114780873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-3b67c241-74ee-42b9-be7f-ccee4c13f574" returned: 0 in 0.645s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:23:39 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-2920e77d-cfec-4480-aa0b-84c27f3fbc05 tempest-GroupsTest-114780873 None] <== create_volume: return (1951ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:23:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-2920e77d-cfec-4480-aa0b-84c27f3fbc05 tempest-GroupsTest-114780873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.954s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:23:39 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2920e77d-cfec-4480-aa0b-84c27f3fbc05 tempest-GroupsTest-114780873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6b5946b-4d84-41d2-a434-e8d754ed8cbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b67c241-74ee-42b9-be7f-ccee4c13f574', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:23:39 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2920e77d-cfec-4480-aa0b-84c27f3fbc05 tempest-GroupsTest-114780873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7c2ea97-ea0c-42a5-94bd-a2e937eb87eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:23:39 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-2920e77d-cfec-4480-aa0b-84c27f3fbc05 tempest-GroupsTest-114780873 None] Volume volume-3b67c241-74ee-42b9-be7f-ccee4c13f574 (3b67c241-74ee-42b9-be7f-ccee4c13f574): created successfully Nov 06 15:23:40 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2920e77d-cfec-4480-aa0b-84c27f3fbc05 tempest-GroupsTest-114780873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7c2ea97-ea0c-42a5-94bd-a2e937eb87eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:23:40 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2920e77d-cfec-4480-aa0b-84c27f3fbc05 tempest-GroupsTest-114780873 None] Flow 'volume_create_manager' (19cdc1ba-9614-43ef-8fb0-410bfe1998e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:23:40 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-2920e77d-cfec-4480-aa0b-84c27f3fbc05 tempest-GroupsTest-114780873 None] Created volume successfully. Nov 06 15:23:40 devstack sudo[94007]: pam_unix(sudo:session): session closed for user root Nov 06 15:23:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-47f823b1-d418-4c7d-992c-25791561f178 tempest-VolumesActionsTest-1966304339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.564s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:23:40 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-47f823b1-d418-4c7d-992c-25791561f178 tempest-VolumesActionsTest-1966304339 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:23:40 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-47f823b1-d418-4c7d-992c-25791561f178 tempest-VolumesActionsTest-1966304339 None] Deleted volume successfully. Nov 06 15:23:40 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-47f823b1-d418-4c7d-992c-25791561f178 tempest-VolumesActionsTest-1966304339 None] Lock "cinder-9e885d62-094f-49f5-a31b-783730ab54c3-delete_volume" released by "delete_volume" :: held 2.936s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:23:41 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-30610354-f77f-4b4c-8901-45d0780637a1 tempest-GroupsTest-114780873 None] Update group completed successfully. Nov 06 15:23:42 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-f366275c-a590-4481-b338-d5c7899f8409 tempest-GroupsTest-114780873 None] Update group completed successfully. Nov 06 15:23:45 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b22ae9c1-d634-4caf-9817-4f55047336cf tempest-GroupsTest-114780873 None] Acquiring lock "cinder-quobyte-3b67c241-74ee-42b9-be7f-ccee4c13f574" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:23:45 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b22ae9c1-d634-4caf-9817-4f55047336cf tempest-GroupsTest-114780873 None] Lock "cinder-quobyte-3b67c241-74ee-42b9-be7f-ccee4c13f574" acquired by "delete_volume" :: waited 0.066s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:23:45 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[e501b43a-30a3-45ec-a605-4ea5e5002270]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:23:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b22ae9c1-d634-4caf-9817-4f55047336cf tempest-GroupsTest-114780873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-3b67c241-74ee-42b9-be7f-ccee4c13f574 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:23:45 devstack sudo[94019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-3b67c241-74ee-42b9-be7f-ccee4c13f574 Nov 06 15:23:45 devstack sudo[94019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:23:45 devstack sudo[94019]: pam_unix(sudo:session): session closed for user root Nov 06 15:23:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b22ae9c1-d634-4caf-9817-4f55047336cf tempest-GroupsTest-114780873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-3b67c241-74ee-42b9-be7f-ccee4c13f574" returned: 0 in 0.667s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:23:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b22ae9c1-d634-4caf-9817-4f55047336cf tempest-GroupsTest-114780873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-3b67c241-74ee-42b9-be7f-ccee4c13f574 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:23:46 devstack sudo[94025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-3b67c241-74ee-42b9-be7f-ccee4c13f574 Nov 06 15:23:46 devstack sudo[94025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:23:46 devstack sudo[94025]: pam_unix(sudo:session): session closed for user root Nov 06 15:23:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b22ae9c1-d634-4caf-9817-4f55047336cf tempest-GroupsTest-114780873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-3b67c241-74ee-42b9-be7f-ccee4c13f574" returned: 0 in 0.992s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:23:47 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b22ae9c1-d634-4caf-9817-4f55047336cf tempest-GroupsTest-114780873 None] Lock "cinder-quobyte-3b67c241-74ee-42b9-be7f-ccee4c13f574" released by "delete_volume" :: held 1.812s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:23:47 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b22ae9c1-d634-4caf-9817-4f55047336cf tempest-GroupsTest-114780873 None] Acquiring lock "cinder-quobyte-92230118-0666-4026-b2f9-7ad9042eb8aa" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:23:47 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b22ae9c1-d634-4caf-9817-4f55047336cf tempest-GroupsTest-114780873 None] Lock "cinder-quobyte-92230118-0666-4026-b2f9-7ad9042eb8aa" acquired by "delete_volume" :: waited 0.038s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:23:47 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb565544-cb01-4906-94e0-46023a27acb3]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:23:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b22ae9c1-d634-4caf-9817-4f55047336cf tempest-GroupsTest-114780873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-92230118-0666-4026-b2f9-7ad9042eb8aa {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:23:47 devstack sudo[94030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-92230118-0666-4026-b2f9-7ad9042eb8aa Nov 06 15:23:47 devstack sudo[94030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:23:48 devstack sudo[94030]: pam_unix(sudo:session): session closed for user root Nov 06 15:23:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b22ae9c1-d634-4caf-9817-4f55047336cf tempest-GroupsTest-114780873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-92230118-0666-4026-b2f9-7ad9042eb8aa" returned: 0 in 0.993s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:23:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b22ae9c1-d634-4caf-9817-4f55047336cf tempest-GroupsTest-114780873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-92230118-0666-4026-b2f9-7ad9042eb8aa {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:23:48 devstack sudo[94036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-92230118-0666-4026-b2f9-7ad9042eb8aa Nov 06 15:23:48 devstack sudo[94036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:23:48 devstack sudo[94036]: pam_unix(sudo:session): session closed for user root Nov 06 15:23:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b22ae9c1-d634-4caf-9817-4f55047336cf tempest-GroupsTest-114780873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-92230118-0666-4026-b2f9-7ad9042eb8aa" returned: 0 in 0.648s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:23:48 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b22ae9c1-d634-4caf-9817-4f55047336cf tempest-GroupsTest-114780873 None] Lock "cinder-quobyte-92230118-0666-4026-b2f9-7ad9042eb8aa" released by "delete_volume" :: held 1.771s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:23:49 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-b22ae9c1-d634-4caf-9817-4f55047336cf tempest-GroupsTest-114780873 None] Created reservations ['afa632f7-ee33-49a2-b039-3acd6e4cb5e5'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:23:49 devstack cinder-volume[87132]: WARNING cinder.quota [None req-b22ae9c1-d634-4caf-9817-4f55047336cf tempest-GroupsTest-114780873 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1916765173 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1916765173, it is now deprecated. Please use the default quota class for default quota. Nov 06 15:23:49 devstack cinder-volume[87132]: WARNING cinder.quota [None req-b22ae9c1-d634-4caf-9817-4f55047336cf tempest-GroupsTest-114780873 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1916765173 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1916765173, it is now deprecated. Please use the default quota class for default quota. Nov 06 15:23:49 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-b22ae9c1-d634-4caf-9817-4f55047336cf tempest-GroupsTest-114780873 None] Created reservations ['5d7cab41-752f-4d7f-9b37-e97813f04864', '67aa8c0c-ba5c-4d9a-99f1-0215cbe75229', 'ce2058da-0c9e-4cce-a10d-70eb91b76a68', 'c54672c7-a45b-4da7-ac51-bbf05afe2c24'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:23:49 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-b22ae9c1-d634-4caf-9817-4f55047336cf tempest-GroupsTest-114780873 None] Created reservations ['0594bda0-96e0-4dc6-a302-aaa52a5d40d7', 'd0cb2949-b205-4528-8f86-360c3a75e848', '1155a4e3-4b25-4cbd-9fb5-f41c41b4f01e', '08596c82-8535-4770-9d44-a02d55dc35f9'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:23:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b22ae9c1-d634-4caf-9817-4f55047336cf tempest-GroupsTest-114780873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:23:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b22ae9c1-d634-4caf-9817-4f55047336cf tempest-GroupsTest-114780873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:23:49 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-b22ae9c1-d634-4caf-9817-4f55047336cf tempest-GroupsTest-114780873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:23:49 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-b22ae9c1-d634-4caf-9817-4f55047336cf tempest-GroupsTest-114780873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:23:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b22ae9c1-d634-4caf-9817-4f55047336cf tempest-GroupsTest-114780873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:23:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b22ae9c1-d634-4caf-9817-4f55047336cf tempest-GroupsTest-114780873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:23:49 devstack sudo[94041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:23:49 devstack sudo[94041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:23:50 devstack sudo[94041]: pam_unix(sudo:session): session closed for user root Nov 06 15:23:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b22ae9c1-d634-4caf-9817-4f55047336cf tempest-GroupsTest-114780873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.685s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:23:50 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-b22ae9c1-d634-4caf-9817-4f55047336cf tempest-GroupsTest-114780873 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:23:50 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-b22ae9c1-d634-4caf-9817-4f55047336cf tempest-GroupsTest-114780873 None] Delete group completed successfully. Nov 06 15:23:58 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:SELECT=84,cinder:UPDATE=82,cinder:INSERT=31,cinder:DELETE=6 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 15:23:58 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:SELECT=99,cinder:INSERT=22,cinder:UPDATE=85,cinder:DELETE=2 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 15:23:58 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-853abf9d-4bad-4d43-a670-47c9384c2777 tempest-VolumesGetTest-1085601192 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:23:58 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-853abf9d-4bad-4d43-a670-47c9384c2777 tempest-VolumesGetTest-1085601192 None] Flow 'volume_create_manager' (19036701-aa08-4a57-aa31-66249a459999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:23:58 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-853abf9d-4bad-4d43-a670-47c9384c2777 tempest-VolumesGetTest-1085601192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e39181a2-1236-4c18-82a0-edef03bda710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:23:58 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-853abf9d-4bad-4d43-a670-47c9384c2777 tempest-VolumesGetTest-1085601192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e39181a2-1236-4c18-82a0-edef03bda710) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:23:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1088974964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4c15885-dcee-43f1-9274-b8ec1be70a4f,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='19a710b72df64f7cb85396f4325746a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:23:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:23:58Z,use_quota=True,user_id='f73a6732646d4a37be9909093d84b9e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:23:58 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-853abf9d-4bad-4d43-a670-47c9384c2777 tempest-VolumesGetTest-1085601192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdb06c0c-ff50-4276-ba3a-c593bfb45e71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:23:58 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-853abf9d-4bad-4d43-a670-47c9384c2777 tempest-VolumesGetTest-1085601192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdb06c0c-ff50-4276-ba3a-c593bfb45e71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:23:58 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-853abf9d-4bad-4d43-a670-47c9384c2777 tempest-VolumesGetTest-1085601192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c144f680-18ec-4ba0-9ec1-e9d296364d96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:23:58 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-853abf9d-4bad-4d43-a670-47c9384c2777 tempest-VolumesGetTest-1085601192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c144f680-18ec-4ba0-9ec1-e9d296364d96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4c15885-dcee-43f1-9274-b8ec1be70a4f', 'volume_name': 'volume-e4c15885-dcee-43f1-9274-b8ec1be70a4f', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:23:58 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-853abf9d-4bad-4d43-a670-47c9384c2777 tempest-VolumesGetTest-1085601192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (595e7826-ce4e-4b36-9a19-d28056e15377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:23:58 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-853abf9d-4bad-4d43-a670-47c9384c2777 tempest-VolumesGetTest-1085601192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (595e7826-ce4e-4b36-9a19-d28056e15377) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:23:58 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-853abf9d-4bad-4d43-a670-47c9384c2777 tempest-VolumesGetTest-1085601192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a291bfd7-bbe1-41df-be9a-bbc5b62ab2f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:23:58 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-853abf9d-4bad-4d43-a670-47c9384c2777 tempest-VolumesGetTest-1085601192 None] Volume e4c15885-dcee-43f1-9274-b8ec1be70a4f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4c15885-dcee-43f1-9274-b8ec1be70a4f', 'volume_size': 1} Nov 06 15:23:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-853abf9d-4bad-4d43-a670-47c9384c2777 tempest-VolumesGetTest-1085601192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:23:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-853abf9d-4bad-4d43-a670-47c9384c2777 tempest-VolumesGetTest-1085601192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:23:58 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-853abf9d-4bad-4d43-a670-47c9384c2777 tempest-VolumesGetTest-1085601192 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:23:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1088974964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4c15885-dcee-43f1-9274-b8ec1be70a4f,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='19a710b72df64f7cb85396f4325746a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:23:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:23:58Z,use_quota=True,user_id='f73a6732646d4a37be9909093d84b9e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:23:58 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-853abf9d-4bad-4d43-a670-47c9384c2777 tempest-VolumesGetTest-1085601192 None] Creating volume e4c15885-dcee-43f1-9274-b8ec1be70a4f {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:23:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-853abf9d-4bad-4d43-a670-47c9384c2777 tempest-VolumesGetTest-1085601192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:23:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-853abf9d-4bad-4d43-a670-47c9384c2777 tempest-VolumesGetTest-1085601192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:23:58 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-853abf9d-4bad-4d43-a670-47c9384c2777 tempest-VolumesGetTest-1085601192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:23:58 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-853abf9d-4bad-4d43-a670-47c9384c2777 tempest-VolumesGetTest-1085601192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:23:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-853abf9d-4bad-4d43-a670-47c9384c2777 tempest-VolumesGetTest-1085601192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:23:58 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-853abf9d-4bad-4d43-a670-47c9384c2777 tempest-VolumesGetTest-1085601192 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:23:58 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-853abf9d-4bad-4d43-a670-47c9384c2777 tempest-VolumesGetTest-1085601192 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:23:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-853abf9d-4bad-4d43-a670-47c9384c2777 tempest-VolumesGetTest-1085601192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-e4c15885-dcee-43f1-9274-b8ec1be70a4f 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:23:58 devstack sudo[94128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-e4c15885-dcee-43f1-9274-b8ec1be70a4f 1073741824 Nov 06 15:23:58 devstack sudo[94128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:23:59 devstack sudo[94128]: pam_unix(sudo:session): session closed for user root Nov 06 15:23:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-853abf9d-4bad-4d43-a670-47c9384c2777 tempest-VolumesGetTest-1085601192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-e4c15885-dcee-43f1-9274-b8ec1be70a4f 1073741824" returned: 0 in 0.796s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:23:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-853abf9d-4bad-4d43-a670-47c9384c2777 tempest-VolumesGetTest-1085601192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-e4c15885-dcee-43f1-9274-b8ec1be70a4f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:23:59 devstack sudo[94134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-e4c15885-dcee-43f1-9274-b8ec1be70a4f Nov 06 15:23:59 devstack sudo[94134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:24:00 devstack sudo[94134]: pam_unix(sudo:session): session closed for user root Nov 06 15:24:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-853abf9d-4bad-4d43-a670-47c9384c2777 tempest-VolumesGetTest-1085601192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-e4c15885-dcee-43f1-9274-b8ec1be70a4f" returned: 0 in 0.875s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:24:00 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-853abf9d-4bad-4d43-a670-47c9384c2777 tempest-VolumesGetTest-1085601192 None] <== create_volume: return (1797ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:24:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-853abf9d-4bad-4d43-a670-47c9384c2777 tempest-VolumesGetTest-1085601192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.809s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:24:00 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-853abf9d-4bad-4d43-a670-47c9384c2777 tempest-VolumesGetTest-1085601192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a291bfd7-bbe1-41df-be9a-bbc5b62ab2f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4c15885-dcee-43f1-9274-b8ec1be70a4f', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:24:00 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-853abf9d-4bad-4d43-a670-47c9384c2777 tempest-VolumesGetTest-1085601192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fb2b892-ab9f-49e8-af70-8a3bcbccffa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:24:00 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-853abf9d-4bad-4d43-a670-47c9384c2777 tempest-VolumesGetTest-1085601192 None] Volume volume-e4c15885-dcee-43f1-9274-b8ec1be70a4f (e4c15885-dcee-43f1-9274-b8ec1be70a4f): created successfully Nov 06 15:24:00 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-853abf9d-4bad-4d43-a670-47c9384c2777 tempest-VolumesGetTest-1085601192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fb2b892-ab9f-49e8-af70-8a3bcbccffa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:24:00 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-853abf9d-4bad-4d43-a670-47c9384c2777 tempest-VolumesGetTest-1085601192 None] Flow 'volume_create_manager' (19036701-aa08-4a57-aa31-66249a459999) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:24:00 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-853abf9d-4bad-4d43-a670-47c9384c2777 tempest-VolumesGetTest-1085601192 None] Created volume successfully. Nov 06 15:24:02 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-ede6c349-1b06-4792-9c4b-653d0dcf415e req-546d201f-9072-447b-b65f-ad88d41f6564 tempest-ServerActionsTestOtherA-1409404420 None] Terminate volume connection completed successfully. Nov 06 15:24:03 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-ede6c349-1b06-4792-9c4b-653d0dcf415e req-546d201f-9072-447b-b65f-ad88d41f6564 tempest-ServerActionsTestOtherA-1409404420 None] Deleting attachment 196e91f2-1482-4b9e-adc8-a6f7b6cc859f. {{(pid=87132) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 06 15:24:03 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-911e0804-dae7-4fc0-92c5-ebeff2504ce7 tempest-VolumesGetTest-1085601192 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:24:03 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-911e0804-dae7-4fc0-92c5-ebeff2504ce7 tempest-VolumesGetTest-1085601192 None] Flow 'volume_create_manager' (7b59ffb8-f8ef-49fc-8075-84503cafa75c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:24:03 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-911e0804-dae7-4fc0-92c5-ebeff2504ce7 tempest-VolumesGetTest-1085601192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75b147ac-706f-44b8-aae0-1628f7e7b9e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:24:03 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-911e0804-dae7-4fc0-92c5-ebeff2504ce7 tempest-VolumesGetTest-1085601192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75b147ac-706f-44b8-aae0-1628f7e7b9e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:24:03Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1725119339',display_name='tempest-VolumesGetTest-Volume-50729761',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc5b8973-84e1-4f3b-a091-0dedb8f869ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19a710b72df64f7cb85396f4325746a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:24:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:24:03Z,use_quota=True,user_id='f73a6732646d4a37be9909093d84b9e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:24:03 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-911e0804-dae7-4fc0-92c5-ebeff2504ce7 tempest-VolumesGetTest-1085601192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f4965a6-c0d2-48b2-9a19-01cb7eb3910d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:24:03 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-911e0804-dae7-4fc0-92c5-ebeff2504ce7 tempest-VolumesGetTest-1085601192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f4965a6-c0d2-48b2-9a19-01cb7eb3910d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:24:03 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-911e0804-dae7-4fc0-92c5-ebeff2504ce7 tempest-VolumesGetTest-1085601192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d3ca833-ac16-4a9e-8e97-b382abaac911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:24:03 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-911e0804-dae7-4fc0-92c5-ebeff2504ce7 tempest-VolumesGetTest-1085601192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d3ca833-ac16-4a9e-8e97-b382abaac911) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc5b8973-84e1-4f3b-a091-0dedb8f869ff', 'volume_name': 'volume-fc5b8973-84e1-4f3b-a091-0dedb8f869ff', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:24:03 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-911e0804-dae7-4fc0-92c5-ebeff2504ce7 tempest-VolumesGetTest-1085601192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82a16fb1-45b6-43ee-961a-1ec327d45d42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:24:03 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-911e0804-dae7-4fc0-92c5-ebeff2504ce7 tempest-VolumesGetTest-1085601192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82a16fb1-45b6-43ee-961a-1ec327d45d42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:24:03 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-911e0804-dae7-4fc0-92c5-ebeff2504ce7 tempest-VolumesGetTest-1085601192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (507cbde8-113e-4774-b517-4a1fde43c6a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:24:03 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-911e0804-dae7-4fc0-92c5-ebeff2504ce7 tempest-VolumesGetTest-1085601192 None] Volume fc5b8973-84e1-4f3b-a091-0dedb8f869ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc5b8973-84e1-4f3b-a091-0dedb8f869ff', 'volume_size': 1} Nov 06 15:24:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-911e0804-dae7-4fc0-92c5-ebeff2504ce7 tempest-VolumesGetTest-1085601192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:24:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-911e0804-dae7-4fc0-92c5-ebeff2504ce7 tempest-VolumesGetTest-1085601192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:24:03 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-911e0804-dae7-4fc0-92c5-ebeff2504ce7 tempest-VolumesGetTest-1085601192 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:24:03Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1725119339',display_name='tempest-VolumesGetTest-Volume-50729761',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc5b8973-84e1-4f3b-a091-0dedb8f869ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19a710b72df64f7cb85396f4325746a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:24:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:24:03Z,use_quota=True,user_id='f73a6732646d4a37be9909093d84b9e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:24:03 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-911e0804-dae7-4fc0-92c5-ebeff2504ce7 tempest-VolumesGetTest-1085601192 None] Creating volume fc5b8973-84e1-4f3b-a091-0dedb8f869ff {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:24:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-911e0804-dae7-4fc0-92c5-ebeff2504ce7 tempest-VolumesGetTest-1085601192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:24:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-911e0804-dae7-4fc0-92c5-ebeff2504ce7 tempest-VolumesGetTest-1085601192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:24:03 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-911e0804-dae7-4fc0-92c5-ebeff2504ce7 tempest-VolumesGetTest-1085601192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:24:03 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-911e0804-dae7-4fc0-92c5-ebeff2504ce7 tempest-VolumesGetTest-1085601192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:24:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-911e0804-dae7-4fc0-92c5-ebeff2504ce7 tempest-VolumesGetTest-1085601192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:24:03 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-911e0804-dae7-4fc0-92c5-ebeff2504ce7 tempest-VolumesGetTest-1085601192 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:24:03 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-911e0804-dae7-4fc0-92c5-ebeff2504ce7 tempest-VolumesGetTest-1085601192 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:24:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-911e0804-dae7-4fc0-92c5-ebeff2504ce7 tempest-VolumesGetTest-1085601192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-fc5b8973-84e1-4f3b-a091-0dedb8f869ff 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:24:03 devstack sudo[94175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-fc5b8973-84e1-4f3b-a091-0dedb8f869ff 1073741824 Nov 06 15:24:03 devstack sudo[94175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:24:04 devstack sudo[94175]: pam_unix(sudo:session): session closed for user root Nov 06 15:24:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-911e0804-dae7-4fc0-92c5-ebeff2504ce7 tempest-VolumesGetTest-1085601192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-fc5b8973-84e1-4f3b-a091-0dedb8f869ff 1073741824" returned: 0 in 0.523s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:24:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-911e0804-dae7-4fc0-92c5-ebeff2504ce7 tempest-VolumesGetTest-1085601192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-fc5b8973-84e1-4f3b-a091-0dedb8f869ff {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:24:04 devstack sudo[94181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-fc5b8973-84e1-4f3b-a091-0dedb8f869ff Nov 06 15:24:04 devstack sudo[94181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:24:04 devstack sudo[94181]: pam_unix(sudo:session): session closed for user root Nov 06 15:24:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-911e0804-dae7-4fc0-92c5-ebeff2504ce7 tempest-VolumesGetTest-1085601192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-fc5b8973-84e1-4f3b-a091-0dedb8f869ff" returned: 0 in 0.267s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:24:04 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-911e0804-dae7-4fc0-92c5-ebeff2504ce7 tempest-VolumesGetTest-1085601192 None] <== create_volume: return (847ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:24:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-911e0804-dae7-4fc0-92c5-ebeff2504ce7 tempest-VolumesGetTest-1085601192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.852s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:24:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-911e0804-dae7-4fc0-92c5-ebeff2504ce7 tempest-VolumesGetTest-1085601192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (507cbde8-113e-4774-b517-4a1fde43c6a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc5b8973-84e1-4f3b-a091-0dedb8f869ff', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:24:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-911e0804-dae7-4fc0-92c5-ebeff2504ce7 tempest-VolumesGetTest-1085601192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (905effb7-360a-47da-91d7-59d4fd0da88b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:24:04 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-911e0804-dae7-4fc0-92c5-ebeff2504ce7 tempest-VolumesGetTest-1085601192 None] Volume volume-fc5b8973-84e1-4f3b-a091-0dedb8f869ff (fc5b8973-84e1-4f3b-a091-0dedb8f869ff): created successfully Nov 06 15:24:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-911e0804-dae7-4fc0-92c5-ebeff2504ce7 tempest-VolumesGetTest-1085601192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (905effb7-360a-47da-91d7-59d4fd0da88b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:24:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-911e0804-dae7-4fc0-92c5-ebeff2504ce7 tempest-VolumesGetTest-1085601192 None] Flow 'volume_create_manager' (7b59ffb8-f8ef-49fc-8075-84503cafa75c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:24:04 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-911e0804-dae7-4fc0-92c5-ebeff2504ce7 tempest-VolumesGetTest-1085601192 None] Created volume successfully. Nov 06 15:24:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-ede6c349-1b06-4792-9c4b-653d0dcf415e req-865bd6ec-ae88-4cca-8343-6e64dcd4c94d tempest-ServerActionsTestOtherA-1409404420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:24:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-ede6c349-1b06-4792-9c4b-653d0dcf415e req-865bd6ec-ae88-4cca-8343-6e64dcd4c94d tempest-ServerActionsTestOtherA-1409404420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:24:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-ede6c349-1b06-4792-9c4b-653d0dcf415e req-865bd6ec-ae88-4cca-8343-6e64dcd4c94d tempest-ServerActionsTestOtherA-1409404420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:24:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-ede6c349-1b06-4792-9c4b-653d0dcf415e req-865bd6ec-ae88-4cca-8343-6e64dcd4c94d tempest-ServerActionsTestOtherA-1409404420 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b', 'name': 'volume-9a321d18-d577-47b6-b042-a4bf84eb92a7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7a536239-5947-4011-b45b-48b82bd0b3a4', 'enforce_multipath': True} {{(pid=87132) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 15:24:05 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-ede6c349-1b06-4792-9c4b-653d0dcf415e req-865bd6ec-ae88-4cca-8343-6e64dcd4c94d tempest-ServerActionsTestOtherA-1409404420 None] attachment_update completed successfully. Nov 06 15:24:05 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-74d369ad-47e8-4081-8555-bd32d89e838f tempest-VolumesGetTest-1085601192 None] Acquiring lock "cinder-fc5b8973-84e1-4f3b-a091-0dedb8f869ff-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:24:05 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-74d369ad-47e8-4081-8555-bd32d89e838f tempest-VolumesGetTest-1085601192 None] Lock "cinder-fc5b8973-84e1-4f3b-a091-0dedb8f869ff-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:24:05 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-74d369ad-47e8-4081-8555-bd32d89e838f tempest-VolumesGetTest-1085601192 None] Acquiring lock "cinder-quobyte-fc5b8973-84e1-4f3b-a091-0dedb8f869ff" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:24:05 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-74d369ad-47e8-4081-8555-bd32d89e838f tempest-VolumesGetTest-1085601192 None] Lock "cinder-quobyte-fc5b8973-84e1-4f3b-a091-0dedb8f869ff" acquired by "delete_volume" :: waited 0.027s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:24:06 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b3a9115-541e-4dc6-84d1-8173ee10d66f]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:24:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-74d369ad-47e8-4081-8555-bd32d89e838f tempest-VolumesGetTest-1085601192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-fc5b8973-84e1-4f3b-a091-0dedb8f869ff {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:24:06 devstack sudo[94225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-fc5b8973-84e1-4f3b-a091-0dedb8f869ff Nov 06 15:24:06 devstack sudo[94225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:24:06 devstack sudo[94225]: pam_unix(sudo:session): session closed for user root Nov 06 15:24:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-74d369ad-47e8-4081-8555-bd32d89e838f tempest-VolumesGetTest-1085601192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-fc5b8973-84e1-4f3b-a091-0dedb8f869ff" returned: 0 in 0.525s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:24:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-74d369ad-47e8-4081-8555-bd32d89e838f tempest-VolumesGetTest-1085601192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-fc5b8973-84e1-4f3b-a091-0dedb8f869ff {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:24:06 devstack sudo[94240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-fc5b8973-84e1-4f3b-a091-0dedb8f869ff Nov 06 15:24:06 devstack sudo[94240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:24:06 devstack sudo[94240]: pam_unix(sudo:session): session closed for user root Nov 06 15:24:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-74d369ad-47e8-4081-8555-bd32d89e838f tempest-VolumesGetTest-1085601192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-fc5b8973-84e1-4f3b-a091-0dedb8f869ff" returned: 0 in 0.298s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:24:06 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-74d369ad-47e8-4081-8555-bd32d89e838f tempest-VolumesGetTest-1085601192 None] Lock "cinder-quobyte-fc5b8973-84e1-4f3b-a091-0dedb8f869ff" released by "delete_volume" :: held 0.904s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:24:06 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-74d369ad-47e8-4081-8555-bd32d89e838f tempest-VolumesGetTest-1085601192 None] Created reservations ['9377741d-6a01-4449-b90d-1c7e707b020b', '6d3c8a2e-ebba-4928-84df-fa509f342c2f', 'bce2f6d8-a921-482f-8b8b-1cef54deaea1', 'a30879cf-1008-471c-96a9-280baff9464d'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:24:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-74d369ad-47e8-4081-8555-bd32d89e838f tempest-VolumesGetTest-1085601192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:24:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-74d369ad-47e8-4081-8555-bd32d89e838f tempest-VolumesGetTest-1085601192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:24:07 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-74d369ad-47e8-4081-8555-bd32d89e838f tempest-VolumesGetTest-1085601192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:24:07 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-74d369ad-47e8-4081-8555-bd32d89e838f tempest-VolumesGetTest-1085601192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:24:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-74d369ad-47e8-4081-8555-bd32d89e838f tempest-VolumesGetTest-1085601192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:24:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-74d369ad-47e8-4081-8555-bd32d89e838f tempest-VolumesGetTest-1085601192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:24:07 devstack sudo[94243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:24:07 devstack sudo[94243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:24:07 devstack sudo[94243]: pam_unix(sudo:session): session closed for user root Nov 06 15:24:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-74d369ad-47e8-4081-8555-bd32d89e838f tempest-VolumesGetTest-1085601192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.405s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:24:07 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-74d369ad-47e8-4081-8555-bd32d89e838f tempest-VolumesGetTest-1085601192 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:24:07 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-74d369ad-47e8-4081-8555-bd32d89e838f tempest-VolumesGetTest-1085601192 None] Deleted volume successfully. Nov 06 15:24:07 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-74d369ad-47e8-4081-8555-bd32d89e838f tempest-VolumesGetTest-1085601192 None] Lock "cinder-fc5b8973-84e1-4f3b-a091-0dedb8f869ff-delete_volume" released by "delete_volume" :: held 1.627s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:24:08 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 15:24:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:24:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:24:08 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:24:08 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:24:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:24:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:24:08 devstack sudo[94248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:24:08 devstack sudo[94248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:24:08 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b46d1445-bf22-41f1-a4f9-9176fe79cf15 tempest-VolumesGetTest-1085601192 None] Acquiring lock "cinder-e4c15885-dcee-43f1-9274-b8ec1be70a4f-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:24:08 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b46d1445-bf22-41f1-a4f9-9176fe79cf15 tempest-VolumesGetTest-1085601192 None] Lock "cinder-e4c15885-dcee-43f1-9274-b8ec1be70a4f-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:24:08 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b46d1445-bf22-41f1-a4f9-9176fe79cf15 tempest-VolumesGetTest-1085601192 None] Acquiring lock "cinder-quobyte-e4c15885-dcee-43f1-9274-b8ec1be70a4f" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:24:08 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b46d1445-bf22-41f1-a4f9-9176fe79cf15 tempest-VolumesGetTest-1085601192 None] Lock "cinder-quobyte-e4c15885-dcee-43f1-9274-b8ec1be70a4f" acquired by "delete_volume" :: waited 0.040s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:24:08 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[391a7b1d-99bd-4fe5-9125-7119bae0b4cf]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:24:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b46d1445-bf22-41f1-a4f9-9176fe79cf15 tempest-VolumesGetTest-1085601192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-e4c15885-dcee-43f1-9274-b8ec1be70a4f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:24:08 devstack sudo[94248]: pam_unix(sudo:session): session closed for user root Nov 06 15:24:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.618s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:24:08 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:24:08 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Running periodic task VolumeManager._thread_info {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 15:24:08 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] thread count: 28 {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 15:24:08 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] thread info: [<_MainThread(MainThread, started 140011251929216)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 06 15:24:08 devstack sudo[94252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-e4c15885-dcee-43f1-9274-b8ec1be70a4f Nov 06 15:24:08 devstack sudo[94252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:24:09 devstack sudo[94252]: pam_unix(sudo:session): session closed for user root Nov 06 15:24:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b46d1445-bf22-41f1-a4f9-9176fe79cf15 tempest-VolumesGetTest-1085601192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-e4c15885-dcee-43f1-9274-b8ec1be70a4f" returned: 0 in 0.491s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:24:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b46d1445-bf22-41f1-a4f9-9176fe79cf15 tempest-VolumesGetTest-1085601192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-e4c15885-dcee-43f1-9274-b8ec1be70a4f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:24:09 devstack sudo[94258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-e4c15885-dcee-43f1-9274-b8ec1be70a4f Nov 06 15:24:09 devstack sudo[94258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:24:09 devstack sudo[94258]: pam_unix(sudo:session): session closed for user root Nov 06 15:24:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b46d1445-bf22-41f1-a4f9-9176fe79cf15 tempest-VolumesGetTest-1085601192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-e4c15885-dcee-43f1-9274-b8ec1be70a4f" returned: 0 in 0.320s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:24:09 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b46d1445-bf22-41f1-a4f9-9176fe79cf15 tempest-VolumesGetTest-1085601192 None] Lock "cinder-quobyte-e4c15885-dcee-43f1-9274-b8ec1be70a4f" released by "delete_volume" :: held 0.899s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:24:09 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-b46d1445-bf22-41f1-a4f9-9176fe79cf15 tempest-VolumesGetTest-1085601192 None] Created reservations ['99b0a6a3-7092-4a00-b087-f75306d14d35', '98f984ec-f532-4062-8bc9-d583cd120dc1', '270f073b-88e8-4c93-a347-d50b236bd105', '47edde6e-cf09-4f48-ab21-ae84c8b0028b'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:24:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b46d1445-bf22-41f1-a4f9-9176fe79cf15 tempest-VolumesGetTest-1085601192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:24:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b46d1445-bf22-41f1-a4f9-9176fe79cf15 tempest-VolumesGetTest-1085601192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:24:09 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-b46d1445-bf22-41f1-a4f9-9176fe79cf15 tempest-VolumesGetTest-1085601192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:24:09 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-b46d1445-bf22-41f1-a4f9-9176fe79cf15 tempest-VolumesGetTest-1085601192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:24:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b46d1445-bf22-41f1-a4f9-9176fe79cf15 tempest-VolumesGetTest-1085601192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:24:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b46d1445-bf22-41f1-a4f9-9176fe79cf15 tempest-VolumesGetTest-1085601192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:24:09 devstack sudo[94261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:24:09 devstack sudo[94261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:24:10 devstack sudo[94261]: pam_unix(sudo:session): session closed for user root Nov 06 15:24:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b46d1445-bf22-41f1-a4f9-9176fe79cf15 tempest-VolumesGetTest-1085601192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.651s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:24:10 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-b46d1445-bf22-41f1-a4f9-9176fe79cf15 tempest-VolumesGetTest-1085601192 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:24:10 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-b46d1445-bf22-41f1-a4f9-9176fe79cf15 tempest-VolumesGetTest-1085601192 None] Deleted volume successfully. Nov 06 15:24:10 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b46d1445-bf22-41f1-a4f9-9176fe79cf15 tempest-VolumesGetTest-1085601192 None] Lock "cinder-e4c15885-dcee-43f1-9274-b8ec1be70a4f-delete_volume" released by "delete_volume" :: held 1.947s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:24:10 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e9d489d-47d8-498e-9c34-c6714c7258d9 tempest-VolumesGetTest-1085601192 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:24:10 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3e9d489d-47d8-498e-9c34-c6714c7258d9 tempest-VolumesGetTest-1085601192 None] Flow 'volume_create_manager' (d266c694-3a35-466f-a3c6-4f892b7af220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:24:10 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3e9d489d-47d8-498e-9c34-c6714c7258d9 tempest-VolumesGetTest-1085601192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc15af5a-f91b-4be5-b5cc-88e148df88e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:24:10 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3e9d489d-47d8-498e-9c34-c6714c7258d9 tempest-VolumesGetTest-1085601192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc15af5a-f91b-4be5-b5cc-88e148df88e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:24:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-231949536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7101f26-6d12-4868-a0b3-42f7d2be25a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19a710b72df64f7cb85396f4325746a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:24:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:24:11Z,use_quota=True,user_id='f73a6732646d4a37be9909093d84b9e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:24:10 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3e9d489d-47d8-498e-9c34-c6714c7258d9 tempest-VolumesGetTest-1085601192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f262d66-c6ca-4a77-bd28-08d2aa090078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:24:10 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3e9d489d-47d8-498e-9c34-c6714c7258d9 tempest-VolumesGetTest-1085601192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f262d66-c6ca-4a77-bd28-08d2aa090078) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:24:10 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3e9d489d-47d8-498e-9c34-c6714c7258d9 tempest-VolumesGetTest-1085601192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5e13477-80a6-4c92-bb9d-4a8428e2757a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:24:10 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3e9d489d-47d8-498e-9c34-c6714c7258d9 tempest-VolumesGetTest-1085601192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5e13477-80a6-4c92-bb9d-4a8428e2757a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7101f26-6d12-4868-a0b3-42f7d2be25a4', 'volume_name': 'volume-a7101f26-6d12-4868-a0b3-42f7d2be25a4', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:24:10 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3e9d489d-47d8-498e-9c34-c6714c7258d9 tempest-VolumesGetTest-1085601192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (945be009-7b13-4f4d-a49b-ba9ef689ef37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:24:10 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3e9d489d-47d8-498e-9c34-c6714c7258d9 tempest-VolumesGetTest-1085601192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (945be009-7b13-4f4d-a49b-ba9ef689ef37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:24:10 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3e9d489d-47d8-498e-9c34-c6714c7258d9 tempest-VolumesGetTest-1085601192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (008ed899-6bb0-4963-9747-6c805abca4ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:24:10 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-3e9d489d-47d8-498e-9c34-c6714c7258d9 tempest-VolumesGetTest-1085601192 None] Volume a7101f26-6d12-4868-a0b3-42f7d2be25a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7101f26-6d12-4868-a0b3-42f7d2be25a4', 'volume_size': 1} Nov 06 15:24:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3e9d489d-47d8-498e-9c34-c6714c7258d9 tempest-VolumesGetTest-1085601192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:24:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3e9d489d-47d8-498e-9c34-c6714c7258d9 tempest-VolumesGetTest-1085601192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:24:10 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3e9d489d-47d8-498e-9c34-c6714c7258d9 tempest-VolumesGetTest-1085601192 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:24:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-231949536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7101f26-6d12-4868-a0b3-42f7d2be25a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19a710b72df64f7cb85396f4325746a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:24:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:24:11Z,use_quota=True,user_id='f73a6732646d4a37be9909093d84b9e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:24:10 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-3e9d489d-47d8-498e-9c34-c6714c7258d9 tempest-VolumesGetTest-1085601192 None] Creating volume a7101f26-6d12-4868-a0b3-42f7d2be25a4 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:24:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3e9d489d-47d8-498e-9c34-c6714c7258d9 tempest-VolumesGetTest-1085601192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:24:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3e9d489d-47d8-498e-9c34-c6714c7258d9 tempest-VolumesGetTest-1085601192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:24:10 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3e9d489d-47d8-498e-9c34-c6714c7258d9 tempest-VolumesGetTest-1085601192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:24:10 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3e9d489d-47d8-498e-9c34-c6714c7258d9 tempest-VolumesGetTest-1085601192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:24:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3e9d489d-47d8-498e-9c34-c6714c7258d9 tempest-VolumesGetTest-1085601192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:24:10 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3e9d489d-47d8-498e-9c34-c6714c7258d9 tempest-VolumesGetTest-1085601192 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:24:10 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-3e9d489d-47d8-498e-9c34-c6714c7258d9 tempest-VolumesGetTest-1085601192 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:24:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3e9d489d-47d8-498e-9c34-c6714c7258d9 tempest-VolumesGetTest-1085601192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a7101f26-6d12-4868-a0b3-42f7d2be25a4 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:24:10 devstack sudo[94264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a7101f26-6d12-4868-a0b3-42f7d2be25a4 1073741824 Nov 06 15:24:10 devstack sudo[94264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:24:11 devstack sudo[94264]: pam_unix(sudo:session): session closed for user root Nov 06 15:24:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3e9d489d-47d8-498e-9c34-c6714c7258d9 tempest-VolumesGetTest-1085601192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a7101f26-6d12-4868-a0b3-42f7d2be25a4 1073741824" returned: 0 in 0.679s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:24:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3e9d489d-47d8-498e-9c34-c6714c7258d9 tempest-VolumesGetTest-1085601192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a7101f26-6d12-4868-a0b3-42f7d2be25a4 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:24:11 devstack sudo[94270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a7101f26-6d12-4868-a0b3-42f7d2be25a4 Nov 06 15:24:11 devstack sudo[94270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:24:12 devstack sudo[94270]: pam_unix(sudo:session): session closed for user root Nov 06 15:24:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3e9d489d-47d8-498e-9c34-c6714c7258d9 tempest-VolumesGetTest-1085601192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a7101f26-6d12-4868-a0b3-42f7d2be25a4" returned: 0 in 0.578s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:24:12 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3e9d489d-47d8-498e-9c34-c6714c7258d9 tempest-VolumesGetTest-1085601192 None] <== create_volume: return (1348ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:24:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3e9d489d-47d8-498e-9c34-c6714c7258d9 tempest-VolumesGetTest-1085601192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.355s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:24:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3e9d489d-47d8-498e-9c34-c6714c7258d9 tempest-VolumesGetTest-1085601192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (008ed899-6bb0-4963-9747-6c805abca4ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7101f26-6d12-4868-a0b3-42f7d2be25a4', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:24:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3e9d489d-47d8-498e-9c34-c6714c7258d9 tempest-VolumesGetTest-1085601192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (913389f8-c6e1-4602-876a-e24bfe915063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:24:12 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-3e9d489d-47d8-498e-9c34-c6714c7258d9 tempest-VolumesGetTest-1085601192 None] Volume volume-a7101f26-6d12-4868-a0b3-42f7d2be25a4 (a7101f26-6d12-4868-a0b3-42f7d2be25a4): created successfully Nov 06 15:24:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3e9d489d-47d8-498e-9c34-c6714c7258d9 tempest-VolumesGetTest-1085601192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (913389f8-c6e1-4602-876a-e24bfe915063) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:24:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3e9d489d-47d8-498e-9c34-c6714c7258d9 tempest-VolumesGetTest-1085601192 None] Flow 'volume_create_manager' (d266c694-3a35-466f-a3c6-4f892b7af220) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:24:12 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-3e9d489d-47d8-498e-9c34-c6714c7258d9 tempest-VolumesGetTest-1085601192 None] Created volume successfully. Nov 06 15:24:13 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ec068ca-e46d-4ad9-88aa-1fa323890e7e tempest-VolumesGetTest-1085601192 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:24:13 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5ec068ca-e46d-4ad9-88aa-1fa323890e7e tempest-VolumesGetTest-1085601192 None] Flow 'volume_create_manager' (9f797340-f217-44ae-b94a-0492b8f0fe05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:24:13 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5ec068ca-e46d-4ad9-88aa-1fa323890e7e tempest-VolumesGetTest-1085601192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ebb3923-10b9-4f57-8d5a-ca28b9a23de1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:24:13 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5ec068ca-e46d-4ad9-88aa-1fa323890e7e tempest-VolumesGetTest-1085601192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ebb3923-10b9-4f57-8d5a-ca28b9a23de1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:24:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1350293799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c72e66b7-e5e4-471f-9327-01bed6214519,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='19a710b72df64f7cb85396f4325746a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:24:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=a7101f26-6d12-4868-a0b3-42f7d2be25a4,status='creating',terminated_at=None,updated_at=2026-11-06T14:24:13Z,use_quota=True,user_id='f73a6732646d4a37be9909093d84b9e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:24:13 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5ec068ca-e46d-4ad9-88aa-1fa323890e7e tempest-VolumesGetTest-1085601192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de0c5f64-d605-4799-aade-a980e993e6f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:24:13 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5ec068ca-e46d-4ad9-88aa-1fa323890e7e tempest-VolumesGetTest-1085601192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de0c5f64-d605-4799-aade-a980e993e6f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:24:13 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5ec068ca-e46d-4ad9-88aa-1fa323890e7e tempest-VolumesGetTest-1085601192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69c459db-a679-4bce-b275-b0fc1defbde2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:24:13 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5ec068ca-e46d-4ad9-88aa-1fa323890e7e tempest-VolumesGetTest-1085601192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69c459db-a679-4bce-b275-b0fc1defbde2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'c72e66b7-e5e4-471f-9327-01bed6214519', 'volume_name': 'volume-c72e66b7-e5e4-471f-9327-01bed6214519', 'volume_size': 1, 'source_volid': 'a7101f26-6d12-4868-a0b3-42f7d2be25a4', 'source_volstatus': 'available'}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:24:13 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5ec068ca-e46d-4ad9-88aa-1fa323890e7e tempest-VolumesGetTest-1085601192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0faf8969-1e7c-404a-a450-5209d39d5780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:24:13 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5ec068ca-e46d-4ad9-88aa-1fa323890e7e tempest-VolumesGetTest-1085601192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0faf8969-1e7c-404a-a450-5209d39d5780) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:24:13 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5ec068ca-e46d-4ad9-88aa-1fa323890e7e tempest-VolumesGetTest-1085601192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25d80083-a43c-444f-924f-3035d839b26a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:24:13 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-5ec068ca-e46d-4ad9-88aa-1fa323890e7e tempest-VolumesGetTest-1085601192 None] Volume c72e66b7-e5e4-471f-9327-01bed6214519: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-c72e66b7-e5e4-471f-9327-01bed6214519', 'volume_size': 1, 'source_volid': 'a7101f26-6d12-4868-a0b3-42f7d2be25a4', 'source_volstatus': 'available'} Nov 06 15:24:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5ec068ca-e46d-4ad9-88aa-1fa323890e7e tempest-VolumesGetTest-1085601192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:24:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5ec068ca-e46d-4ad9-88aa-1fa323890e7e tempest-VolumesGetTest-1085601192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:24:13 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-5ec068ca-e46d-4ad9-88aa-1fa323890e7e tempest-VolumesGetTest-1085601192 None] Cloning volume a7101f26-6d12-4868-a0b3-42f7d2be25a4 to volume c72e66b7-e5e4-471f-9327-01bed6214519 Nov 06 15:24:13 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-5ec068ca-e46d-4ad9-88aa-1fa323890e7e tempest-VolumesGetTest-1085601192 None] Creating offline snapshot aae065e8-4a4e-4042-8750-08c79eca7a08 of volume a7101f26-6d12-4868-a0b3-42f7d2be25a4 {{(pid=87132) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 15:24:13 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[63989a2f-9330-4806-a02a-b1361f9fdf59]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:24:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5ec068ca-e46d-4ad9-88aa-1fa323890e7e tempest-VolumesGetTest-1085601192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a7101f26-6d12-4868-a0b3-42f7d2be25a4 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:24:13 devstack sudo[94274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a7101f26-6d12-4868-a0b3-42f7d2be25a4 Nov 06 15:24:13 devstack sudo[94274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:24:14 devstack sudo[94274]: pam_unix(sudo:session): session closed for user root Nov 06 15:24:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5ec068ca-e46d-4ad9-88aa-1fa323890e7e tempest-VolumesGetTest-1085601192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a7101f26-6d12-4868-a0b3-42f7d2be25a4" returned: 0 in 0.469s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:24:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5ec068ca-e46d-4ad9-88aa-1fa323890e7e tempest-VolumesGetTest-1085601192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a7101f26-6d12-4868-a0b3-42f7d2be25a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a7101f26-6d12-4868-a0b3-42f7d2be25a4.aae065e8-4a4e-4042-8750-08c79eca7a08 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:24:14 devstack sudo[94280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a7101f26-6d12-4868-a0b3-42f7d2be25a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a7101f26-6d12-4868-a0b3-42f7d2be25a4.aae065e8-4a4e-4042-8750-08c79eca7a08 1G Nov 06 15:24:14 devstack sudo[94280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:24:14 devstack sudo[94280]: pam_unix(sudo:session): session closed for user root Nov 06 15:24:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5ec068ca-e46d-4ad9-88aa-1fa323890e7e tempest-VolumesGetTest-1085601192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a7101f26-6d12-4868-a0b3-42f7d2be25a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a7101f26-6d12-4868-a0b3-42f7d2be25a4.aae065e8-4a4e-4042-8750-08c79eca7a08 1G" returned: 0 in 0.504s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:24:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5ec068ca-e46d-4ad9-88aa-1fa323890e7e tempest-VolumesGetTest-1085601192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7101f26-6d12-4868-a0b3-42f7d2be25a4 -F qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a7101f26-6d12-4868-a0b3-42f7d2be25a4.aae065e8-4a4e-4042-8750-08c79eca7a08 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:24:14 devstack sudo[94290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7101f26-6d12-4868-a0b3-42f7d2be25a4 -F qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a7101f26-6d12-4868-a0b3-42f7d2be25a4.aae065e8-4a4e-4042-8750-08c79eca7a08 Nov 06 15:24:14 devstack sudo[94290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:24:15 devstack sudo[94290]: pam_unix(sudo:session): session closed for user root Nov 06 15:24:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5ec068ca-e46d-4ad9-88aa-1fa323890e7e tempest-VolumesGetTest-1085601192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7101f26-6d12-4868-a0b3-42f7d2be25a4 -F qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a7101f26-6d12-4868-a0b3-42f7d2be25a4.aae065e8-4a4e-4042-8750-08c79eca7a08" returned: 0 in 0.369s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:24:15 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-5ec068ca-e46d-4ad9-88aa-1fa323890e7e tempest-VolumesGetTest-1085601192 None] /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a7101f26-6d12-4868-a0b3-42f7d2be25a4.aae065e8-4a4e-4042-8750-08c79eca7a08 is being set with open permissions: ugo+rw Nov 06 15:24:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5ec068ca-e46d-4ad9-88aa-1fa323890e7e tempest-VolumesGetTest-1085601192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a7101f26-6d12-4868-a0b3-42f7d2be25a4.aae065e8-4a4e-4042-8750-08c79eca7a08 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:24:15 devstack sudo[94300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a7101f26-6d12-4868-a0b3-42f7d2be25a4.aae065e8-4a4e-4042-8750-08c79eca7a08 Nov 06 15:24:15 devstack sudo[94300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:24:15 devstack sudo[94300]: pam_unix(sudo:session): session closed for user root Nov 06 15:24:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5ec068ca-e46d-4ad9-88aa-1fa323890e7e tempest-VolumesGetTest-1085601192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a7101f26-6d12-4868-a0b3-42f7d2be25a4.aae065e8-4a4e-4042-8750-08c79eca7a08" returned: 0 in 0.361s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:24:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5ec068ca-e46d-4ad9-88aa-1fa323890e7e tempest-VolumesGetTest-1085601192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a7101f26-6d12-4868-a0b3-42f7d2be25a4.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:24:15 devstack sudo[94305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a7101f26-6d12-4868-a0b3-42f7d2be25a4.info Nov 06 15:24:15 devstack sudo[94305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:24:15 devstack sudo[94305]: pam_unix(sudo:session): session closed for user root Nov 06 15:24:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5ec068ca-e46d-4ad9-88aa-1fa323890e7e tempest-VolumesGetTest-1085601192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a7101f26-6d12-4868-a0b3-42f7d2be25a4.info" returned: 0 in 0.349s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:24:15 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-5ec068ca-e46d-4ad9-88aa-1fa323890e7e tempest-VolumesGetTest-1085601192 None] /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a7101f26-6d12-4868-a0b3-42f7d2be25a4.info is being set with open permissions: ugo+rw Nov 06 15:24:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5ec068ca-e46d-4ad9-88aa-1fa323890e7e tempest-VolumesGetTest-1085601192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a7101f26-6d12-4868-a0b3-42f7d2be25a4.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:24:15 devstack sudo[94312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a7101f26-6d12-4868-a0b3-42f7d2be25a4.info Nov 06 15:24:15 devstack sudo[94312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:24:16 devstack sudo[94312]: pam_unix(sudo:session): session closed for user root Nov 06 15:24:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5ec068ca-e46d-4ad9-88aa-1fa323890e7e tempest-VolumesGetTest-1085601192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a7101f26-6d12-4868-a0b3-42f7d2be25a4.info" returned: 0 in 0.277s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:24:16 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-5ec068ca-e46d-4ad9-88aa-1fa323890e7e tempest-VolumesGetTest-1085601192 None] Acquiring lock "cinder-quobyte-c72e66b7-e5e4-471f-9327-01bed6214519" by "_copy_volume_from_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:24:16 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-5ec068ca-e46d-4ad9-88aa-1fa323890e7e tempest-VolumesGetTest-1085601192 None] Lock "cinder-quobyte-c72e66b7-e5e4-471f-9327-01bed6214519" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:24:16 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-5ec068ca-e46d-4ad9-88aa-1fa323890e7e tempest-VolumesGetTest-1085601192 None] snapshot: aae065e8-4a4e-4042-8750-08c79eca7a08, volume: c72e66b7-e5e4-471f-9327-01bed6214519, {{(pid=87132) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 06 15:24:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5ec068ca-e46d-4ad9-88aa-1fa323890e7e tempest-VolumesGetTest-1085601192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:24:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5ec068ca-e46d-4ad9-88aa-1fa323890e7e tempest-VolumesGetTest-1085601192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:24:16 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-5ec068ca-e46d-4ad9-88aa-1fa323890e7e tempest-VolumesGetTest-1085601192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:24:16 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-5ec068ca-e46d-4ad9-88aa-1fa323890e7e tempest-VolumesGetTest-1085601192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:24:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5ec068ca-e46d-4ad9-88aa-1fa323890e7e tempest-VolumesGetTest-1085601192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:24:16 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[de06bbce-1029-4935-9b9c-59ec50530cde]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:24:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5ec068ca-e46d-4ad9-88aa-1fa323890e7e tempest-VolumesGetTest-1085601192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a7101f26-6d12-4868-a0b3-42f7d2be25a4.aae065e8-4a4e-4042-8750-08c79eca7a08 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:24:16 devstack sudo[94316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a7101f26-6d12-4868-a0b3-42f7d2be25a4.aae065e8-4a4e-4042-8750-08c79eca7a08 Nov 06 15:24:16 devstack sudo[94316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:24:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-845ac114-6f13-4a3a-a44f-7ff810ca532d req-8d2ca334-5269-4b49-956e-b56210fdc953 tempest-TestInstancesWithCinderVolumes-1896526329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:24:16 devstack sudo[94316]: pam_unix(sudo:session): session closed for user root Nov 06 15:24:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5ec068ca-e46d-4ad9-88aa-1fa323890e7e tempest-VolumesGetTest-1085601192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a7101f26-6d12-4868-a0b3-42f7d2be25a4.aae065e8-4a4e-4042-8750-08c79eca7a08" returned: 0 in 0.501s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:24:16 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-5ec068ca-e46d-4ad9-88aa-1fa323890e7e tempest-VolumesGetTest-1085601192 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7101f26-6d12-4868-a0b3-42f7d2be25a4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 15:24:16 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce678d94-9e4c-4892-b5bc-1d53237ee032]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:24:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5ec068ca-e46d-4ad9-88aa-1fa323890e7e tempest-VolumesGetTest-1085601192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a7101f26-6d12-4868-a0b3-42f7d2be25a4 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:24:16 devstack sudo[94329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a7101f26-6d12-4868-a0b3-42f7d2be25a4 Nov 06 15:24:16 devstack sudo[94329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:24:17 devstack sudo[94329]: pam_unix(sudo:session): session closed for user root Nov 06 15:24:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5ec068ca-e46d-4ad9-88aa-1fa323890e7e tempest-VolumesGetTest-1085601192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a7101f26-6d12-4868-a0b3-42f7d2be25a4" returned: 0 in 0.400s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:24:17 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-5ec068ca-e46d-4ad9-88aa-1fa323890e7e tempest-VolumesGetTest-1085601192 None] will copy from snapshot at /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a7101f26-6d12-4868-a0b3-42f7d2be25a4 {{(pid=87132) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 06 15:24:17 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-5ec068ca-e46d-4ad9-88aa-1fa323890e7e tempest-VolumesGetTest-1085601192 None] Creating direct copy from snapshot {{(pid=87132) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 06 15:24:17 devstack cinder-volume[87132]: DEBUG cinder.utils [None req-5ec068ca-e46d-4ad9-88aa-1fa323890e7e tempest-VolumesGetTest-1085601192 None] Path /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-c72e66b7-e5e4-471f-9327-01bed6214519 not found in is_blk_device check {{(pid=87132) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 06 15:24:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5ec068ca-e46d-4ad9-88aa-1fa323890e7e tempest-VolumesGetTest-1085601192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a7101f26-6d12-4868-a0b3-42f7d2be25a4 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-c72e66b7-e5e4-471f-9327-01bed6214519 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:24:17 devstack sudo[94335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a7101f26-6d12-4868-a0b3-42f7d2be25a4 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-c72e66b7-e5e4-471f-9327-01bed6214519 Nov 06 15:24:17 devstack sudo[94335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:24:26 devstack sudo[94335]: pam_unix(sudo:session): session closed for user root Nov 06 15:24:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5ec068ca-e46d-4ad9-88aa-1fa323890e7e tempest-VolumesGetTest-1085601192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a7101f26-6d12-4868-a0b3-42f7d2be25a4 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-c72e66b7-e5e4-471f-9327-01bed6214519" returned: 0 in 9.117s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:24:26 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-5ec068ca-e46d-4ad9-88aa-1fa323890e7e tempest-VolumesGetTest-1085601192 None] Image conversion details: src /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a7101f26-6d12-4868-a0b3-42f7d2be25a4, size 1024.00 MB, duration 9.12 sec, destination /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-c72e66b7-e5e4-471f-9327-01bed6214519 {{(pid=87132) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 06 15:24:26 devstack cinder-volume[87132]: INFO cinder.image.image_utils [None req-5ec068ca-e46d-4ad9-88aa-1fa323890e7e tempest-VolumesGetTest-1085601192 None] Converted 1024.00 MB image at 112.31 MB/s Nov 06 15:24:26 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-5ec068ca-e46d-4ad9-88aa-1fa323890e7e tempest-VolumesGetTest-1085601192 None] /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-c72e66b7-e5e4-471f-9327-01bed6214519 is being set with open permissions: ugo+rw Nov 06 15:24:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5ec068ca-e46d-4ad9-88aa-1fa323890e7e tempest-VolumesGetTest-1085601192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-c72e66b7-e5e4-471f-9327-01bed6214519 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:24:26 devstack sudo[94380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-c72e66b7-e5e4-471f-9327-01bed6214519 Nov 06 15:24:26 devstack sudo[94380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:24:26 devstack sudo[94380]: pam_unix(sudo:session): session closed for user root Nov 06 15:24:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5ec068ca-e46d-4ad9-88aa-1fa323890e7e tempest-VolumesGetTest-1085601192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-c72e66b7-e5e4-471f-9327-01bed6214519" returned: 0 in 0.249s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:24:26 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-5ec068ca-e46d-4ad9-88aa-1fa323890e7e tempest-VolumesGetTest-1085601192 None] Lock "cinder-quobyte-c72e66b7-e5e4-471f-9327-01bed6214519" released by "_copy_volume_from_snapshot" :: held 10.377s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:24:26 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-5ec068ca-e46d-4ad9-88aa-1fa323890e7e tempest-VolumesGetTest-1085601192 None] Acquiring lock "cinder-quobyte-aae065e8-4a4e-4042-8750-08c79eca7a08" by "_delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:24:26 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-5ec068ca-e46d-4ad9-88aa-1fa323890e7e tempest-VolumesGetTest-1085601192 None] Lock "cinder-quobyte-aae065e8-4a4e-4042-8750-08c79eca7a08" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:24:26 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-5ec068ca-e46d-4ad9-88aa-1fa323890e7e tempest-VolumesGetTest-1085601192 None] Deleting offline snapshot aae065e8-4a4e-4042-8750-08c79eca7a08 of volume a7101f26-6d12-4868-a0b3-42f7d2be25a4 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 15:24:26 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-5ec068ca-e46d-4ad9-88aa-1fa323890e7e tempest-VolumesGetTest-1085601192 None] snapshot_file for this snap is: volume-a7101f26-6d12-4868-a0b3-42f7d2be25a4.aae065e8-4a4e-4042-8750-08c79eca7a08 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 15:24:26 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4a9bbf7-6229-4c51-b2d6-fc325c262649]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:24:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5ec068ca-e46d-4ad9-88aa-1fa323890e7e tempest-VolumesGetTest-1085601192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a7101f26-6d12-4868-a0b3-42f7d2be25a4.aae065e8-4a4e-4042-8750-08c79eca7a08 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:24:26 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:SELECT=25,cinder:INSERT=8,cinder:UPDATE=32,cinder:DELETE=3 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 15:24:26 devstack sudo[94383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a7101f26-6d12-4868-a0b3-42f7d2be25a4.aae065e8-4a4e-4042-8750-08c79eca7a08 Nov 06 15:24:26 devstack sudo[94383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:24:27 devstack sudo[94383]: pam_unix(sudo:session): session closed for user root Nov 06 15:24:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5ec068ca-e46d-4ad9-88aa-1fa323890e7e tempest-VolumesGetTest-1085601192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a7101f26-6d12-4868-a0b3-42f7d2be25a4.aae065e8-4a4e-4042-8750-08c79eca7a08" returned: 0 in 0.378s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:24:27 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-5ec068ca-e46d-4ad9-88aa-1fa323890e7e tempest-VolumesGetTest-1085601192 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7101f26-6d12-4868-a0b3-42f7d2be25a4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 15:24:27 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd6a05cc-b8e5-4d3c-9cae-d9ee3d6e9562]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:24:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5ec068ca-e46d-4ad9-88aa-1fa323890e7e tempest-VolumesGetTest-1085601192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a7101f26-6d12-4868-a0b3-42f7d2be25a4 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:24:27 devstack sudo[94388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a7101f26-6d12-4868-a0b3-42f7d2be25a4 Nov 06 15:24:27 devstack sudo[94388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:24:27 devstack sudo[94388]: pam_unix(sudo:session): session closed for user root Nov 06 15:24:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5ec068ca-e46d-4ad9-88aa-1fa323890e7e tempest-VolumesGetTest-1085601192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a7101f26-6d12-4868-a0b3-42f7d2be25a4" returned: 0 in 0.546s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:24:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5ec068ca-e46d-4ad9-88aa-1fa323890e7e tempest-VolumesGetTest-1085601192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a7101f26-6d12-4868-a0b3-42f7d2be25a4.aae065e8-4a4e-4042-8750-08c79eca7a08 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:24:27 devstack sudo[94394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a7101f26-6d12-4868-a0b3-42f7d2be25a4.aae065e8-4a4e-4042-8750-08c79eca7a08 Nov 06 15:24:27 devstack sudo[94394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:24:28 devstack sudo[94394]: pam_unix(sudo:session): session closed for user root Nov 06 15:24:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5ec068ca-e46d-4ad9-88aa-1fa323890e7e tempest-VolumesGetTest-1085601192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a7101f26-6d12-4868-a0b3-42f7d2be25a4.aae065e8-4a4e-4042-8750-08c79eca7a08" returned: 0 in 0.339s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:24:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5ec068ca-e46d-4ad9-88aa-1fa323890e7e tempest-VolumesGetTest-1085601192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a7101f26-6d12-4868-a0b3-42f7d2be25a4.aae065e8-4a4e-4042-8750-08c79eca7a08 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:24:28 devstack sudo[94399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a7101f26-6d12-4868-a0b3-42f7d2be25a4.aae065e8-4a4e-4042-8750-08c79eca7a08 Nov 06 15:24:28 devstack sudo[94399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:24:28 devstack sudo[94399]: pam_unix(sudo:session): session closed for user root Nov 06 15:24:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5ec068ca-e46d-4ad9-88aa-1fa323890e7e tempest-VolumesGetTest-1085601192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a7101f26-6d12-4868-a0b3-42f7d2be25a4.aae065e8-4a4e-4042-8750-08c79eca7a08" returned: 0 in 0.282s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:24:28 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-5ec068ca-e46d-4ad9-88aa-1fa323890e7e tempest-VolumesGetTest-1085601192 None] Lock "cinder-quobyte-aae065e8-4a4e-4042-8750-08c79eca7a08" released by "_delete_snapshot" :: held 1.657s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:24:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5ec068ca-e46d-4ad9-88aa-1fa323890e7e tempest-VolumesGetTest-1085601192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.631s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:24:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-845ac114-6f13-4a3a-a44f-7ff810ca532d req-8d2ca334-5269-4b49-956e-b56210fdc953 tempest-TestInstancesWithCinderVolumes-1896526329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 11.593s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:24:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-845ac114-6f13-4a3a-a44f-7ff810ca532d req-8d2ca334-5269-4b49-956e-b56210fdc953 tempest-TestInstancesWithCinderVolumes-1896526329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:24:28 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5ec068ca-e46d-4ad9-88aa-1fa323890e7e tempest-VolumesGetTest-1085601192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25d80083-a43c-444f-924f-3035d839b26a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c72e66b7-e5e4-471f-9327-01bed6214519', 'volume_size': 1, 'source_volid': 'a7101f26-6d12-4868-a0b3-42f7d2be25a4', 'source_volstatus': 'available'}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:24:28 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5ec068ca-e46d-4ad9-88aa-1fa323890e7e tempest-VolumesGetTest-1085601192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fde2e103-b3d4-4508-9caa-aebcbc7f5a6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:24:28 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-3742d96e-1cd8-4479-9eb0-63a38c13032b tempest-VolumeSnapshotQuotasNegativeTestJSON-1013463211 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:24:28 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3742d96e-1cd8-4479-9eb0-63a38c13032b tempest-VolumeSnapshotQuotasNegativeTestJSON-1013463211 None] Flow 'volume_create_manager' (044fffc0-8bb7-46ec-aa53-9b97c9737790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:24:28 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3742d96e-1cd8-4479-9eb0-63a38c13032b tempest-VolumeSnapshotQuotasNegativeTestJSON-1013463211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cef5007-b032-427c-8692-7dfaca7da380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:24:28 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-5ec068ca-e46d-4ad9-88aa-1fa323890e7e tempest-VolumesGetTest-1085601192 None] Volume volume-c72e66b7-e5e4-471f-9327-01bed6214519 (c72e66b7-e5e4-471f-9327-01bed6214519): created successfully Nov 06 15:24:28 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5ec068ca-e46d-4ad9-88aa-1fa323890e7e tempest-VolumesGetTest-1085601192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fde2e103-b3d4-4508-9caa-aebcbc7f5a6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:24:28 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5ec068ca-e46d-4ad9-88aa-1fa323890e7e tempest-VolumesGetTest-1085601192 None] Flow 'volume_create_manager' (9f797340-f217-44ae-b94a-0492b8f0fe05) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:24:28 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3742d96e-1cd8-4479-9eb0-63a38c13032b tempest-VolumeSnapshotQuotasNegativeTestJSON-1013463211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cef5007-b032-427c-8692-7dfaca7da380) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:24:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-808673817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b0fef9e-2818-45de-a795-7cab87a9bdb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2c6b05dbf2e4640bc5adbe5de7cfabf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:24:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:24:28Z,use_quota=True,user_id='33551d16fd514bdb9d5d92fad499c3ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:24:28 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3742d96e-1cd8-4479-9eb0-63a38c13032b tempest-VolumeSnapshotQuotasNegativeTestJSON-1013463211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24bb1fc0-676f-4fca-b72b-1867aae58d0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:24:28 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3742d96e-1cd8-4479-9eb0-63a38c13032b tempest-VolumeSnapshotQuotasNegativeTestJSON-1013463211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24bb1fc0-676f-4fca-b72b-1867aae58d0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:24:28 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3742d96e-1cd8-4479-9eb0-63a38c13032b tempest-VolumeSnapshotQuotasNegativeTestJSON-1013463211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a0e3f22-52af-4ab8-9e64-54a0f6b7a13f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:24:28 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3742d96e-1cd8-4479-9eb0-63a38c13032b tempest-VolumeSnapshotQuotasNegativeTestJSON-1013463211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a0e3f22-52af-4ab8-9e64-54a0f6b7a13f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b0fef9e-2818-45de-a795-7cab87a9bdb4', 'volume_name': 'volume-8b0fef9e-2818-45de-a795-7cab87a9bdb4', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:24:28 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3742d96e-1cd8-4479-9eb0-63a38c13032b tempest-VolumeSnapshotQuotasNegativeTestJSON-1013463211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fed48059-3683-45ea-8a56-a08136af6a12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:24:28 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3742d96e-1cd8-4479-9eb0-63a38c13032b tempest-VolumeSnapshotQuotasNegativeTestJSON-1013463211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fed48059-3683-45ea-8a56-a08136af6a12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:24:28 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3742d96e-1cd8-4479-9eb0-63a38c13032b tempest-VolumeSnapshotQuotasNegativeTestJSON-1013463211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a292a0df-c4e0-44fd-864f-54d3bee62f82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:24:28 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-3742d96e-1cd8-4479-9eb0-63a38c13032b tempest-VolumeSnapshotQuotasNegativeTestJSON-1013463211 None] Volume 8b0fef9e-2818-45de-a795-7cab87a9bdb4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b0fef9e-2818-45de-a795-7cab87a9bdb4', 'volume_size': 1} Nov 06 15:24:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3742d96e-1cd8-4479-9eb0-63a38c13032b tempest-VolumeSnapshotQuotasNegativeTestJSON-1013463211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:24:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3742d96e-1cd8-4479-9eb0-63a38c13032b tempest-VolumeSnapshotQuotasNegativeTestJSON-1013463211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:24:28 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3742d96e-1cd8-4479-9eb0-63a38c13032b tempest-VolumeSnapshotQuotasNegativeTestJSON-1013463211 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:24:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-808673817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b0fef9e-2818-45de-a795-7cab87a9bdb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2c6b05dbf2e4640bc5adbe5de7cfabf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:24:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:24:28Z,use_quota=True,user_id='33551d16fd514bdb9d5d92fad499c3ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:24:28 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-3742d96e-1cd8-4479-9eb0-63a38c13032b tempest-VolumeSnapshotQuotasNegativeTestJSON-1013463211 None] Creating volume 8b0fef9e-2818-45de-a795-7cab87a9bdb4 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:24:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3742d96e-1cd8-4479-9eb0-63a38c13032b tempest-VolumeSnapshotQuotasNegativeTestJSON-1013463211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:24:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3742d96e-1cd8-4479-9eb0-63a38c13032b tempest-VolumeSnapshotQuotasNegativeTestJSON-1013463211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:24:28 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3742d96e-1cd8-4479-9eb0-63a38c13032b tempest-VolumeSnapshotQuotasNegativeTestJSON-1013463211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:24:28 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3742d96e-1cd8-4479-9eb0-63a38c13032b tempest-VolumeSnapshotQuotasNegativeTestJSON-1013463211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:24:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3742d96e-1cd8-4479-9eb0-63a38c13032b tempest-VolumeSnapshotQuotasNegativeTestJSON-1013463211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:24:28 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3742d96e-1cd8-4479-9eb0-63a38c13032b tempest-VolumeSnapshotQuotasNegativeTestJSON-1013463211 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:24:28 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-3742d96e-1cd8-4479-9eb0-63a38c13032b tempest-VolumeSnapshotQuotasNegativeTestJSON-1013463211 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:24:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3742d96e-1cd8-4479-9eb0-63a38c13032b tempest-VolumeSnapshotQuotasNegativeTestJSON-1013463211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-8b0fef9e-2818-45de-a795-7cab87a9bdb4 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:24:28 devstack sudo[94402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-8b0fef9e-2818-45de-a795-7cab87a9bdb4 1073741824 Nov 06 15:24:28 devstack sudo[94402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:24:28 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-845ac114-6f13-4a3a-a44f-7ff810ca532d req-8d2ca334-5269-4b49-956e-b56210fdc953 tempest-TestInstancesWithCinderVolumes-1896526329 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b', 'name': 'volume-70211137-3d04-47b2-99ef-1e2f66c9f1c6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd3ea52e4-d460-4167-82ab-04b0c0db574e', 'enforce_multipath': True} {{(pid=87132) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 15:24:28 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-5ec068ca-e46d-4ad9-88aa-1fa323890e7e tempest-VolumesGetTest-1085601192 None] Created volume successfully. Nov 06 15:24:28 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-845ac114-6f13-4a3a-a44f-7ff810ca532d req-8d2ca334-5269-4b49-956e-b56210fdc953 tempest-TestInstancesWithCinderVolumes-1896526329 None] attachment_update completed successfully. Nov 06 15:24:29 devstack sudo[94402]: pam_unix(sudo:session): session closed for user root Nov 06 15:24:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3742d96e-1cd8-4479-9eb0-63a38c13032b tempest-VolumeSnapshotQuotasNegativeTestJSON-1013463211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-8b0fef9e-2818-45de-a795-7cab87a9bdb4 1073741824" returned: 0 in 0.505s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:24:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3742d96e-1cd8-4479-9eb0-63a38c13032b tempest-VolumeSnapshotQuotasNegativeTestJSON-1013463211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-8b0fef9e-2818-45de-a795-7cab87a9bdb4 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:24:29 devstack sudo[94410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-8b0fef9e-2818-45de-a795-7cab87a9bdb4 Nov 06 15:24:29 devstack sudo[94410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:24:29 devstack sudo[94410]: pam_unix(sudo:session): session closed for user root Nov 06 15:24:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3742d96e-1cd8-4479-9eb0-63a38c13032b tempest-VolumeSnapshotQuotasNegativeTestJSON-1013463211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-8b0fef9e-2818-45de-a795-7cab87a9bdb4" returned: 0 in 0.271s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:24:29 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3742d96e-1cd8-4479-9eb0-63a38c13032b tempest-VolumeSnapshotQuotasNegativeTestJSON-1013463211 None] <== create_volume: return (829ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:24:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3742d96e-1cd8-4479-9eb0-63a38c13032b tempest-VolumeSnapshotQuotasNegativeTestJSON-1013463211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.832s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:24:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3742d96e-1cd8-4479-9eb0-63a38c13032b tempest-VolumeSnapshotQuotasNegativeTestJSON-1013463211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a292a0df-c4e0-44fd-864f-54d3bee62f82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b0fef9e-2818-45de-a795-7cab87a9bdb4', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:24:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3742d96e-1cd8-4479-9eb0-63a38c13032b tempest-VolumeSnapshotQuotasNegativeTestJSON-1013463211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22984225-9045-47ca-9203-d6e304f078f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:24:29 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-3742d96e-1cd8-4479-9eb0-63a38c13032b tempest-VolumeSnapshotQuotasNegativeTestJSON-1013463211 None] Volume volume-8b0fef9e-2818-45de-a795-7cab87a9bdb4 (8b0fef9e-2818-45de-a795-7cab87a9bdb4): created successfully Nov 06 15:24:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3742d96e-1cd8-4479-9eb0-63a38c13032b tempest-VolumeSnapshotQuotasNegativeTestJSON-1013463211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22984225-9045-47ca-9203-d6e304f078f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:24:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3742d96e-1cd8-4479-9eb0-63a38c13032b tempest-VolumeSnapshotQuotasNegativeTestJSON-1013463211 None] Flow 'volume_create_manager' (044fffc0-8bb7-46ec-aa53-9b97c9737790) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:24:29 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-3742d96e-1cd8-4479-9eb0-63a38c13032b tempest-VolumeSnapshotQuotasNegativeTestJSON-1013463211 None] Created volume successfully. Nov 06 15:24:30 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-01623399-d57e-435a-93e5-fbf41fcbb6ff tempest-VolumesGetTest-1085601192 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:24:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-01623399-d57e-435a-93e5-fbf41fcbb6ff tempest-VolumesGetTest-1085601192 None] Flow 'volume_create_manager' (50e6bd62-e866-43ba-808b-50cf8047387c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:24:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-01623399-d57e-435a-93e5-fbf41fcbb6ff tempest-VolumesGetTest-1085601192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2666c2d-2282-4f0c-9488-2ccae40e0c6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:24:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-01623399-d57e-435a-93e5-fbf41fcbb6ff tempest-VolumesGetTest-1085601192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2666c2d-2282-4f0c-9488-2ccae40e0c6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:24:30Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1194441457',display_name='tempest-VolumesGetTest-Volume-1820338019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d0cc6df-8b63-4479-843b-6423d8e0309f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19a710b72df64f7cb85396f4325746a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:24:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:24:30Z,use_quota=True,user_id='f73a6732646d4a37be9909093d84b9e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:24:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-01623399-d57e-435a-93e5-fbf41fcbb6ff tempest-VolumesGetTest-1085601192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (322e8295-0187-4227-8860-46a62b433b96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:24:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-01623399-d57e-435a-93e5-fbf41fcbb6ff tempest-VolumesGetTest-1085601192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (322e8295-0187-4227-8860-46a62b433b96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:24:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-01623399-d57e-435a-93e5-fbf41fcbb6ff tempest-VolumesGetTest-1085601192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0a2a2f5-af84-4c9e-8433-58775ef8be84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:24:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-01623399-d57e-435a-93e5-fbf41fcbb6ff tempest-VolumesGetTest-1085601192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0a2a2f5-af84-4c9e-8433-58775ef8be84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d0cc6df-8b63-4479-843b-6423d8e0309f', 'volume_name': 'volume-0d0cc6df-8b63-4479-843b-6423d8e0309f', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:24:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-01623399-d57e-435a-93e5-fbf41fcbb6ff tempest-VolumesGetTest-1085601192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3faeae62-b8d5-4499-acd7-2e6cbb79e288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:24:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-01623399-d57e-435a-93e5-fbf41fcbb6ff tempest-VolumesGetTest-1085601192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3faeae62-b8d5-4499-acd7-2e6cbb79e288) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:24:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-01623399-d57e-435a-93e5-fbf41fcbb6ff tempest-VolumesGetTest-1085601192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdd31979-dc6d-454e-8ca7-97df88a3bc12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:24:30 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-01623399-d57e-435a-93e5-fbf41fcbb6ff tempest-VolumesGetTest-1085601192 None] Volume 0d0cc6df-8b63-4479-843b-6423d8e0309f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d0cc6df-8b63-4479-843b-6423d8e0309f', 'volume_size': 1} Nov 06 15:24:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-01623399-d57e-435a-93e5-fbf41fcbb6ff tempest-VolumesGetTest-1085601192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:24:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-01623399-d57e-435a-93e5-fbf41fcbb6ff tempest-VolumesGetTest-1085601192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:24:30 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-01623399-d57e-435a-93e5-fbf41fcbb6ff tempest-VolumesGetTest-1085601192 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:24:30Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1194441457',display_name='tempest-VolumesGetTest-Volume-1820338019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d0cc6df-8b63-4479-843b-6423d8e0309f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19a710b72df64f7cb85396f4325746a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:24:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:24:30Z,use_quota=True,user_id='f73a6732646d4a37be9909093d84b9e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:24:30 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-01623399-d57e-435a-93e5-fbf41fcbb6ff tempest-VolumesGetTest-1085601192 None] Creating volume 0d0cc6df-8b63-4479-843b-6423d8e0309f {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:24:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-01623399-d57e-435a-93e5-fbf41fcbb6ff tempest-VolumesGetTest-1085601192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:24:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-01623399-d57e-435a-93e5-fbf41fcbb6ff tempest-VolumesGetTest-1085601192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:24:30 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-01623399-d57e-435a-93e5-fbf41fcbb6ff tempest-VolumesGetTest-1085601192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:24:30 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-01623399-d57e-435a-93e5-fbf41fcbb6ff tempest-VolumesGetTest-1085601192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:24:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-01623399-d57e-435a-93e5-fbf41fcbb6ff tempest-VolumesGetTest-1085601192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:24:30 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-01623399-d57e-435a-93e5-fbf41fcbb6ff tempest-VolumesGetTest-1085601192 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:24:30 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-01623399-d57e-435a-93e5-fbf41fcbb6ff tempest-VolumesGetTest-1085601192 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:24:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-01623399-d57e-435a-93e5-fbf41fcbb6ff tempest-VolumesGetTest-1085601192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0d0cc6df-8b63-4479-843b-6423d8e0309f 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:24:30 devstack sudo[94424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0d0cc6df-8b63-4479-843b-6423d8e0309f 1073741824 Nov 06 15:24:30 devstack sudo[94424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:24:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-3f9c996d-4380-45f7-8810-cd31dedae393 req-c8a63092-a971-4e43-8ffd-fa4e9c39b57c tempest-TestInstancesWithCinderVolumes-1896526329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:24:30 devstack sudo[94424]: pam_unix(sudo:session): session closed for user root Nov 06 15:24:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-01623399-d57e-435a-93e5-fbf41fcbb6ff tempest-VolumesGetTest-1085601192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0d0cc6df-8b63-4479-843b-6423d8e0309f 1073741824" returned: 0 in 0.474s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:24:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-74f0ca54-048f-4543-bcc6-dc71439c072b tempest-VolumeSnapshotQuotasNegativeTestJSON-1013463211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:24:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-01623399-d57e-435a-93e5-fbf41fcbb6ff tempest-VolumesGetTest-1085601192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0d0cc6df-8b63-4479-843b-6423d8e0309f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:24:30 devstack sudo[94439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0d0cc6df-8b63-4479-843b-6423d8e0309f Nov 06 15:24:30 devstack sudo[94439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:24:31 devstack sudo[94439]: pam_unix(sudo:session): session closed for user root Nov 06 15:24:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-01623399-d57e-435a-93e5-fbf41fcbb6ff tempest-VolumesGetTest-1085601192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0d0cc6df-8b63-4479-843b-6423d8e0309f" returned: 0 in 0.241s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:24:31 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-01623399-d57e-435a-93e5-fbf41fcbb6ff tempest-VolumesGetTest-1085601192 None] <== create_volume: return (766ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:24:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-01623399-d57e-435a-93e5-fbf41fcbb6ff tempest-VolumesGetTest-1085601192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.770s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:24:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-3f9c996d-4380-45f7-8810-cd31dedae393 req-c8a63092-a971-4e43-8ffd-fa4e9c39b57c tempest-TestInstancesWithCinderVolumes-1896526329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.357s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:24:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-01623399-d57e-435a-93e5-fbf41fcbb6ff tempest-VolumesGetTest-1085601192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdd31979-dc6d-454e-8ca7-97df88a3bc12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d0cc6df-8b63-4479-843b-6423d8e0309f', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:24:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-01623399-d57e-435a-93e5-fbf41fcbb6ff tempest-VolumesGetTest-1085601192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfb321f2-e1bc-4e84-ae8a-447fc1d9d973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:24:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-3f9c996d-4380-45f7-8810-cd31dedae393 req-c8a63092-a971-4e43-8ffd-fa4e9c39b57c tempest-TestInstancesWithCinderVolumes-1896526329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:24:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-74f0ca54-048f-4543-bcc6-dc71439c072b tempest-VolumeSnapshotQuotasNegativeTestJSON-1013463211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.281s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:24:31 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-01623399-d57e-435a-93e5-fbf41fcbb6ff tempest-VolumesGetTest-1085601192 None] Volume volume-0d0cc6df-8b63-4479-843b-6423d8e0309f (0d0cc6df-8b63-4479-843b-6423d8e0309f): created successfully Nov 06 15:24:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-01623399-d57e-435a-93e5-fbf41fcbb6ff tempest-VolumesGetTest-1085601192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfb321f2-e1bc-4e84-ae8a-447fc1d9d973) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:24:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-01623399-d57e-435a-93e5-fbf41fcbb6ff tempest-VolumesGetTest-1085601192 None] Flow 'volume_create_manager' (50e6bd62-e866-43ba-808b-50cf8047387c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:24:31 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-74f0ca54-048f-4543-bcc6-dc71439c072b tempest-VolumeSnapshotQuotasNegativeTestJSON-1013463211 None] Creating offline snapshot 521ff5aa-6f57-4744-8d1e-d309e968b82e of volume 8b0fef9e-2818-45de-a795-7cab87a9bdb4 {{(pid=87132) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 15:24:31 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-01623399-d57e-435a-93e5-fbf41fcbb6ff tempest-VolumesGetTest-1085601192 None] Created volume successfully. Nov 06 15:24:31 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3998093-6eff-46c7-b789-72cd0256d7fc]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:24:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-74f0ca54-048f-4543-bcc6-dc71439c072b tempest-VolumeSnapshotQuotasNegativeTestJSON-1013463211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-8b0fef9e-2818-45de-a795-7cab87a9bdb4 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:24:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-3f9c996d-4380-45f7-8810-cd31dedae393 req-c8a63092-a971-4e43-8ffd-fa4e9c39b57c tempest-TestInstancesWithCinderVolumes-1896526329 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b', 'name': 'volume-f6e34394-758c-4448-9f2e-14209069c77f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ad05df65-90ba-478c-8e5b-30804972ff48', 'enforce_multipath': True} {{(pid=87132) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 15:24:31 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-3f9c996d-4380-45f7-8810-cd31dedae393 req-c8a63092-a971-4e43-8ffd-fa4e9c39b57c tempest-TestInstancesWithCinderVolumes-1896526329 None] attachment_update completed successfully. Nov 06 15:24:31 devstack sudo[94442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-8b0fef9e-2818-45de-a795-7cab87a9bdb4 Nov 06 15:24:31 devstack sudo[94442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:24:31 devstack sudo[94442]: pam_unix(sudo:session): session closed for user root Nov 06 15:24:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-74f0ca54-048f-4543-bcc6-dc71439c072b tempest-VolumeSnapshotQuotasNegativeTestJSON-1013463211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-8b0fef9e-2818-45de-a795-7cab87a9bdb4" returned: 0 in 0.439s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:24:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-74f0ca54-048f-4543-bcc6-dc71439c072b tempest-VolumeSnapshotQuotasNegativeTestJSON-1013463211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-8b0fef9e-2818-45de-a795-7cab87a9bdb4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-8b0fef9e-2818-45de-a795-7cab87a9bdb4.521ff5aa-6f57-4744-8d1e-d309e968b82e 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:24:31 devstack sudo[94449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-8b0fef9e-2818-45de-a795-7cab87a9bdb4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-8b0fef9e-2818-45de-a795-7cab87a9bdb4.521ff5aa-6f57-4744-8d1e-d309e968b82e 1G Nov 06 15:24:31 devstack sudo[94449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:24:31 devstack sudo[94449]: pam_unix(sudo:session): session closed for user root Nov 06 15:24:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-74f0ca54-048f-4543-bcc6-dc71439c072b tempest-VolumeSnapshotQuotasNegativeTestJSON-1013463211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-8b0fef9e-2818-45de-a795-7cab87a9bdb4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-8b0fef9e-2818-45de-a795-7cab87a9bdb4.521ff5aa-6f57-4744-8d1e-d309e968b82e 1G" returned: 0 in 0.415s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:24:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-74f0ca54-048f-4543-bcc6-dc71439c072b tempest-VolumeSnapshotQuotasNegativeTestJSON-1013463211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b0fef9e-2818-45de-a795-7cab87a9bdb4 -F qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-8b0fef9e-2818-45de-a795-7cab87a9bdb4.521ff5aa-6f57-4744-8d1e-d309e968b82e {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:24:32 devstack sudo[94454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b0fef9e-2818-45de-a795-7cab87a9bdb4 -F qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-8b0fef9e-2818-45de-a795-7cab87a9bdb4.521ff5aa-6f57-4744-8d1e-d309e968b82e Nov 06 15:24:32 devstack sudo[94454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:24:32 devstack sudo[94454]: pam_unix(sudo:session): session closed for user root Nov 06 15:24:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-74f0ca54-048f-4543-bcc6-dc71439c072b tempest-VolumeSnapshotQuotasNegativeTestJSON-1013463211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b0fef9e-2818-45de-a795-7cab87a9bdb4 -F qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-8b0fef9e-2818-45de-a795-7cab87a9bdb4.521ff5aa-6f57-4744-8d1e-d309e968b82e" returned: 0 in 0.304s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:24:32 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-74f0ca54-048f-4543-bcc6-dc71439c072b tempest-VolumeSnapshotQuotasNegativeTestJSON-1013463211 None] /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-8b0fef9e-2818-45de-a795-7cab87a9bdb4.521ff5aa-6f57-4744-8d1e-d309e968b82e is being set with open permissions: ugo+rw Nov 06 15:24:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-74f0ca54-048f-4543-bcc6-dc71439c072b tempest-VolumeSnapshotQuotasNegativeTestJSON-1013463211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-8b0fef9e-2818-45de-a795-7cab87a9bdb4.521ff5aa-6f57-4744-8d1e-d309e968b82e {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:24:32 devstack sudo[94459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-8b0fef9e-2818-45de-a795-7cab87a9bdb4.521ff5aa-6f57-4744-8d1e-d309e968b82e Nov 06 15:24:32 devstack sudo[94459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:24:32 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-9caff640-5a55-4457-b068-803d5b2d0fff tempest-VolumesGetTest-1085601192 None] Acquiring lock "cinder-0d0cc6df-8b63-4479-843b-6423d8e0309f-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:24:32 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-9caff640-5a55-4457-b068-803d5b2d0fff tempest-VolumesGetTest-1085601192 None] Lock "cinder-0d0cc6df-8b63-4479-843b-6423d8e0309f-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:24:32 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-9caff640-5a55-4457-b068-803d5b2d0fff tempest-VolumesGetTest-1085601192 None] Acquiring lock "cinder-quobyte-0d0cc6df-8b63-4479-843b-6423d8e0309f" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:24:32 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-9caff640-5a55-4457-b068-803d5b2d0fff tempest-VolumesGetTest-1085601192 None] Lock "cinder-quobyte-0d0cc6df-8b63-4479-843b-6423d8e0309f" acquired by "delete_volume" :: waited 0.015s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:24:32 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd05aad9-0673-44ca-9e97-3aa4d7ff153e]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:24:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9caff640-5a55-4457-b068-803d5b2d0fff tempest-VolumesGetTest-1085601192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0d0cc6df-8b63-4479-843b-6423d8e0309f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:24:32 devstack sudo[94459]: pam_unix(sudo:session): session closed for user root Nov 06 15:24:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-74f0ca54-048f-4543-bcc6-dc71439c072b tempest-VolumeSnapshotQuotasNegativeTestJSON-1013463211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-8b0fef9e-2818-45de-a795-7cab87a9bdb4.521ff5aa-6f57-4744-8d1e-d309e968b82e" returned: 0 in 0.252s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:24:32 devstack sudo[94461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0d0cc6df-8b63-4479-843b-6423d8e0309f Nov 06 15:24:32 devstack sudo[94461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:24:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-74f0ca54-048f-4543-bcc6-dc71439c072b tempest-VolumeSnapshotQuotasNegativeTestJSON-1013463211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-8b0fef9e-2818-45de-a795-7cab87a9bdb4.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:24:32 devstack sudo[94464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-8b0fef9e-2818-45de-a795-7cab87a9bdb4.info Nov 06 15:24:32 devstack sudo[94464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:24:32 devstack sudo[94464]: pam_unix(sudo:session): session closed for user root Nov 06 15:24:32 devstack sudo[94461]: pam_unix(sudo:session): session closed for user root Nov 06 15:24:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-74f0ca54-048f-4543-bcc6-dc71439c072b tempest-VolumeSnapshotQuotasNegativeTestJSON-1013463211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-8b0fef9e-2818-45de-a795-7cab87a9bdb4.info" returned: 0 in 0.275s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:24:32 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-74f0ca54-048f-4543-bcc6-dc71439c072b tempest-VolumeSnapshotQuotasNegativeTestJSON-1013463211 None] /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-8b0fef9e-2818-45de-a795-7cab87a9bdb4.info is being set with open permissions: ugo+rw Nov 06 15:24:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-74f0ca54-048f-4543-bcc6-dc71439c072b tempest-VolumeSnapshotQuotasNegativeTestJSON-1013463211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-8b0fef9e-2818-45de-a795-7cab87a9bdb4.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:24:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9caff640-5a55-4457-b068-803d5b2d0fff tempest-VolumesGetTest-1085601192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0d0cc6df-8b63-4479-843b-6423d8e0309f" returned: 0 in 0.400s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:24:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9caff640-5a55-4457-b068-803d5b2d0fff tempest-VolumesGetTest-1085601192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0d0cc6df-8b63-4479-843b-6423d8e0309f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:24:32 devstack sudo[94477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-8b0fef9e-2818-45de-a795-7cab87a9bdb4.info Nov 06 15:24:32 devstack sudo[94477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:24:32 devstack sudo[94478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0d0cc6df-8b63-4479-843b-6423d8e0309f Nov 06 15:24:32 devstack sudo[94478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:24:33 devstack sudo[94478]: pam_unix(sudo:session): session closed for user root Nov 06 15:24:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9caff640-5a55-4457-b068-803d5b2d0fff tempest-VolumesGetTest-1085601192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0d0cc6df-8b63-4479-843b-6423d8e0309f" returned: 0 in 0.255s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:24:33 devstack sudo[94477]: pam_unix(sudo:session): session closed for user root Nov 06 15:24:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-74f0ca54-048f-4543-bcc6-dc71439c072b tempest-VolumeSnapshotQuotasNegativeTestJSON-1013463211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-8b0fef9e-2818-45de-a795-7cab87a9bdb4.info" returned: 0 in 0.278s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:24:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-74f0ca54-048f-4543-bcc6-dc71439c072b tempest-VolumeSnapshotQuotasNegativeTestJSON-1013463211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.075s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:24:33 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-9caff640-5a55-4457-b068-803d5b2d0fff tempest-VolumesGetTest-1085601192 None] Lock "cinder-quobyte-0d0cc6df-8b63-4479-843b-6423d8e0309f" released by "delete_volume" :: held 0.717s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:24:33 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-74f0ca54-048f-4543-bcc6-dc71439c072b tempest-VolumeSnapshotQuotasNegativeTestJSON-1013463211 None] Create snapshot completed successfully Nov 06 15:24:33 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-9caff640-5a55-4457-b068-803d5b2d0fff tempest-VolumesGetTest-1085601192 None] Created reservations ['657c5f4e-8dad-4809-849e-eb8e0612d5f9', '43ddd535-1227-40d6-93c0-9fa9359efed6', '8ff32842-e9cc-4a77-ad50-35c82e9f292e', 'd1585134-f99f-4f29-a5fa-33fc35a93861'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:24:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9caff640-5a55-4457-b068-803d5b2d0fff tempest-VolumesGetTest-1085601192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:24:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9caff640-5a55-4457-b068-803d5b2d0fff tempest-VolumesGetTest-1085601192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:24:33 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-9caff640-5a55-4457-b068-803d5b2d0fff tempest-VolumesGetTest-1085601192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:24:33 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-9caff640-5a55-4457-b068-803d5b2d0fff tempest-VolumesGetTest-1085601192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:24:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9caff640-5a55-4457-b068-803d5b2d0fff tempest-VolumesGetTest-1085601192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:24:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9caff640-5a55-4457-b068-803d5b2d0fff tempest-VolumesGetTest-1085601192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:24:33 devstack sudo[94485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:24:33 devstack sudo[94485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:24:33 devstack sudo[94485]: pam_unix(sudo:session): session closed for user root Nov 06 15:24:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9caff640-5a55-4457-b068-803d5b2d0fff tempest-VolumesGetTest-1085601192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.266s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:24:33 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-9caff640-5a55-4457-b068-803d5b2d0fff tempest-VolumesGetTest-1085601192 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:24:33 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-9caff640-5a55-4457-b068-803d5b2d0fff tempest-VolumesGetTest-1085601192 None] Deleted volume successfully. Nov 06 15:24:33 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-9caff640-5a55-4457-b068-803d5b2d0fff tempest-VolumesGetTest-1085601192 None] Lock "cinder-0d0cc6df-8b63-4479-843b-6423d8e0309f-delete_volume" released by "delete_volume" :: held 1.229s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:24:33 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-1f98dff0-bef5-4e2e-99eb-ef867b422a28 tempest-VolumesGetTest-1085601192 None] Acquiring lock "cinder-c72e66b7-e5e4-471f-9327-01bed6214519-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:24:33 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-1f98dff0-bef5-4e2e-99eb-ef867b422a28 tempest-VolumesGetTest-1085601192 None] Lock "cinder-c72e66b7-e5e4-471f-9327-01bed6214519-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:24:33 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-1f98dff0-bef5-4e2e-99eb-ef867b422a28 tempest-VolumesGetTest-1085601192 None] Acquiring lock "cinder-quobyte-c72e66b7-e5e4-471f-9327-01bed6214519" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:24:33 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-1f98dff0-bef5-4e2e-99eb-ef867b422a28 tempest-VolumesGetTest-1085601192 None] Lock "cinder-quobyte-c72e66b7-e5e4-471f-9327-01bed6214519" acquired by "delete_volume" :: waited 0.016s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:24:33 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c5cee3d-8595-4abe-b494-0a0aa6d90170]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:24:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1f98dff0-bef5-4e2e-99eb-ef867b422a28 tempest-VolumesGetTest-1085601192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-c72e66b7-e5e4-471f-9327-01bed6214519 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:24:33 devstack sudo[94488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-c72e66b7-e5e4-471f-9327-01bed6214519 Nov 06 15:24:33 devstack sudo[94488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:24:34 devstack sudo[94488]: pam_unix(sudo:session): session closed for user root Nov 06 15:24:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1f98dff0-bef5-4e2e-99eb-ef867b422a28 tempest-VolumesGetTest-1085601192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-c72e66b7-e5e4-471f-9327-01bed6214519" returned: 0 in 0.438s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:24:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1f98dff0-bef5-4e2e-99eb-ef867b422a28 tempest-VolumesGetTest-1085601192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-c72e66b7-e5e4-471f-9327-01bed6214519 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:24:34 devstack sudo[94494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-c72e66b7-e5e4-471f-9327-01bed6214519 Nov 06 15:24:34 devstack sudo[94494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:24:34 devstack sudo[94494]: pam_unix(sudo:session): session closed for user root Nov 06 15:24:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1f98dff0-bef5-4e2e-99eb-ef867b422a28 tempest-VolumesGetTest-1085601192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-c72e66b7-e5e4-471f-9327-01bed6214519" returned: 0 in 0.336s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:24:34 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-1f98dff0-bef5-4e2e-99eb-ef867b422a28 tempest-VolumesGetTest-1085601192 None] Lock "cinder-quobyte-c72e66b7-e5e4-471f-9327-01bed6214519" released by "delete_volume" :: held 0.836s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:24:34 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-952c4d8c-6bc4-4ff4-8674-04a46c9f8717 tempest-VolumeSnapshotQuotasNegativeTestJSON-1013463211 None] Acquiring lock "cinder-521ff5aa-6f57-4744-8d1e-d309e968b82e-delete_snapshot" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:24:34 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-952c4d8c-6bc4-4ff4-8674-04a46c9f8717 tempest-VolumeSnapshotQuotasNegativeTestJSON-1013463211 None] Lock "cinder-521ff5aa-6f57-4744-8d1e-d309e968b82e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:24:34 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-952c4d8c-6bc4-4ff4-8674-04a46c9f8717 tempest-VolumeSnapshotQuotasNegativeTestJSON-1013463211 None] Acquiring lock "cinder-quobyte-8b0fef9e-2818-45de-a795-7cab87a9bdb4" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:24:34 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-1f98dff0-bef5-4e2e-99eb-ef867b422a28 tempest-VolumesGetTest-1085601192 None] Created reservations ['f51b5cb9-4e03-4d28-9ede-6ebeec113131', '0ec90720-b359-4250-8b90-4ba5fb586556', '5ab5adfc-4af9-46d3-b072-38b6088e83de', '7273a07c-1b1d-40b4-93e9-146ad0cee5a2'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:24:34 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-952c4d8c-6bc4-4ff4-8674-04a46c9f8717 tempest-VolumeSnapshotQuotasNegativeTestJSON-1013463211 None] Lock "cinder-quobyte-8b0fef9e-2818-45de-a795-7cab87a9bdb4" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:24:34 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-952c4d8c-6bc4-4ff4-8674-04a46c9f8717 tempest-VolumeSnapshotQuotasNegativeTestJSON-1013463211 None] Acquiring lock "cinder-quobyte-521ff5aa-6f57-4744-8d1e-d309e968b82e" by "_delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:24:34 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-952c4d8c-6bc4-4ff4-8674-04a46c9f8717 tempest-VolumeSnapshotQuotasNegativeTestJSON-1013463211 None] Lock "cinder-quobyte-521ff5aa-6f57-4744-8d1e-d309e968b82e" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:24:34 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-952c4d8c-6bc4-4ff4-8674-04a46c9f8717 tempest-VolumeSnapshotQuotasNegativeTestJSON-1013463211 None] Deleting offline snapshot 521ff5aa-6f57-4744-8d1e-d309e968b82e of volume 8b0fef9e-2818-45de-a795-7cab87a9bdb4 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 15:24:34 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-952c4d8c-6bc4-4ff4-8674-04a46c9f8717 tempest-VolumeSnapshotQuotasNegativeTestJSON-1013463211 None] snapshot_file for this snap is: volume-8b0fef9e-2818-45de-a795-7cab87a9bdb4.521ff5aa-6f57-4744-8d1e-d309e968b82e {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 15:24:34 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5eeb061-d64e-44b3-b020-3d75d9e99655]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:24:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-952c4d8c-6bc4-4ff4-8674-04a46c9f8717 tempest-VolumeSnapshotQuotasNegativeTestJSON-1013463211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-8b0fef9e-2818-45de-a795-7cab87a9bdb4.521ff5aa-6f57-4744-8d1e-d309e968b82e {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:24:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1f98dff0-bef5-4e2e-99eb-ef867b422a28 tempest-VolumesGetTest-1085601192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:24:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1f98dff0-bef5-4e2e-99eb-ef867b422a28 tempest-VolumesGetTest-1085601192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:24:34 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1f98dff0-bef5-4e2e-99eb-ef867b422a28 tempest-VolumesGetTest-1085601192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:24:34 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1f98dff0-bef5-4e2e-99eb-ef867b422a28 tempest-VolumesGetTest-1085601192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:24:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1f98dff0-bef5-4e2e-99eb-ef867b422a28 tempest-VolumesGetTest-1085601192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:24:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1f98dff0-bef5-4e2e-99eb-ef867b422a28 tempest-VolumesGetTest-1085601192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:24:34 devstack sudo[94498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:24:34 devstack sudo[94498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:24:34 devstack sudo[94497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-8b0fef9e-2818-45de-a795-7cab87a9bdb4.521ff5aa-6f57-4744-8d1e-d309e968b82e Nov 06 15:24:34 devstack sudo[94497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:24:34 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-f906182f-ec0b-48b8-9f2b-5e01af3d4535 tempest-VolumesGetTest-1085601192 None] Acquiring lock "cinder-a7101f26-6d12-4868-a0b3-42f7d2be25a4-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:24:34 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-f906182f-ec0b-48b8-9f2b-5e01af3d4535 tempest-VolumesGetTest-1085601192 None] Lock "cinder-a7101f26-6d12-4868-a0b3-42f7d2be25a4-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:24:35 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-f906182f-ec0b-48b8-9f2b-5e01af3d4535 tempest-VolumesGetTest-1085601192 None] Acquiring lock "cinder-quobyte-a7101f26-6d12-4868-a0b3-42f7d2be25a4" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:24:35 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-f906182f-ec0b-48b8-9f2b-5e01af3d4535 tempest-VolumesGetTest-1085601192 None] Lock "cinder-quobyte-a7101f26-6d12-4868-a0b3-42f7d2be25a4" acquired by "delete_volume" :: waited 0.030s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:24:35 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[10e139d5-5ebf-4d13-90f6-7128427038f7]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:24:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f906182f-ec0b-48b8-9f2b-5e01af3d4535 tempest-VolumesGetTest-1085601192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a7101f26-6d12-4868-a0b3-42f7d2be25a4 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:24:35 devstack sudo[94497]: pam_unix(sudo:session): session closed for user root Nov 06 15:24:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-952c4d8c-6bc4-4ff4-8674-04a46c9f8717 tempest-VolumeSnapshotQuotasNegativeTestJSON-1013463211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-8b0fef9e-2818-45de-a795-7cab87a9bdb4.521ff5aa-6f57-4744-8d1e-d309e968b82e" returned: 0 in 0.524s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:24:35 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-952c4d8c-6bc4-4ff4-8674-04a46c9f8717 tempest-VolumeSnapshotQuotasNegativeTestJSON-1013463211 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8b0fef9e-2818-45de-a795-7cab87a9bdb4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 15:24:35 devstack sudo[94498]: pam_unix(sudo:session): session closed for user root Nov 06 15:24:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1f98dff0-bef5-4e2e-99eb-ef867b422a28 tempest-VolumesGetTest-1085601192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.510s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:24:35 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-1f98dff0-bef5-4e2e-99eb-ef867b422a28 tempest-VolumesGetTest-1085601192 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:24:35 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-1f98dff0-bef5-4e2e-99eb-ef867b422a28 tempest-VolumesGetTest-1085601192 None] Deleted volume successfully. Nov 06 15:24:35 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[00f8907e-fa31-4be6-96e2-9b23db56b442]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:24:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-952c4d8c-6bc4-4ff4-8674-04a46c9f8717 tempest-VolumeSnapshotQuotasNegativeTestJSON-1013463211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-8b0fef9e-2818-45de-a795-7cab87a9bdb4 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:24:35 devstack sudo[94504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a7101f26-6d12-4868-a0b3-42f7d2be25a4 Nov 06 15:24:35 devstack sudo[94504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:24:35 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-1f98dff0-bef5-4e2e-99eb-ef867b422a28 tempest-VolumesGetTest-1085601192 None] Lock "cinder-c72e66b7-e5e4-471f-9327-01bed6214519-delete_volume" released by "delete_volume" :: held 1.685s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:24:35 devstack sudo[94507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-8b0fef9e-2818-45de-a795-7cab87a9bdb4 Nov 06 15:24:35 devstack sudo[94507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:24:35 devstack sudo[94504]: pam_unix(sudo:session): session closed for user root Nov 06 15:24:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f906182f-ec0b-48b8-9f2b-5e01af3d4535 tempest-VolumesGetTest-1085601192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a7101f26-6d12-4868-a0b3-42f7d2be25a4" returned: 0 in 0.489s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:24:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f906182f-ec0b-48b8-9f2b-5e01af3d4535 tempest-VolumesGetTest-1085601192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a7101f26-6d12-4868-a0b3-42f7d2be25a4 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:24:35 devstack sudo[94520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a7101f26-6d12-4868-a0b3-42f7d2be25a4 Nov 06 15:24:35 devstack sudo[94520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:24:35 devstack sudo[94507]: pam_unix(sudo:session): session closed for user root Nov 06 15:24:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-952c4d8c-6bc4-4ff4-8674-04a46c9f8717 tempest-VolumeSnapshotQuotasNegativeTestJSON-1013463211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-8b0fef9e-2818-45de-a795-7cab87a9bdb4" returned: 0 in 0.459s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:24:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-952c4d8c-6bc4-4ff4-8674-04a46c9f8717 tempest-VolumeSnapshotQuotasNegativeTestJSON-1013463211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-8b0fef9e-2818-45de-a795-7cab87a9bdb4.521ff5aa-6f57-4744-8d1e-d309e968b82e {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:24:35 devstack sudo[94528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-8b0fef9e-2818-45de-a795-7cab87a9bdb4.521ff5aa-6f57-4744-8d1e-d309e968b82e Nov 06 15:24:35 devstack sudo[94528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:24:35 devstack sudo[94520]: pam_unix(sudo:session): session closed for user root Nov 06 15:24:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f906182f-ec0b-48b8-9f2b-5e01af3d4535 tempest-VolumesGetTest-1085601192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a7101f26-6d12-4868-a0b3-42f7d2be25a4" returned: 0 in 0.277s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:24:35 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-f906182f-ec0b-48b8-9f2b-5e01af3d4535 tempest-VolumesGetTest-1085601192 None] Lock "cinder-quobyte-a7101f26-6d12-4868-a0b3-42f7d2be25a4" released by "delete_volume" :: held 0.878s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:24:36 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-f906182f-ec0b-48b8-9f2b-5e01af3d4535 tempest-VolumesGetTest-1085601192 None] Created reservations ['d8686269-b644-43a9-a534-f631c8bb7d13', '98ff5fda-5bff-47eb-8e54-e22cf8a7ff3c', 'eb97c1b2-b817-41d6-a813-d3a739adc099', '6bf1ba99-f18e-4f5a-84e8-e5a7309a96de'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:24:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f906182f-ec0b-48b8-9f2b-5e01af3d4535 tempest-VolumesGetTest-1085601192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:24:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f906182f-ec0b-48b8-9f2b-5e01af3d4535 tempest-VolumesGetTest-1085601192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:24:36 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-f906182f-ec0b-48b8-9f2b-5e01af3d4535 tempest-VolumesGetTest-1085601192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:24:36 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-f906182f-ec0b-48b8-9f2b-5e01af3d4535 tempest-VolumesGetTest-1085601192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:24:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f906182f-ec0b-48b8-9f2b-5e01af3d4535 tempest-VolumesGetTest-1085601192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:24:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f906182f-ec0b-48b8-9f2b-5e01af3d4535 tempest-VolumesGetTest-1085601192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:24:36 devstack sudo[94543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:24:36 devstack sudo[94543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:24:36 devstack sudo[94528]: pam_unix(sudo:session): session closed for user root Nov 06 15:24:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-952c4d8c-6bc4-4ff4-8674-04a46c9f8717 tempest-VolumeSnapshotQuotasNegativeTestJSON-1013463211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-8b0fef9e-2818-45de-a795-7cab87a9bdb4.521ff5aa-6f57-4744-8d1e-d309e968b82e" returned: 0 in 0.457s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:24:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-952c4d8c-6bc4-4ff4-8674-04a46c9f8717 tempest-VolumeSnapshotQuotasNegativeTestJSON-1013463211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-8b0fef9e-2818-45de-a795-7cab87a9bdb4.521ff5aa-6f57-4744-8d1e-d309e968b82e {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:24:36 devstack sudo[94545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-8b0fef9e-2818-45de-a795-7cab87a9bdb4.521ff5aa-6f57-4744-8d1e-d309e968b82e Nov 06 15:24:36 devstack sudo[94545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:24:36 devstack sudo[94543]: pam_unix(sudo:session): session closed for user root Nov 06 15:24:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f906182f-ec0b-48b8-9f2b-5e01af3d4535 tempest-VolumesGetTest-1085601192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.281s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:24:36 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-f906182f-ec0b-48b8-9f2b-5e01af3d4535 tempest-VolumesGetTest-1085601192 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:24:36 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-f906182f-ec0b-48b8-9f2b-5e01af3d4535 tempest-VolumesGetTest-1085601192 None] Deleted volume successfully. Nov 06 15:24:36 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-f906182f-ec0b-48b8-9f2b-5e01af3d4535 tempest-VolumesGetTest-1085601192 None] Lock "cinder-a7101f26-6d12-4868-a0b3-42f7d2be25a4-delete_volume" released by "delete_volume" :: held 1.487s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:24:36 devstack sudo[94545]: pam_unix(sudo:session): session closed for user root Nov 06 15:24:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-952c4d8c-6bc4-4ff4-8674-04a46c9f8717 tempest-VolumeSnapshotQuotasNegativeTestJSON-1013463211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-8b0fef9e-2818-45de-a795-7cab87a9bdb4.521ff5aa-6f57-4744-8d1e-d309e968b82e" returned: 0 in 0.296s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:24:36 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-952c4d8c-6bc4-4ff4-8674-04a46c9f8717 tempest-VolumeSnapshotQuotasNegativeTestJSON-1013463211 None] Lock "cinder-quobyte-521ff5aa-6f57-4744-8d1e-d309e968b82e" released by "_delete_snapshot" :: held 1.887s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:24:36 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-952c4d8c-6bc4-4ff4-8674-04a46c9f8717 tempest-VolumeSnapshotQuotasNegativeTestJSON-1013463211 None] Lock "cinder-quobyte-8b0fef9e-2818-45de-a795-7cab87a9bdb4" released by "delete_snapshot" :: held 1.921s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:24:36 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-952c4d8c-6bc4-4ff4-8674-04a46c9f8717 tempest-VolumeSnapshotQuotasNegativeTestJSON-1013463211 None] Created reservations ['89bc49bb-5585-48ae-9b43-9007868a7be0', 'f46d6f3b-abbc-444e-a4e7-527fac4b0323', 'da7dd571-f50e-4775-a8d2-4cc51408844c', '603f78d6-50c5-40e6-b105-b893bfcc29b4'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:24:36 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-952c4d8c-6bc4-4ff4-8674-04a46c9f8717 tempest-VolumeSnapshotQuotasNegativeTestJSON-1013463211 None] Delete snapshot completed successfully. Nov 06 15:24:36 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-952c4d8c-6bc4-4ff4-8674-04a46c9f8717 tempest-VolumeSnapshotQuotasNegativeTestJSON-1013463211 None] Lock "cinder-521ff5aa-6f57-4744-8d1e-d309e968b82e-delete_snapshot" released by "delete_snapshot" :: held 2.091s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:24:36 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-761d0329-3936-4e66-a90d-5ef4631ed547 tempest-VolumeSnapshotQuotasNegativeTestJSON-1013463211 None] Acquiring lock "cinder-8b0fef9e-2818-45de-a795-7cab87a9bdb4-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:24:36 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-761d0329-3936-4e66-a90d-5ef4631ed547 tempest-VolumeSnapshotQuotasNegativeTestJSON-1013463211 None] Lock "cinder-8b0fef9e-2818-45de-a795-7cab87a9bdb4-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:24:36 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-761d0329-3936-4e66-a90d-5ef4631ed547 tempest-VolumeSnapshotQuotasNegativeTestJSON-1013463211 None] Acquiring lock "cinder-quobyte-8b0fef9e-2818-45de-a795-7cab87a9bdb4" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:24:36 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-761d0329-3936-4e66-a90d-5ef4631ed547 tempest-VolumeSnapshotQuotasNegativeTestJSON-1013463211 None] Lock "cinder-quobyte-8b0fef9e-2818-45de-a795-7cab87a9bdb4" acquired by "delete_volume" :: waited 0.020s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:24:37 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[9407c35f-e4b2-466b-861b-81ebd5defdf9]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:24:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-761d0329-3936-4e66-a90d-5ef4631ed547 tempest-VolumeSnapshotQuotasNegativeTestJSON-1013463211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-8b0fef9e-2818-45de-a795-7cab87a9bdb4 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:24:37 devstack sudo[94556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-8b0fef9e-2818-45de-a795-7cab87a9bdb4 Nov 06 15:24:37 devstack sudo[94556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:24:37 devstack sudo[94556]: pam_unix(sudo:session): session closed for user root Nov 06 15:24:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-761d0329-3936-4e66-a90d-5ef4631ed547 tempest-VolumeSnapshotQuotasNegativeTestJSON-1013463211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-8b0fef9e-2818-45de-a795-7cab87a9bdb4" returned: 0 in 0.417s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:24:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-761d0329-3936-4e66-a90d-5ef4631ed547 tempest-VolumeSnapshotQuotasNegativeTestJSON-1013463211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-8b0fef9e-2818-45de-a795-7cab87a9bdb4 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:24:37 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-20c7a7da-32df-4fec-84d7-fb1afa8d621f req-592bbe21-fc62-4d83-b5b2-3bfe5aeca67b tempest-TestInstancesWithCinderVolumes-1896526329 None] Terminate volume connection completed successfully. Nov 06 15:24:37 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-20c7a7da-32df-4fec-84d7-fb1afa8d621f req-592bbe21-fc62-4d83-b5b2-3bfe5aeca67b tempest-TestInstancesWithCinderVolumes-1896526329 None] Deleting attachment d3ea52e4-d460-4167-82ab-04b0c0db574e. {{(pid=87132) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 06 15:24:37 devstack sudo[94564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-8b0fef9e-2818-45de-a795-7cab87a9bdb4 Nov 06 15:24:37 devstack sudo[94564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:24:37 devstack sudo[94564]: pam_unix(sudo:session): session closed for user root Nov 06 15:24:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-761d0329-3936-4e66-a90d-5ef4631ed547 tempest-VolumeSnapshotQuotasNegativeTestJSON-1013463211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-8b0fef9e-2818-45de-a795-7cab87a9bdb4" returned: 0 in 0.259s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:24:37 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-761d0329-3936-4e66-a90d-5ef4631ed547 tempest-VolumeSnapshotQuotasNegativeTestJSON-1013463211 None] Lock "cinder-quobyte-8b0fef9e-2818-45de-a795-7cab87a9bdb4" released by "delete_volume" :: held 0.763s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:24:37 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-761d0329-3936-4e66-a90d-5ef4631ed547 tempest-VolumeSnapshotQuotasNegativeTestJSON-1013463211 None] Created reservations ['3a9dde79-fa7f-4682-8c13-87a341fde062', 'd2108cc7-5c2e-4f49-84f9-7712b81e37b9', '1da62702-6548-4e3b-b5d2-5490df4db50b', 'e368b0db-213f-47d3-bbe5-fecc1b3a2b09'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:24:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-761d0329-3936-4e66-a90d-5ef4631ed547 tempest-VolumeSnapshotQuotasNegativeTestJSON-1013463211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:24:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-761d0329-3936-4e66-a90d-5ef4631ed547 tempest-VolumeSnapshotQuotasNegativeTestJSON-1013463211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:24:37 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-761d0329-3936-4e66-a90d-5ef4631ed547 tempest-VolumeSnapshotQuotasNegativeTestJSON-1013463211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:24:37 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-761d0329-3936-4e66-a90d-5ef4631ed547 tempest-VolumeSnapshotQuotasNegativeTestJSON-1013463211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:24:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-761d0329-3936-4e66-a90d-5ef4631ed547 tempest-VolumeSnapshotQuotasNegativeTestJSON-1013463211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:24:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-761d0329-3936-4e66-a90d-5ef4631ed547 tempest-VolumeSnapshotQuotasNegativeTestJSON-1013463211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:24:37 devstack sudo[94567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:24:37 devstack sudo[94567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:24:37 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d2ff5f2-032a-4b9c-b881-9240ae6467f3 tempest-VolumesGetTest-1085601192 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:24:37 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7d2ff5f2-032a-4b9c-b881-9240ae6467f3 tempest-VolumesGetTest-1085601192 None] Flow 'volume_create_manager' (014831da-7ebc-44d4-a4a6-797aa5ec539c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:24:37 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7d2ff5f2-032a-4b9c-b881-9240ae6467f3 tempest-VolumesGetTest-1085601192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8886f753-2419-49f4-a1d4-c4a7997335bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:24:37 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7d2ff5f2-032a-4b9c-b881-9240ae6467f3 tempest-VolumesGetTest-1085601192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8886f753-2419-49f4-a1d4-c4a7997335bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:24:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-648731553',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fd5c268-2cb1-4319-b8ce-b878e0c20325,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='19a710b72df64f7cb85396f4325746a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:24:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:24:38Z,use_quota=True,user_id='f73a6732646d4a37be9909093d84b9e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:24:37 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7d2ff5f2-032a-4b9c-b881-9240ae6467f3 tempest-VolumesGetTest-1085601192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23bafc3c-2edd-47a1-9aea-0a8d34577a28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:24:37 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7d2ff5f2-032a-4b9c-b881-9240ae6467f3 tempest-VolumesGetTest-1085601192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23bafc3c-2edd-47a1-9aea-0a8d34577a28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:24:37 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7d2ff5f2-032a-4b9c-b881-9240ae6467f3 tempest-VolumesGetTest-1085601192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12d1b873-2108-467a-b4c7-66e3d10caebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:24:37 devstack cinder-volume[87132]: DEBUG cinder.image.glance [None req-7d2ff5f2-032a-4b9c-b881-9240ae6467f3 tempest-VolumesGetTest-1085601192 None] Creating Keystone auth plugin from conf {{(pid=87132) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 06 15:24:38 devstack sudo[94567]: pam_unix(sudo:session): session closed for user root Nov 06 15:24:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-761d0329-3936-4e66-a90d-5ef4631ed547 tempest-VolumeSnapshotQuotasNegativeTestJSON-1013463211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.282s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:24:38 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-761d0329-3936-4e66-a90d-5ef4631ed547 tempest-VolumeSnapshotQuotasNegativeTestJSON-1013463211 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:24:38 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-761d0329-3936-4e66-a90d-5ef4631ed547 tempest-VolumeSnapshotQuotasNegativeTestJSON-1013463211 None] Deleted volume successfully. Nov 06 15:24:38 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-761d0329-3936-4e66-a90d-5ef4631ed547 tempest-VolumeSnapshotQuotasNegativeTestJSON-1013463211 None] Lock "cinder-8b0fef9e-2818-45de-a795-7cab87a9bdb4-delete_volume" released by "delete_volume" :: held 1.291s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:24:38 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c432f3e8-e335-4861-8a97-e53406c8b455 tempest-TestInstancesWithCinderVolumes-1896526329 None] Acquiring lock "cinder-70211137-3d04-47b2-99ef-1e2f66c9f1c6-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:24:38 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c432f3e8-e335-4861-8a97-e53406c8b455 tempest-TestInstancesWithCinderVolumes-1896526329 None] Lock "cinder-70211137-3d04-47b2-99ef-1e2f66c9f1c6-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:24:38 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c432f3e8-e335-4861-8a97-e53406c8b455 tempest-TestInstancesWithCinderVolumes-1896526329 None] Acquiring lock "cinder-quobyte-70211137-3d04-47b2-99ef-1e2f66c9f1c6" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:24:38 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c432f3e8-e335-4861-8a97-e53406c8b455 tempest-TestInstancesWithCinderVolumes-1896526329 None] Lock "cinder-quobyte-70211137-3d04-47b2-99ef-1e2f66c9f1c6" acquired by "delete_volume" :: waited 0.018s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:24:38 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[96491e74-6cbd-494e-97ca-a3173d7d74f5]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:24:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c432f3e8-e335-4861-8a97-e53406c8b455 tempest-TestInstancesWithCinderVolumes-1896526329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-70211137-3d04-47b2-99ef-1e2f66c9f1c6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:24:38 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7d2ff5f2-032a-4b9c-b881-9240ae6467f3 tempest-VolumesGetTest-1085601192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12d1b873-2108-467a-b4c7-66e3d10caebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2fd5c268-2cb1-4319-b8ce-b878e0c20325', 'volume_name': 'volume-2fd5c268-2cb1-4319-b8ce-b878e0c20325', 'volume_size': 1, 'image_id': '3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c02e84193ee841ccb304f909f5951fd0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83', 'created_at': datetime.datetime(2026, 11, 6, 14, 12, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 14, 12, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:24:38 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7d2ff5f2-032a-4b9c-b881-9240ae6467f3 tempest-VolumesGetTest-1085601192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a18970f-f33d-47d0-928e-4435258ac5df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:24:38 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7d2ff5f2-032a-4b9c-b881-9240ae6467f3 tempest-VolumesGetTest-1085601192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a18970f-f33d-47d0-928e-4435258ac5df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:24:38 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7d2ff5f2-032a-4b9c-b881-9240ae6467f3 tempest-VolumesGetTest-1085601192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0824c257-fd82-46d2-aa7b-fda2b648d4a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:24:38 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-7d2ff5f2-032a-4b9c-b881-9240ae6467f3 tempest-VolumesGetTest-1085601192 None] Volume 2fd5c268-2cb1-4319-b8ce-b878e0c20325: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2fd5c268-2cb1-4319-b8ce-b878e0c20325', 'volume_size': 1, 'image_id': '3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c02e84193ee841ccb304f909f5951fd0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83', 'created_at': datetime.datetime(2026, 11, 6, 14, 12, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 14, 12, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 06 15:24:38 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d2ff5f2-032a-4b9c-b881-9240ae6467f3 tempest-VolumesGetTest-1085601192 None] Trying to clone 2fd5c268-2cb1-4319-b8ce-b878e0c20325 from image 3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83 at location (None, [{'url': 'file:///opt/stack/data/glance/images/3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83', 'metadata': {}}]). {{(pid=87132) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 06 15:24:38 devstack sudo[94574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-70211137-3d04-47b2-99ef-1e2f66c9f1c6 Nov 06 15:24:38 devstack sudo[94574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:24:38 devstack sudo[94574]: pam_unix(sudo:session): session closed for user root Nov 06 15:24:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c432f3e8-e335-4861-8a97-e53406c8b455 tempest-TestInstancesWithCinderVolumes-1896526329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-70211137-3d04-47b2-99ef-1e2f66c9f1c6" returned: 0 in 0.473s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:24:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c432f3e8-e335-4861-8a97-e53406c8b455 tempest-TestInstancesWithCinderVolumes-1896526329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-70211137-3d04-47b2-99ef-1e2f66c9f1c6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:24:38 devstack sudo[94580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-70211137-3d04-47b2-99ef-1e2f66c9f1c6 Nov 06 15:24:38 devstack sudo[94580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:24:38 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-7d2ff5f2-032a-4b9c-b881-9240ae6467f3 tempest-VolumesGetTest-1085601192 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83_09sz8v60devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87132) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 06 15:24:38 devstack cinder-volume[87132]: INFO cinder.image.image_utils [None req-7d2ff5f2-032a-4b9c-b881-9240ae6467f3 tempest-VolumesGetTest-1085601192 None] Image download 20.69 MB at 20.69 MB/s Nov 06 15:24:38 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[1328d0a4-4e4a-4fc4-af8c-c6df6ed69b47]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:24:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7d2ff5f2-032a-4b9c-b881-9240ae6467f3 tempest-VolumesGetTest-1085601192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83_09sz8v60devstack@QuobyteHD {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:24:39 devstack sudo[94582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83_09sz8v60devstack@QuobyteHD Nov 06 15:24:39 devstack sudo[94582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:24:39 devstack sudo[94580]: pam_unix(sudo:session): session closed for user root Nov 06 15:24:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c432f3e8-e335-4861-8a97-e53406c8b455 tempest-TestInstancesWithCinderVolumes-1896526329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-70211137-3d04-47b2-99ef-1e2f66c9f1c6" returned: 0 in 0.322s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:24:39 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c432f3e8-e335-4861-8a97-e53406c8b455 tempest-TestInstancesWithCinderVolumes-1896526329 None] Lock "cinder-quobyte-70211137-3d04-47b2-99ef-1e2f66c9f1c6" released by "delete_volume" :: held 0.848s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:24:39 devstack cinder-volume[87132]: WARNING cinder.quota [None req-c432f3e8-e335-4861-8a97-e53406c8b455 tempest-TestInstancesWithCinderVolumes-1896526329 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1406527310-956239074 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1406527310-956239074, it is now deprecated. Please use the default quota class for default quota. Nov 06 15:24:39 devstack cinder-volume[87132]: WARNING cinder.quota [None req-c432f3e8-e335-4861-8a97-e53406c8b455 tempest-TestInstancesWithCinderVolumes-1896526329 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1406527310-956239074 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1406527310-956239074, it is now deprecated. Please use the default quota class for default quota. Nov 06 15:24:39 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-c432f3e8-e335-4861-8a97-e53406c8b455 tempest-TestInstancesWithCinderVolumes-1896526329 None] Created reservations ['676a53eb-c598-45b1-9113-8f19252aa5b0', 'bd85a5b3-0983-4f25-a988-699eb6acae2e', 'a707db34-1923-4ee8-b557-07525c050a8e', '9b18565f-84c1-4341-bdc4-d008bbf7c405'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:24:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c432f3e8-e335-4861-8a97-e53406c8b455 tempest-TestInstancesWithCinderVolumes-1896526329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:24:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c432f3e8-e335-4861-8a97-e53406c8b455 tempest-TestInstancesWithCinderVolumes-1896526329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:24:39 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c432f3e8-e335-4861-8a97-e53406c8b455 tempest-TestInstancesWithCinderVolumes-1896526329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:24:39 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c432f3e8-e335-4861-8a97-e53406c8b455 tempest-TestInstancesWithCinderVolumes-1896526329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:24:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c432f3e8-e335-4861-8a97-e53406c8b455 tempest-TestInstancesWithCinderVolumes-1896526329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:24:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c432f3e8-e335-4861-8a97-e53406c8b455 tempest-TestInstancesWithCinderVolumes-1896526329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:24:39 devstack sudo[94585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:24:39 devstack sudo[94585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:24:39 devstack sudo[94582]: pam_unix(sudo:session): session closed for user root Nov 06 15:24:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7d2ff5f2-032a-4b9c-b881-9240ae6467f3 tempest-VolumesGetTest-1085601192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83_09sz8v60devstack@QuobyteHD" returned: 0 in 0.451s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:24:39 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-7d2ff5f2-032a-4b9c-b881-9240ae6467f3 tempest-VolumesGetTest-1085601192 None] Temporary image 3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83 is fetched for user f73a6732646d4a37be9909093d84b9e6. {{(pid=87132) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 06 15:24:39 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba6ab96b-81ef-4620-a8f7-62c1ddc4f3ac]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:24:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7d2ff5f2-032a-4b9c-b881-9240ae6467f3 tempest-VolumesGetTest-1085601192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83_09sz8v60devstack@QuobyteHD {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:24:39 devstack sudo[94585]: pam_unix(sudo:session): session closed for user root Nov 06 15:24:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c432f3e8-e335-4861-8a97-e53406c8b455 tempest-TestInstancesWithCinderVolumes-1896526329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.264s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:24:39 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-c432f3e8-e335-4861-8a97-e53406c8b455 tempest-TestInstancesWithCinderVolumes-1896526329 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:24:39 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-c432f3e8-e335-4861-8a97-e53406c8b455 tempest-TestInstancesWithCinderVolumes-1896526329 None] Deleted volume successfully. Nov 06 15:24:39 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c432f3e8-e335-4861-8a97-e53406c8b455 tempest-TestInstancesWithCinderVolumes-1896526329 None] Lock "cinder-70211137-3d04-47b2-99ef-1e2f66c9f1c6-delete_volume" released by "delete_volume" :: held 1.363s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:24:39 devstack sudo[94590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83_09sz8v60devstack@QuobyteHD Nov 06 15:24:39 devstack sudo[94590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:24:39 devstack sudo[94590]: pam_unix(sudo:session): session closed for user root Nov 06 15:24:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7d2ff5f2-032a-4b9c-b881-9240ae6467f3 tempest-VolumesGetTest-1085601192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83_09sz8v60devstack@QuobyteHD" returned: 0 in 0.425s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:24:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7d2ff5f2-032a-4b9c-b881-9240ae6467f3 tempest-VolumesGetTest-1085601192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:24:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7d2ff5f2-032a-4b9c-b881-9240ae6467f3 tempest-VolumesGetTest-1085601192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:24:39 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-7d2ff5f2-032a-4b9c-b881-9240ae6467f3 tempest-VolumesGetTest-1085601192 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:24:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-648731553',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fd5c268-2cb1-4319-b8ce-b878e0c20325,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='19a710b72df64f7cb85396f4325746a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:24:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:24:38Z,use_quota=True,user_id='f73a6732646d4a37be9909093d84b9e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:24:39 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-7d2ff5f2-032a-4b9c-b881-9240ae6467f3 tempest-VolumesGetTest-1085601192 None] Creating volume 2fd5c268-2cb1-4319-b8ce-b878e0c20325 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:24:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7d2ff5f2-032a-4b9c-b881-9240ae6467f3 tempest-VolumesGetTest-1085601192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:24:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7d2ff5f2-032a-4b9c-b881-9240ae6467f3 tempest-VolumesGetTest-1085601192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:24:39 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-7d2ff5f2-032a-4b9c-b881-9240ae6467f3 tempest-VolumesGetTest-1085601192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:24:39 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-7d2ff5f2-032a-4b9c-b881-9240ae6467f3 tempest-VolumesGetTest-1085601192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:24:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7d2ff5f2-032a-4b9c-b881-9240ae6467f3 tempest-VolumesGetTest-1085601192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:24:39 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-7d2ff5f2-032a-4b9c-b881-9240ae6467f3 tempest-VolumesGetTest-1085601192 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:24:39 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-7d2ff5f2-032a-4b9c-b881-9240ae6467f3 tempest-VolumesGetTest-1085601192 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:24:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7d2ff5f2-032a-4b9c-b881-9240ae6467f3 tempest-VolumesGetTest-1085601192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-2fd5c268-2cb1-4319-b8ce-b878e0c20325 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:24:40 devstack sudo[94596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-2fd5c268-2cb1-4319-b8ce-b878e0c20325 1073741824 Nov 06 15:24:40 devstack sudo[94596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:24:40 devstack sudo[94596]: pam_unix(sudo:session): session closed for user root Nov 06 15:24:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7d2ff5f2-032a-4b9c-b881-9240ae6467f3 tempest-VolumesGetTest-1085601192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-2fd5c268-2cb1-4319-b8ce-b878e0c20325 1073741824" returned: 0 in 0.587s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:24:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7d2ff5f2-032a-4b9c-b881-9240ae6467f3 tempest-VolumesGetTest-1085601192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-2fd5c268-2cb1-4319-b8ce-b878e0c20325 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:24:40 devstack sudo[94602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-2fd5c268-2cb1-4319-b8ce-b878e0c20325 Nov 06 15:24:40 devstack sudo[94602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:24:40 devstack sudo[94602]: pam_unix(sudo:session): session closed for user root Nov 06 15:24:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7d2ff5f2-032a-4b9c-b881-9240ae6467f3 tempest-VolumesGetTest-1085601192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-2fd5c268-2cb1-4319-b8ce-b878e0c20325" returned: 0 in 0.296s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:24:40 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-7d2ff5f2-032a-4b9c-b881-9240ae6467f3 tempest-VolumesGetTest-1085601192 None] <== create_volume: return (940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:24:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7d2ff5f2-032a-4b9c-b881-9240ae6467f3 tempest-VolumesGetTest-1085601192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.949s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:24:40 devstack cinder-volume[87132]: DEBUG cinder.volume.volume_utils [None req-7d2ff5f2-032a-4b9c-b881-9240ae6467f3 tempest-VolumesGetTest-1085601192 None] Attempting download of 3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83 ((None, [{'url': 'file:///opt/stack/data/glance/images/3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83', 'metadata': {}}])) to volume 2fd5c268-2cb1-4319-b8ce-b878e0c20325. {{(pid=87132) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 06 15:24:41 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef6ca02d-a14a-4a0b-ae83-892ec8d11e38]: (4, 'raw') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:24:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7d2ff5f2-032a-4b9c-b881-9240ae6467f3 tempest-VolumesGetTest-1085601192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83_k1qzgcn6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:24:41 devstack sudo[94609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83_k1qzgcn6 Nov 06 15:24:41 devstack sudo[94609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:24:41 devstack sudo[94609]: pam_unix(sudo:session): session closed for user root Nov 06 15:24:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7d2ff5f2-032a-4b9c-b881-9240ae6467f3 tempest-VolumesGetTest-1085601192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83_k1qzgcn6" returned: 0 in 0.411s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:24:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7d2ff5f2-032a-4b9c-b881-9240ae6467f3 tempest-VolumesGetTest-1085601192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83_k1qzgcn6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:24:41 devstack sudo[94620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83_k1qzgcn6 Nov 06 15:24:41 devstack sudo[94620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:24:41 devstack sudo[94620]: pam_unix(sudo:session): session closed for user root Nov 06 15:24:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7d2ff5f2-032a-4b9c-b881-9240ae6467f3 tempest-VolumesGetTest-1085601192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83_k1qzgcn6" returned: 1 in 0.365s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:24:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7d2ff5f2-032a-4b9c-b881-9240ae6467f3 tempest-VolumesGetTest-1085601192 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83_k1qzgcn6' failed. Not Retrying. {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 15:24:41 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9e46d53-ad64-40ea-b957-33eb599ba241]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:24:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7d2ff5f2-032a-4b9c-b881-9240ae6467f3 tempest-VolumesGetTest-1085601192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83_09sz8v60devstack@QuobyteHD {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:24:41 devstack sudo[94630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83_09sz8v60devstack@QuobyteHD Nov 06 15:24:41 devstack sudo[94630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:24:42 devstack sudo[94630]: pam_unix(sudo:session): session closed for user root Nov 06 15:24:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7d2ff5f2-032a-4b9c-b881-9240ae6467f3 tempest-VolumesGetTest-1085601192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83_09sz8v60devstack@QuobyteHD" returned: 0 in 0.339s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:24:42 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-7d2ff5f2-032a-4b9c-b881-9240ae6467f3 tempest-VolumesGetTest-1085601192 None] 3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83 was qcow2, converting to qcow2 {{(pid=87132) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 06 15:24:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7d2ff5f2-032a-4b9c-b881-9240ae6467f3 tempest-VolumesGetTest-1085601192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83_09sz8v60devstack@QuobyteHD /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-2fd5c268-2cb1-4319-b8ce-b878e0c20325 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:24:42 devstack sudo[94640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83_09sz8v60devstack@QuobyteHD /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-2fd5c268-2cb1-4319-b8ce-b878e0c20325 Nov 06 15:24:42 devstack sudo[94640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:24:42 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-2953750f-93c8-46bd-836b-680fcc574c17 req-f1239408-f466-40d0-a60e-f925eeeca5b9 tempest-TestInstancesWithCinderVolumes-1896526329 None] Terminate volume connection completed successfully. Nov 06 15:24:42 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-2953750f-93c8-46bd-836b-680fcc574c17 req-f1239408-f466-40d0-a60e-f925eeeca5b9 tempest-TestInstancesWithCinderVolumes-1896526329 None] Deleting attachment ad05df65-90ba-478c-8e5b-30804972ff48. {{(pid=87132) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 06 15:24:43 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-1e3e3a1a-ae22-4725-9cae-a108e2b2ab16 tempest-TestInstancesWithCinderVolumes-1896526329 None] Acquiring lock "cinder-f6e34394-758c-4448-9f2e-14209069c77f-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:24:43 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-1e3e3a1a-ae22-4725-9cae-a108e2b2ab16 tempest-TestInstancesWithCinderVolumes-1896526329 None] Lock "cinder-f6e34394-758c-4448-9f2e-14209069c77f-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:24:43 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-1e3e3a1a-ae22-4725-9cae-a108e2b2ab16 tempest-TestInstancesWithCinderVolumes-1896526329 None] Acquiring lock "cinder-quobyte-f6e34394-758c-4448-9f2e-14209069c77f" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:24:43 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-1e3e3a1a-ae22-4725-9cae-a108e2b2ab16 tempest-TestInstancesWithCinderVolumes-1896526329 None] Lock "cinder-quobyte-f6e34394-758c-4448-9f2e-14209069c77f" acquired by "delete_volume" :: waited 0.018s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:24:43 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cc9c0e7-b323-403c-bea0-02e9e4051466]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:24:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1e3e3a1a-ae22-4725-9cae-a108e2b2ab16 tempest-TestInstancesWithCinderVolumes-1896526329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f6e34394-758c-4448-9f2e-14209069c77f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:24:43 devstack sudo[94651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f6e34394-758c-4448-9f2e-14209069c77f Nov 06 15:24:43 devstack sudo[94651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:24:44 devstack sudo[94651]: pam_unix(sudo:session): session closed for user root Nov 06 15:24:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1e3e3a1a-ae22-4725-9cae-a108e2b2ab16 tempest-TestInstancesWithCinderVolumes-1896526329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f6e34394-758c-4448-9f2e-14209069c77f" returned: 0 in 0.478s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:24:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1e3e3a1a-ae22-4725-9cae-a108e2b2ab16 tempest-TestInstancesWithCinderVolumes-1896526329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f6e34394-758c-4448-9f2e-14209069c77f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:24:44 devstack sudo[94656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f6e34394-758c-4448-9f2e-14209069c77f Nov 06 15:24:44 devstack sudo[94656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:24:44 devstack sudo[94640]: pam_unix(sudo:session): session closed for user root Nov 06 15:24:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7d2ff5f2-032a-4b9c-b881-9240ae6467f3 tempest-VolumesGetTest-1085601192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83_09sz8v60devstack@QuobyteHD /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-2fd5c268-2cb1-4319-b8ce-b878e0c20325" returned: 0 in 2.204s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:24:44 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-7d2ff5f2-032a-4b9c-b881-9240ae6467f3 tempest-VolumesGetTest-1085601192 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83_09sz8v60devstack@QuobyteHD, size 112.00 MB, duration 2.21 sec, destination /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-2fd5c268-2cb1-4319-b8ce-b878e0c20325 {{(pid=87132) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 06 15:24:44 devstack cinder-volume[87132]: INFO cinder.image.image_utils [None req-7d2ff5f2-032a-4b9c-b881-9240ae6467f3 tempest-VolumesGetTest-1085601192 None] Converted 112.00 MB image at 50.79 MB/s Nov 06 15:24:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7d2ff5f2-032a-4b9c-b881-9240ae6467f3 tempest-VolumesGetTest-1085601192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-2fd5c268-2cb1-4319-b8ce-b878e0c20325 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:24:44 devstack sudo[94658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-2fd5c268-2cb1-4319-b8ce-b878e0c20325 1G Nov 06 15:24:44 devstack sudo[94658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:24:44 devstack sudo[94656]: pam_unix(sudo:session): session closed for user root Nov 06 15:24:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1e3e3a1a-ae22-4725-9cae-a108e2b2ab16 tempest-TestInstancesWithCinderVolumes-1896526329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f6e34394-758c-4448-9f2e-14209069c77f" returned: 0 in 0.317s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:24:44 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-1e3e3a1a-ae22-4725-9cae-a108e2b2ab16 tempest-TestInstancesWithCinderVolumes-1896526329 None] Lock "cinder-quobyte-f6e34394-758c-4448-9f2e-14209069c77f" released by "delete_volume" :: held 0.863s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:24:44 devstack cinder-volume[87132]: WARNING cinder.quota [None req-1e3e3a1a-ae22-4725-9cae-a108e2b2ab16 tempest-TestInstancesWithCinderVolumes-1896526329 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-680357527-1273737118 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-680357527-1273737118, it is now deprecated. Please use the default quota class for default quota. Nov 06 15:24:44 devstack cinder-volume[87132]: WARNING cinder.quota [None req-1e3e3a1a-ae22-4725-9cae-a108e2b2ab16 tempest-TestInstancesWithCinderVolumes-1896526329 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-680357527-1273737118 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-680357527-1273737118, it is now deprecated. Please use the default quota class for default quota. Nov 06 15:24:44 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-1e3e3a1a-ae22-4725-9cae-a108e2b2ab16 tempest-TestInstancesWithCinderVolumes-1896526329 None] Created reservations ['9e53ceb6-05cf-4ad1-bc87-1ae8a0d72075', 'b79aeb8c-e6a0-4c07-8099-6dfa7bc6dc44', 'c6f323f5-9ad7-4687-a7ca-0ca118437786', '701c6217-2284-4dbc-bcdd-5eff7d8fc980'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:24:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1e3e3a1a-ae22-4725-9cae-a108e2b2ab16 tempest-TestInstancesWithCinderVolumes-1896526329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:24:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1e3e3a1a-ae22-4725-9cae-a108e2b2ab16 tempest-TestInstancesWithCinderVolumes-1896526329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:24:44 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1e3e3a1a-ae22-4725-9cae-a108e2b2ab16 tempest-TestInstancesWithCinderVolumes-1896526329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:24:44 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1e3e3a1a-ae22-4725-9cae-a108e2b2ab16 tempest-TestInstancesWithCinderVolumes-1896526329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:24:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1e3e3a1a-ae22-4725-9cae-a108e2b2ab16 tempest-TestInstancesWithCinderVolumes-1896526329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:24:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1e3e3a1a-ae22-4725-9cae-a108e2b2ab16 tempest-TestInstancesWithCinderVolumes-1896526329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:24:44 devstack sudo[94658]: pam_unix(sudo:session): session closed for user root Nov 06 15:24:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7d2ff5f2-032a-4b9c-b881-9240ae6467f3 tempest-VolumesGetTest-1085601192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-2fd5c268-2cb1-4319-b8ce-b878e0c20325 1G" returned: 0 in 0.400s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:24:44 devstack cinder-volume[87132]: DEBUG cinder.volume.volume_utils [None req-7d2ff5f2-032a-4b9c-b881-9240ae6467f3 tempest-VolumesGetTest-1085601192 None] Downloaded image 3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83 ((None, [{'url': 'file:///opt/stack/data/glance/images/3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83', 'metadata': {}}])) to volume 2fd5c268-2cb1-4319-b8ce-b878e0c20325 successfully. {{(pid=87132) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 06 15:24:44 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-7d2ff5f2-032a-4b9c-b881-9240ae6467f3 tempest-VolumesGetTest-1085601192 None] Temporary image 3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83 for user f73a6732646d4a37be9909093d84b9e6 is deleted. {{(pid=87132) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 06 15:24:44 devstack cinder-volume[87132]: DEBUG cinder.volume.volume_utils [None req-7d2ff5f2-032a-4b9c-b881-9240ae6467f3 tempest-VolumesGetTest-1085601192 None] Marking volume 2fd5c268-2cb1-4319-b8ce-b878e0c20325 as bootable. {{(pid=87132) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 06 15:24:44 devstack sudo[94664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:24:44 devstack sudo[94664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:24:44 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d2ff5f2-032a-4b9c-b881-9240ae6467f3 tempest-VolumesGetTest-1085601192 None] Copying metadata from image 3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83 to 2fd5c268-2cb1-4319-b8ce-b878e0c20325. {{(pid=87132) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 06 15:24:44 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d2ff5f2-032a-4b9c-b881-9240ae6467f3 tempest-VolumesGetTest-1085601192 None] Creating volume glance metadata for volume 2fd5c268-2cb1-4319-b8ce-b878e0c20325 backed by image 3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87132) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 06 15:24:44 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7d2ff5f2-032a-4b9c-b881-9240ae6467f3 tempest-VolumesGetTest-1085601192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0824c257-fd82-46d2-aa7b-fda2b648d4a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2fd5c268-2cb1-4319-b8ce-b878e0c20325', 'volume_size': 1, 'image_id': '3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c02e84193ee841ccb304f909f5951fd0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83', 'created_at': datetime.datetime(2026, 11, 6, 14, 12, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 14, 12, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:24:44 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7d2ff5f2-032a-4b9c-b881-9240ae6467f3 tempest-VolumesGetTest-1085601192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd5ac419-374b-4227-b8ea-2fff7dd08a0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:24:44 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-7d2ff5f2-032a-4b9c-b881-9240ae6467f3 tempest-VolumesGetTest-1085601192 None] Volume volume-2fd5c268-2cb1-4319-b8ce-b878e0c20325 (2fd5c268-2cb1-4319-b8ce-b878e0c20325): created successfully Nov 06 15:24:44 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7d2ff5f2-032a-4b9c-b881-9240ae6467f3 tempest-VolumesGetTest-1085601192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd5ac419-374b-4227-b8ea-2fff7dd08a0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:24:44 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7d2ff5f2-032a-4b9c-b881-9240ae6467f3 tempest-VolumesGetTest-1085601192 None] Flow 'volume_create_manager' (014831da-7ebc-44d4-a4a6-797aa5ec539c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:24:45 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-7d2ff5f2-032a-4b9c-b881-9240ae6467f3 tempest-VolumesGetTest-1085601192 None] Created volume successfully. Nov 06 15:24:45 devstack sudo[94664]: pam_unix(sudo:session): session closed for user root Nov 06 15:24:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1e3e3a1a-ae22-4725-9cae-a108e2b2ab16 tempest-TestInstancesWithCinderVolumes-1896526329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.376s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:24:45 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-1e3e3a1a-ae22-4725-9cae-a108e2b2ab16 tempest-TestInstancesWithCinderVolumes-1896526329 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:24:45 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-1e3e3a1a-ae22-4725-9cae-a108e2b2ab16 tempest-TestInstancesWithCinderVolumes-1896526329 None] Deleted volume successfully. Nov 06 15:24:45 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-1e3e3a1a-ae22-4725-9cae-a108e2b2ab16 tempest-TestInstancesWithCinderVolumes-1896526329 None] Lock "cinder-f6e34394-758c-4448-9f2e-14209069c77f-delete_volume" released by "delete_volume" :: held 1.520s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:24:45 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4994b18-f780-4e62-98b7-7a70d8d8c7c2 tempest-VolumeTypesAccessTest-832732465 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:24:45 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c4994b18-f780-4e62-98b7-7a70d8d8c7c2 tempest-VolumeTypesAccessTest-832732465 None] Flow 'volume_create_manager' (4f09ec06-d2b7-4a05-9bca-c4b32567fe23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:24:45 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c4994b18-f780-4e62-98b7-7a70d8d8c7c2 tempest-VolumeTypesAccessTest-832732465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1559927-5856-43be-84fd-f879695872c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:24:45 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c4994b18-f780-4e62-98b7-7a70d8d8c7c2 tempest-VolumeTypesAccessTest-832732465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1559927-5856-43be-84fd-f879695872c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:24:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1875628236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca00a37c-65c4-4993-b1d2-a54953fee814,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a9dc696891348eeaf4b65b1eb6dd381',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:24:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:24:46Z,use_quota=True,user_id='8db69a915e004175aa2e831320cacdbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22eb880e-8040-4985-98f0-c042a2748474),volume_type_id=22eb880e-8040-4985-98f0-c042a2748474)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:24:45 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c4994b18-f780-4e62-98b7-7a70d8d8c7c2 tempest-VolumeTypesAccessTest-832732465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db8727a1-3c24-43b7-b897-68439631748f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:24:45 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c4994b18-f780-4e62-98b7-7a70d8d8c7c2 tempest-VolumeTypesAccessTest-832732465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db8727a1-3c24-43b7-b897-68439631748f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:24:45 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c4994b18-f780-4e62-98b7-7a70d8d8c7c2 tempest-VolumeTypesAccessTest-832732465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0ab836b-8c4c-4cb0-b0ba-4e56a64254a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:24:45 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c4994b18-f780-4e62-98b7-7a70d8d8c7c2 tempest-VolumeTypesAccessTest-832732465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0ab836b-8c4c-4cb0-b0ba-4e56a64254a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca00a37c-65c4-4993-b1d2-a54953fee814', 'volume_name': 'volume-ca00a37c-65c4-4993-b1d2-a54953fee814', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:24:45 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c4994b18-f780-4e62-98b7-7a70d8d8c7c2 tempest-VolumeTypesAccessTest-832732465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73325d16-1bfe-46da-8bf9-cf90bf024343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:24:45 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c4994b18-f780-4e62-98b7-7a70d8d8c7c2 tempest-VolumeTypesAccessTest-832732465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73325d16-1bfe-46da-8bf9-cf90bf024343) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:24:45 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c4994b18-f780-4e62-98b7-7a70d8d8c7c2 tempest-VolumeTypesAccessTest-832732465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b6f31d3-6ff2-4a2c-91ee-a512027562a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:24:45 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-c4994b18-f780-4e62-98b7-7a70d8d8c7c2 tempest-VolumeTypesAccessTest-832732465 None] Volume ca00a37c-65c4-4993-b1d2-a54953fee814: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca00a37c-65c4-4993-b1d2-a54953fee814', 'volume_size': 1} Nov 06 15:24:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c4994b18-f780-4e62-98b7-7a70d8d8c7c2 tempest-VolumeTypesAccessTest-832732465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:24:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c4994b18-f780-4e62-98b7-7a70d8d8c7c2 tempest-VolumeTypesAccessTest-832732465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:24:45 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c4994b18-f780-4e62-98b7-7a70d8d8c7c2 tempest-VolumeTypesAccessTest-832732465 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:24:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1875628236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca00a37c-65c4-4993-b1d2-a54953fee814,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a9dc696891348eeaf4b65b1eb6dd381',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:24:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:24:46Z,use_quota=True,user_id='8db69a915e004175aa2e831320cacdbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22eb880e-8040-4985-98f0-c042a2748474),volume_type_id=22eb880e-8040-4985-98f0-c042a2748474)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:24:45 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-c4994b18-f780-4e62-98b7-7a70d8d8c7c2 tempest-VolumeTypesAccessTest-832732465 None] Creating volume ca00a37c-65c4-4993-b1d2-a54953fee814 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:24:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c4994b18-f780-4e62-98b7-7a70d8d8c7c2 tempest-VolumeTypesAccessTest-832732465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:24:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c4994b18-f780-4e62-98b7-7a70d8d8c7c2 tempest-VolumeTypesAccessTest-832732465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:24:45 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c4994b18-f780-4e62-98b7-7a70d8d8c7c2 tempest-VolumeTypesAccessTest-832732465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:24:45 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c4994b18-f780-4e62-98b7-7a70d8d8c7c2 tempest-VolumeTypesAccessTest-832732465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:24:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c4994b18-f780-4e62-98b7-7a70d8d8c7c2 tempest-VolumeTypesAccessTest-832732465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:24:45 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c4994b18-f780-4e62-98b7-7a70d8d8c7c2 tempest-VolumeTypesAccessTest-832732465 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:24:45 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-c4994b18-f780-4e62-98b7-7a70d8d8c7c2 tempest-VolumeTypesAccessTest-832732465 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:24:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c4994b18-f780-4e62-98b7-7a70d8d8c7c2 tempest-VolumeTypesAccessTest-832732465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ca00a37c-65c4-4993-b1d2-a54953fee814 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:24:45 devstack sudo[94670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ca00a37c-65c4-4993-b1d2-a54953fee814 1073741824 Nov 06 15:24:45 devstack sudo[94670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:24:46 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b3ee8c5-15ac-499b-a0ba-5d8c40a3d5c0 tempest-VolumesGetTest-1085601192 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:24:46 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0b3ee8c5-15ac-499b-a0ba-5d8c40a3d5c0 tempest-VolumesGetTest-1085601192 None] Flow 'volume_create_manager' (cf25aa87-14b1-4663-815c-0aeb7cc621ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:24:46 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0b3ee8c5-15ac-499b-a0ba-5d8c40a3d5c0 tempest-VolumesGetTest-1085601192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cacbf10-e13d-4e9b-88d3-071a15777899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:24:46 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0b3ee8c5-15ac-499b-a0ba-5d8c40a3d5c0 tempest-VolumesGetTest-1085601192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cacbf10-e13d-4e9b-88d3-071a15777899) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:24:46Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-14158208',display_name='tempest-VolumesGetTest-Volume-1680353989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae454d07-717b-4cb4-927c-c40cf309171c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19a710b72df64f7cb85396f4325746a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:24:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:24:46Z,use_quota=True,user_id='f73a6732646d4a37be9909093d84b9e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:24:46 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0b3ee8c5-15ac-499b-a0ba-5d8c40a3d5c0 tempest-VolumesGetTest-1085601192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (367ae5d3-6413-4b88-a614-3ba79e195103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:24:46 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0b3ee8c5-15ac-499b-a0ba-5d8c40a3d5c0 tempest-VolumesGetTest-1085601192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (367ae5d3-6413-4b88-a614-3ba79e195103) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:24:46 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0b3ee8c5-15ac-499b-a0ba-5d8c40a3d5c0 tempest-VolumesGetTest-1085601192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (641ad524-3fe2-4521-b013-cda345469efa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:24:46 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0b3ee8c5-15ac-499b-a0ba-5d8c40a3d5c0 tempest-VolumesGetTest-1085601192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (641ad524-3fe2-4521-b013-cda345469efa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae454d07-717b-4cb4-927c-c40cf309171c', 'volume_name': 'volume-ae454d07-717b-4cb4-927c-c40cf309171c', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:24:46 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0b3ee8c5-15ac-499b-a0ba-5d8c40a3d5c0 tempest-VolumesGetTest-1085601192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c86f0082-f655-44a7-9c4d-169284777fc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:24:46 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0b3ee8c5-15ac-499b-a0ba-5d8c40a3d5c0 tempest-VolumesGetTest-1085601192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c86f0082-f655-44a7-9c4d-169284777fc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:24:46 devstack sudo[94670]: pam_unix(sudo:session): session closed for user root Nov 06 15:24:46 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0b3ee8c5-15ac-499b-a0ba-5d8c40a3d5c0 tempest-VolumesGetTest-1085601192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1fe68ae-1791-4bd7-bd9f-757bd851c58d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:24:46 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-0b3ee8c5-15ac-499b-a0ba-5d8c40a3d5c0 tempest-VolumesGetTest-1085601192 None] Volume ae454d07-717b-4cb4-927c-c40cf309171c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae454d07-717b-4cb4-927c-c40cf309171c', 'volume_size': 1} Nov 06 15:24:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0b3ee8c5-15ac-499b-a0ba-5d8c40a3d5c0 tempest-VolumesGetTest-1085601192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:24:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c4994b18-f780-4e62-98b7-7a70d8d8c7c2 tempest-VolumeTypesAccessTest-832732465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ca00a37c-65c4-4993-b1d2-a54953fee814 1073741824" returned: 0 in 0.679s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:24:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c4994b18-f780-4e62-98b7-7a70d8d8c7c2 tempest-VolumeTypesAccessTest-832732465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ca00a37c-65c4-4993-b1d2-a54953fee814 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:24:46 devstack sudo[94678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ca00a37c-65c4-4993-b1d2-a54953fee814 Nov 06 15:24:46 devstack sudo[94678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:24:46 devstack sudo[94678]: pam_unix(sudo:session): session closed for user root Nov 06 15:24:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c4994b18-f780-4e62-98b7-7a70d8d8c7c2 tempest-VolumeTypesAccessTest-832732465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ca00a37c-65c4-4993-b1d2-a54953fee814" returned: 0 in 0.322s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:24:46 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c4994b18-f780-4e62-98b7-7a70d8d8c7c2 tempest-VolumeTypesAccessTest-832732465 None] <== create_volume: return (1063ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:24:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c4994b18-f780-4e62-98b7-7a70d8d8c7c2 tempest-VolumeTypesAccessTest-832732465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.066s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:24:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0b3ee8c5-15ac-499b-a0ba-5d8c40a3d5c0 tempest-VolumesGetTest-1085601192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.386s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:24:46 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0b3ee8c5-15ac-499b-a0ba-5d8c40a3d5c0 tempest-VolumesGetTest-1085601192 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:24:46Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-14158208',display_name='tempest-VolumesGetTest-Volume-1680353989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae454d07-717b-4cb4-927c-c40cf309171c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19a710b72df64f7cb85396f4325746a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:24:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:24:46Z,use_quota=True,user_id='f73a6732646d4a37be9909093d84b9e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:24:46 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-0b3ee8c5-15ac-499b-a0ba-5d8c40a3d5c0 tempest-VolumesGetTest-1085601192 None] Creating volume ae454d07-717b-4cb4-927c-c40cf309171c {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:24:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0b3ee8c5-15ac-499b-a0ba-5d8c40a3d5c0 tempest-VolumesGetTest-1085601192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:24:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0b3ee8c5-15ac-499b-a0ba-5d8c40a3d5c0 tempest-VolumesGetTest-1085601192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:24:46 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0b3ee8c5-15ac-499b-a0ba-5d8c40a3d5c0 tempest-VolumesGetTest-1085601192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:24:46 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0b3ee8c5-15ac-499b-a0ba-5d8c40a3d5c0 tempest-VolumesGetTest-1085601192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:24:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0b3ee8c5-15ac-499b-a0ba-5d8c40a3d5c0 tempest-VolumesGetTest-1085601192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:24:46 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0b3ee8c5-15ac-499b-a0ba-5d8c40a3d5c0 tempest-VolumesGetTest-1085601192 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:24:46 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-0b3ee8c5-15ac-499b-a0ba-5d8c40a3d5c0 tempest-VolumesGetTest-1085601192 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:24:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0b3ee8c5-15ac-499b-a0ba-5d8c40a3d5c0 tempest-VolumesGetTest-1085601192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ae454d07-717b-4cb4-927c-c40cf309171c 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:24:47 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c4994b18-f780-4e62-98b7-7a70d8d8c7c2 tempest-VolumeTypesAccessTest-832732465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b6f31d3-6ff2-4a2c-91ee-a512027562a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca00a37c-65c4-4993-b1d2-a54953fee814', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:24:47 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c4994b18-f780-4e62-98b7-7a70d8d8c7c2 tempest-VolumeTypesAccessTest-832732465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7255fdd-d849-49c4-9fb9-bce03d9cc3e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:24:47 devstack sudo[94685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ae454d07-717b-4cb4-927c-c40cf309171c 1073741824 Nov 06 15:24:47 devstack sudo[94685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:24:47 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-c4994b18-f780-4e62-98b7-7a70d8d8c7c2 tempest-VolumeTypesAccessTest-832732465 None] Volume volume-ca00a37c-65c4-4993-b1d2-a54953fee814 (ca00a37c-65c4-4993-b1d2-a54953fee814): created successfully Nov 06 15:24:47 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c4994b18-f780-4e62-98b7-7a70d8d8c7c2 tempest-VolumeTypesAccessTest-832732465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7255fdd-d849-49c4-9fb9-bce03d9cc3e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:24:47 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c4994b18-f780-4e62-98b7-7a70d8d8c7c2 tempest-VolumeTypesAccessTest-832732465 None] Flow 'volume_create_manager' (4f09ec06-d2b7-4a05-9bca-c4b32567fe23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:24:47 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-c4994b18-f780-4e62-98b7-7a70d8d8c7c2 tempest-VolumeTypesAccessTest-832732465 None] Created volume successfully. Nov 06 15:24:47 devstack sudo[94685]: pam_unix(sudo:session): session closed for user root Nov 06 15:24:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0b3ee8c5-15ac-499b-a0ba-5d8c40a3d5c0 tempest-VolumesGetTest-1085601192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ae454d07-717b-4cb4-927c-c40cf309171c 1073741824" returned: 0 in 0.660s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:24:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0b3ee8c5-15ac-499b-a0ba-5d8c40a3d5c0 tempest-VolumesGetTest-1085601192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ae454d07-717b-4cb4-927c-c40cf309171c {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:24:47 devstack sudo[94710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ae454d07-717b-4cb4-927c-c40cf309171c Nov 06 15:24:47 devstack sudo[94710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:24:47 devstack sudo[94710]: pam_unix(sudo:session): session closed for user root Nov 06 15:24:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0b3ee8c5-15ac-499b-a0ba-5d8c40a3d5c0 tempest-VolumesGetTest-1085601192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ae454d07-717b-4cb4-927c-c40cf309171c" returned: 0 in 0.269s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:24:47 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0b3ee8c5-15ac-499b-a0ba-5d8c40a3d5c0 tempest-VolumesGetTest-1085601192 None] <== create_volume: return (974ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:24:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0b3ee8c5-15ac-499b-a0ba-5d8c40a3d5c0 tempest-VolumesGetTest-1085601192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.977s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:24:47 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0b3ee8c5-15ac-499b-a0ba-5d8c40a3d5c0 tempest-VolumesGetTest-1085601192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1fe68ae-1791-4bd7-bd9f-757bd851c58d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae454d07-717b-4cb4-927c-c40cf309171c', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:24:47 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0b3ee8c5-15ac-499b-a0ba-5d8c40a3d5c0 tempest-VolumesGetTest-1085601192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5680c17f-a53e-4f46-970d-85152164c6c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:24:47 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-ece811aa-c99e-4777-a65c-a7d622a4d578 tempest-VolumeTypesAccessTest-832732465 None] Acquiring lock "cinder-ca00a37c-65c4-4993-b1d2-a54953fee814-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:24:48 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-0b3ee8c5-15ac-499b-a0ba-5d8c40a3d5c0 tempest-VolumesGetTest-1085601192 None] Volume volume-ae454d07-717b-4cb4-927c-c40cf309171c (ae454d07-717b-4cb4-927c-c40cf309171c): created successfully Nov 06 15:24:48 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0b3ee8c5-15ac-499b-a0ba-5d8c40a3d5c0 tempest-VolumesGetTest-1085601192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5680c17f-a53e-4f46-970d-85152164c6c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:24:48 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0b3ee8c5-15ac-499b-a0ba-5d8c40a3d5c0 tempest-VolumesGetTest-1085601192 None] Flow 'volume_create_manager' (cf25aa87-14b1-4663-815c-0aeb7cc621ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:24:48 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-ece811aa-c99e-4777-a65c-a7d622a4d578 tempest-VolumeTypesAccessTest-832732465 None] Lock "cinder-ca00a37c-65c4-4993-b1d2-a54953fee814-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:24:48 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-0b3ee8c5-15ac-499b-a0ba-5d8c40a3d5c0 tempest-VolumesGetTest-1085601192 None] Created volume successfully. Nov 06 15:24:48 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-ece811aa-c99e-4777-a65c-a7d622a4d578 tempest-VolumeTypesAccessTest-832732465 None] Acquiring lock "cinder-quobyte-ca00a37c-65c4-4993-b1d2-a54953fee814" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:24:48 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-ece811aa-c99e-4777-a65c-a7d622a4d578 tempest-VolumeTypesAccessTest-832732465 None] Lock "cinder-quobyte-ca00a37c-65c4-4993-b1d2-a54953fee814" acquired by "delete_volume" :: waited 0.023s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:24:48 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aa6eea5-5522-45bc-8db7-6a6d569aa269]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:24:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ece811aa-c99e-4777-a65c-a7d622a4d578 tempest-VolumeTypesAccessTest-832732465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ca00a37c-65c4-4993-b1d2-a54953fee814 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:24:48 devstack sudo[94714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ca00a37c-65c4-4993-b1d2-a54953fee814 Nov 06 15:24:48 devstack sudo[94714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:24:48 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-bc019675-947f-48c1-90fb-a1df39c27b07 req-98e6b53d-43f1-412a-9f0c-99c02e116d0f tempest-TestInstancesWithCinderVolumes-1896526329 None] Terminate volume connection completed successfully. Nov 06 15:24:48 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-bc019675-947f-48c1-90fb-a1df39c27b07 req-98e6b53d-43f1-412a-9f0c-99c02e116d0f tempest-TestInstancesWithCinderVolumes-1896526329 None] Deleting attachment 297bd5e9-4d46-4a9d-890f-5ace482252fd. {{(pid=87132) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 06 15:24:48 devstack sudo[94714]: pam_unix(sudo:session): session closed for user root Nov 06 15:24:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ece811aa-c99e-4777-a65c-a7d622a4d578 tempest-VolumeTypesAccessTest-832732465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ca00a37c-65c4-4993-b1d2-a54953fee814" returned: 0 in 0.421s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:24:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ece811aa-c99e-4777-a65c-a7d622a4d578 tempest-VolumeTypesAccessTest-832732465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ca00a37c-65c4-4993-b1d2-a54953fee814 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:24:48 devstack sudo[94720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ca00a37c-65c4-4993-b1d2-a54953fee814 Nov 06 15:24:48 devstack sudo[94720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:24:48 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a8d70c7a-05b4-4789-aed2-f340f764da14 tempest-VolumesGetTest-1085601192 None] Acquiring lock "cinder-ae454d07-717b-4cb4-927c-c40cf309171c-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:24:48 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a8d70c7a-05b4-4789-aed2-f340f764da14 tempest-VolumesGetTest-1085601192 None] Lock "cinder-ae454d07-717b-4cb4-927c-c40cf309171c-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:24:48 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a8d70c7a-05b4-4789-aed2-f340f764da14 tempest-VolumesGetTest-1085601192 None] Acquiring lock "cinder-quobyte-ae454d07-717b-4cb4-927c-c40cf309171c" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:24:48 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a8d70c7a-05b4-4789-aed2-f340f764da14 tempest-VolumesGetTest-1085601192 None] Lock "cinder-quobyte-ae454d07-717b-4cb4-927c-c40cf309171c" acquired by "delete_volume" :: waited 0.022s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:24:48 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[35e964af-4e5f-4ee7-86db-d6f04cf57800]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:24:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a8d70c7a-05b4-4789-aed2-f340f764da14 tempest-VolumesGetTest-1085601192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ae454d07-717b-4cb4-927c-c40cf309171c {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:24:48 devstack sudo[94720]: pam_unix(sudo:session): session closed for user root Nov 06 15:24:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ece811aa-c99e-4777-a65c-a7d622a4d578 tempest-VolumeTypesAccessTest-832732465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ca00a37c-65c4-4993-b1d2-a54953fee814" returned: 0 in 0.355s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:24:48 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-ece811aa-c99e-4777-a65c-a7d622a4d578 tempest-VolumeTypesAccessTest-832732465 None] Lock "cinder-quobyte-ca00a37c-65c4-4993-b1d2-a54953fee814" released by "delete_volume" :: held 0.839s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:24:49 devstack cinder-volume[87132]: WARNING cinder.quota [None req-ece811aa-c99e-4777-a65c-a7d622a4d578 tempest-VolumeTypesAccessTest-832732465 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-235950172 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-235950172, it is now deprecated. Please use the default quota class for default quota. Nov 06 15:24:49 devstack cinder-volume[87132]: WARNING cinder.quota [None req-ece811aa-c99e-4777-a65c-a7d622a4d578 tempest-VolumeTypesAccessTest-832732465 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-235950172 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-235950172, it is now deprecated. Please use the default quota class for default quota. Nov 06 15:24:49 devstack sudo[94725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ae454d07-717b-4cb4-927c-c40cf309171c Nov 06 15:24:49 devstack sudo[94725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:24:49 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-ece811aa-c99e-4777-a65c-a7d622a4d578 tempest-VolumeTypesAccessTest-832732465 None] Created reservations ['f3a66dc9-f191-42f3-b0c7-10f9bf2c1ad9', '4bb647db-f76b-4e14-aa9f-c037ac66efdb', '5d0a4da7-0ce2-4c68-aa34-6f6bbdc392b7', '1ae77e16-efef-40da-8392-f42b8cde3067'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:24:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ece811aa-c99e-4777-a65c-a7d622a4d578 tempest-VolumeTypesAccessTest-832732465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:24:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ece811aa-c99e-4777-a65c-a7d622a4d578 tempest-VolumeTypesAccessTest-832732465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:24:49 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-ece811aa-c99e-4777-a65c-a7d622a4d578 tempest-VolumeTypesAccessTest-832732465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:24:49 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-ece811aa-c99e-4777-a65c-a7d622a4d578 tempest-VolumeTypesAccessTest-832732465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:24:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ece811aa-c99e-4777-a65c-a7d622a4d578 tempest-VolumeTypesAccessTest-832732465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:24:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ece811aa-c99e-4777-a65c-a7d622a4d578 tempest-VolumeTypesAccessTest-832732465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:24:49 devstack sudo[94728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:24:49 devstack sudo[94728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:24:49 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-7a744ffb-cd06-4402-9ede-17223589b6f1 tempest-TestInstancesWithCinderVolumes-1896526329 None] Acquiring lock "cinder-15eac778-7ea0-42b0-b76a-69e0b9496376-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:24:49 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-7a744ffb-cd06-4402-9ede-17223589b6f1 tempest-TestInstancesWithCinderVolumes-1896526329 None] Lock "cinder-15eac778-7ea0-42b0-b76a-69e0b9496376-delete_volume" acquired by "delete_volume" :: waited 0.074s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:24:49 devstack sudo[94725]: pam_unix(sudo:session): session closed for user root Nov 06 15:24:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a8d70c7a-05b4-4789-aed2-f340f764da14 tempest-VolumesGetTest-1085601192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ae454d07-717b-4cb4-927c-c40cf309171c" returned: 0 in 0.604s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:24:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a8d70c7a-05b4-4789-aed2-f340f764da14 tempest-VolumesGetTest-1085601192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ae454d07-717b-4cb4-927c-c40cf309171c {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:24:49 devstack sudo[94734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ae454d07-717b-4cb4-927c-c40cf309171c Nov 06 15:24:49 devstack sudo[94734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:24:49 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-7a744ffb-cd06-4402-9ede-17223589b6f1 tempest-TestInstancesWithCinderVolumes-1896526329 None] Acquiring lock "cinder-quobyte-15eac778-7ea0-42b0-b76a-69e0b9496376" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:24:49 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-7a744ffb-cd06-4402-9ede-17223589b6f1 tempest-TestInstancesWithCinderVolumes-1896526329 None] Lock "cinder-quobyte-15eac778-7ea0-42b0-b76a-69e0b9496376" acquired by "delete_volume" :: waited 0.023s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:24:49 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[31ce6323-acd4-459e-95b4-cf62853c0f53]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:24:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7a744ffb-cd06-4402-9ede-17223589b6f1 tempest-TestInstancesWithCinderVolumes-1896526329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-15eac778-7ea0-42b0-b76a-69e0b9496376 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:24:49 devstack sudo[94728]: pam_unix(sudo:session): session closed for user root Nov 06 15:24:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ece811aa-c99e-4777-a65c-a7d622a4d578 tempest-VolumeTypesAccessTest-832732465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.553s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:24:49 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-ece811aa-c99e-4777-a65c-a7d622a4d578 tempest-VolumeTypesAccessTest-832732465 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:24:49 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-ece811aa-c99e-4777-a65c-a7d622a4d578 tempest-VolumeTypesAccessTest-832732465 None] Deleted volume successfully. Nov 06 15:24:49 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-ece811aa-c99e-4777-a65c-a7d622a4d578 tempest-VolumeTypesAccessTest-832732465 None] Lock "cinder-ca00a37c-65c4-4993-b1d2-a54953fee814-delete_volume" released by "delete_volume" :: held 1.735s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:24:49 devstack sudo[94739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-15eac778-7ea0-42b0-b76a-69e0b9496376 Nov 06 15:24:49 devstack sudo[94739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:24:50 devstack sudo[94734]: pam_unix(sudo:session): session closed for user root Nov 06 15:24:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a8d70c7a-05b4-4789-aed2-f340f764da14 tempest-VolumesGetTest-1085601192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ae454d07-717b-4cb4-927c-c40cf309171c" returned: 0 in 0.585s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:24:50 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a8d70c7a-05b4-4789-aed2-f340f764da14 tempest-VolumesGetTest-1085601192 None] Lock "cinder-quobyte-ae454d07-717b-4cb4-927c-c40cf309171c" released by "delete_volume" :: held 1.307s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:24:50 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-a8d70c7a-05b4-4789-aed2-f340f764da14 tempest-VolumesGetTest-1085601192 None] Created reservations ['171a471d-7b61-4941-8ed8-9a9aa39e0372', '0bf656a3-16e5-4929-a9be-5c0131d436da', '45ab4f42-c026-44e5-add4-7f233ca64d3c', 'e045a9b8-98eb-4ed7-af1e-b48158a33d53'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:24:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a8d70c7a-05b4-4789-aed2-f340f764da14 tempest-VolumesGetTest-1085601192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:24:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a8d70c7a-05b4-4789-aed2-f340f764da14 tempest-VolumesGetTest-1085601192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:24:50 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-a8d70c7a-05b4-4789-aed2-f340f764da14 tempest-VolumesGetTest-1085601192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:24:50 devstack sudo[94739]: pam_unix(sudo:session): session closed for user root Nov 06 15:24:50 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-a8d70c7a-05b4-4789-aed2-f340f764da14 tempest-VolumesGetTest-1085601192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:24:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a8d70c7a-05b4-4789-aed2-f340f764da14 tempest-VolumesGetTest-1085601192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:24:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a8d70c7a-05b4-4789-aed2-f340f764da14 tempest-VolumesGetTest-1085601192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:24:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7a744ffb-cd06-4402-9ede-17223589b6f1 tempest-TestInstancesWithCinderVolumes-1896526329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-15eac778-7ea0-42b0-b76a-69e0b9496376" returned: 0 in 0.739s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:24:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7a744ffb-cd06-4402-9ede-17223589b6f1 tempest-TestInstancesWithCinderVolumes-1896526329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-15eac778-7ea0-42b0-b76a-69e0b9496376 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:24:50 devstack sudo[94765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:24:50 devstack sudo[94765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:24:50 devstack sudo[94766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-15eac778-7ea0-42b0-b76a-69e0b9496376 Nov 06 15:24:50 devstack sudo[94766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:24:50 devstack sudo[94765]: pam_unix(sudo:session): session closed for user root Nov 06 15:24:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a8d70c7a-05b4-4789-aed2-f340f764da14 tempest-VolumesGetTest-1085601192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.341s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:24:50 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-a8d70c7a-05b4-4789-aed2-f340f764da14 tempest-VolumesGetTest-1085601192 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:24:50 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-a8d70c7a-05b4-4789-aed2-f340f764da14 tempest-VolumesGetTest-1085601192 None] Deleted volume successfully. Nov 06 15:24:50 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a8d70c7a-05b4-4789-aed2-f340f764da14 tempest-VolumesGetTest-1085601192 None] Lock "cinder-ae454d07-717b-4cb4-927c-c40cf309171c-delete_volume" released by "delete_volume" :: held 1.996s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:24:50 devstack sudo[94766]: pam_unix(sudo:session): session closed for user root Nov 06 15:24:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7a744ffb-cd06-4402-9ede-17223589b6f1 tempest-TestInstancesWithCinderVolumes-1896526329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-15eac778-7ea0-42b0-b76a-69e0b9496376" returned: 0 in 0.399s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:24:50 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-7a744ffb-cd06-4402-9ede-17223589b6f1 tempest-TestInstancesWithCinderVolumes-1896526329 None] Lock "cinder-quobyte-15eac778-7ea0-42b0-b76a-69e0b9496376" released by "delete_volume" :: held 1.202s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:24:50 devstack cinder-volume[87132]: WARNING cinder.quota [None req-7a744ffb-cd06-4402-9ede-17223589b6f1 tempest-TestInstancesWithCinderVolumes-1896526329 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-256223307-1120199436 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-256223307-1120199436, it is now deprecated. Please use the default quota class for default quota. Nov 06 15:24:50 devstack cinder-volume[87132]: WARNING cinder.quota [None req-7a744ffb-cd06-4402-9ede-17223589b6f1 tempest-TestInstancesWithCinderVolumes-1896526329 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-256223307-1120199436 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-256223307-1120199436, it is now deprecated. Please use the default quota class for default quota. Nov 06 15:24:50 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-7a744ffb-cd06-4402-9ede-17223589b6f1 tempest-TestInstancesWithCinderVolumes-1896526329 None] Created reservations ['66e783f4-4842-453e-a6f0-baa666d84094', '46d74e00-fcd1-4139-b4a1-7bb6a774d3c7', 'c4b0bb95-756f-456e-8b9a-08ae3f728c37', '06a58c31-76c8-4b57-b868-fd907367dcdd'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:24:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7a744ffb-cd06-4402-9ede-17223589b6f1 tempest-TestInstancesWithCinderVolumes-1896526329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:24:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7a744ffb-cd06-4402-9ede-17223589b6f1 tempest-TestInstancesWithCinderVolumes-1896526329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:24:50 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-7a744ffb-cd06-4402-9ede-17223589b6f1 tempest-TestInstancesWithCinderVolumes-1896526329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:24:50 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-7a744ffb-cd06-4402-9ede-17223589b6f1 tempest-TestInstancesWithCinderVolumes-1896526329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:24:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7a744ffb-cd06-4402-9ede-17223589b6f1 tempest-TestInstancesWithCinderVolumes-1896526329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:24:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7a744ffb-cd06-4402-9ede-17223589b6f1 tempest-TestInstancesWithCinderVolumes-1896526329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:24:51 devstack sudo[94771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:24:51 devstack sudo[94771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:24:51 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-7f520a24-8715-47ed-96fe-80f46c86ddae tempest-VolumesGetTest-1085601192 None] Acquiring lock "cinder-2fd5c268-2cb1-4319-b8ce-b878e0c20325-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:24:51 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-7f520a24-8715-47ed-96fe-80f46c86ddae tempest-VolumesGetTest-1085601192 None] Lock "cinder-2fd5c268-2cb1-4319-b8ce-b878e0c20325-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:24:51 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-7f520a24-8715-47ed-96fe-80f46c86ddae tempest-VolumesGetTest-1085601192 None] Acquiring lock "cinder-quobyte-2fd5c268-2cb1-4319-b8ce-b878e0c20325" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:24:51 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-7f520a24-8715-47ed-96fe-80f46c86ddae tempest-VolumesGetTest-1085601192 None] Lock "cinder-quobyte-2fd5c268-2cb1-4319-b8ce-b878e0c20325" acquired by "delete_volume" :: waited 0.026s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:24:51 devstack sudo[94771]: pam_unix(sudo:session): session closed for user root Nov 06 15:24:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7a744ffb-cd06-4402-9ede-17223589b6f1 tempest-TestInstancesWithCinderVolumes-1896526329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.431s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:24:51 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-7a744ffb-cd06-4402-9ede-17223589b6f1 tempest-TestInstancesWithCinderVolumes-1896526329 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:24:51 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecf781a4-7fc7-4bc6-b6fa-6debf79b3f74]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:24:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7f520a24-8715-47ed-96fe-80f46c86ddae tempest-VolumesGetTest-1085601192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-2fd5c268-2cb1-4319-b8ce-b878e0c20325 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:24:51 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-7a744ffb-cd06-4402-9ede-17223589b6f1 tempest-TestInstancesWithCinderVolumes-1896526329 None] Deleted volume successfully. Nov 06 15:24:51 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-7a744ffb-cd06-4402-9ede-17223589b6f1 tempest-TestInstancesWithCinderVolumes-1896526329 None] Lock "cinder-15eac778-7ea0-42b0-b76a-69e0b9496376-delete_volume" released by "delete_volume" :: held 2.006s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:24:51 devstack sudo[94775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-2fd5c268-2cb1-4319-b8ce-b878e0c20325 Nov 06 15:24:51 devstack sudo[94775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:24:51 devstack sudo[94775]: pam_unix(sudo:session): session closed for user root Nov 06 15:24:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7f520a24-8715-47ed-96fe-80f46c86ddae tempest-VolumesGetTest-1085601192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-2fd5c268-2cb1-4319-b8ce-b878e0c20325" returned: 0 in 0.548s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:24:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7f520a24-8715-47ed-96fe-80f46c86ddae tempest-VolumesGetTest-1085601192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-2fd5c268-2cb1-4319-b8ce-b878e0c20325 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:24:52 devstack sudo[94817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-2fd5c268-2cb1-4319-b8ce-b878e0c20325 Nov 06 15:24:52 devstack sudo[94817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:24:52 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-e1fa6d97-137c-49ba-95e8-ac6b3637e5b9 req-2b5d09a2-fe4b-40cf-9be8-f0367d501314 tempest-ServerActionsTestOtherA-1409404420 None] Terminate volume connection completed successfully. Nov 06 15:24:52 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-e1fa6d97-137c-49ba-95e8-ac6b3637e5b9 req-2b5d09a2-fe4b-40cf-9be8-f0367d501314 tempest-ServerActionsTestOtherA-1409404420 None] Deleting attachment 7a536239-5947-4011-b45b-48b82bd0b3a4. {{(pid=87132) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 06 15:24:52 devstack sudo[94817]: pam_unix(sudo:session): session closed for user root Nov 06 15:24:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7f520a24-8715-47ed-96fe-80f46c86ddae tempest-VolumesGetTest-1085601192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-2fd5c268-2cb1-4319-b8ce-b878e0c20325" returned: 0 in 0.459s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:24:52 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-7f520a24-8715-47ed-96fe-80f46c86ddae tempest-VolumesGetTest-1085601192 None] Lock "cinder-quobyte-2fd5c268-2cb1-4319-b8ce-b878e0c20325" released by "delete_volume" :: held 1.081s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:24:52 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-7f520a24-8715-47ed-96fe-80f46c86ddae tempest-VolumesGetTest-1085601192 None] Created reservations ['f68d5975-4135-45a8-8e97-e2e08507e010', 'c24d2f56-3727-4043-9a92-2318a9635a5c', '864f15f3-d2c5-434f-96fb-1284a4d0f62d', '3307de45-3f2c-4a1e-85a9-0259c876293d'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:24:52 devstack cinder-volume[87132]: DEBUG cinder.coordination [req-e1fa6d97-137c-49ba-95e8-ac6b3637e5b9 req-c6f3afe4-1586-40f3-9934-0704bcd0d312 tempest-ServerActionsTestOtherA-1409404420 None] Acquiring lock "cinder-9a321d18-d577-47b6-b042-a4bf84eb92a7-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:24:52 devstack cinder-volume[87132]: DEBUG cinder.coordination [req-e1fa6d97-137c-49ba-95e8-ac6b3637e5b9 req-c6f3afe4-1586-40f3-9934-0704bcd0d312 tempest-ServerActionsTestOtherA-1409404420 None] Lock "cinder-9a321d18-d577-47b6-b042-a4bf84eb92a7-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:24:52 devstack cinder-volume[87132]: DEBUG cinder.coordination [req-e1fa6d97-137c-49ba-95e8-ac6b3637e5b9 req-c6f3afe4-1586-40f3-9934-0704bcd0d312 tempest-ServerActionsTestOtherA-1409404420 None] Acquiring lock "cinder-quobyte-9a321d18-d577-47b6-b042-a4bf84eb92a7" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:24:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7f520a24-8715-47ed-96fe-80f46c86ddae tempest-VolumesGetTest-1085601192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:24:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7f520a24-8715-47ed-96fe-80f46c86ddae tempest-VolumesGetTest-1085601192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:24:52 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-7f520a24-8715-47ed-96fe-80f46c86ddae tempest-VolumesGetTest-1085601192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:24:52 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-7f520a24-8715-47ed-96fe-80f46c86ddae tempest-VolumesGetTest-1085601192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:24:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7f520a24-8715-47ed-96fe-80f46c86ddae tempest-VolumesGetTest-1085601192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:24:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7f520a24-8715-47ed-96fe-80f46c86ddae tempest-VolumesGetTest-1085601192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:24:52 devstack cinder-volume[87132]: DEBUG cinder.coordination [req-e1fa6d97-137c-49ba-95e8-ac6b3637e5b9 req-c6f3afe4-1586-40f3-9934-0704bcd0d312 tempest-ServerActionsTestOtherA-1409404420 None] Lock "cinder-quobyte-9a321d18-d577-47b6-b042-a4bf84eb92a7" acquired by "delete_volume" :: waited 0.073s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:24:52 devstack sudo[94823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:24:52 devstack sudo[94823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:24:52 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[f99baaf1-ef54-45ae-bde4-4a8c46e969b9]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:24:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-e1fa6d97-137c-49ba-95e8-ac6b3637e5b9 req-c6f3afe4-1586-40f3-9934-0704bcd0d312 tempest-ServerActionsTestOtherA-1409404420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-9a321d18-d577-47b6-b042-a4bf84eb92a7 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:24:52 devstack sudo[94825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-9a321d18-d577-47b6-b042-a4bf84eb92a7 Nov 06 15:24:53 devstack sudo[94825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:24:53 devstack sudo[94823]: pam_unix(sudo:session): session closed for user root Nov 06 15:24:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7f520a24-8715-47ed-96fe-80f46c86ddae tempest-VolumesGetTest-1085601192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.428s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:24:53 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-7f520a24-8715-47ed-96fe-80f46c86ddae tempest-VolumesGetTest-1085601192 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:24:53 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-7f520a24-8715-47ed-96fe-80f46c86ddae tempest-VolumesGetTest-1085601192 None] Deleted volume successfully. Nov 06 15:24:53 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-7f520a24-8715-47ed-96fe-80f46c86ddae tempest-VolumesGetTest-1085601192 None] Lock "cinder-2fd5c268-2cb1-4319-b8ce-b878e0c20325-delete_volume" released by "delete_volume" :: held 1.897s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:24:53 devstack sudo[94825]: pam_unix(sudo:session): session closed for user root Nov 06 15:24:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-e1fa6d97-137c-49ba-95e8-ac6b3637e5b9 req-c6f3afe4-1586-40f3-9934-0704bcd0d312 tempest-ServerActionsTestOtherA-1409404420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-9a321d18-d577-47b6-b042-a4bf84eb92a7" returned: 0 in 0.564s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:24:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-e1fa6d97-137c-49ba-95e8-ac6b3637e5b9 req-c6f3afe4-1586-40f3-9934-0704bcd0d312 tempest-ServerActionsTestOtherA-1409404420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-9a321d18-d577-47b6-b042-a4bf84eb92a7 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:24:53 devstack sudo[94831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-9a321d18-d577-47b6-b042-a4bf84eb92a7 Nov 06 15:24:53 devstack sudo[94831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:24:53 devstack sudo[94831]: pam_unix(sudo:session): session closed for user root Nov 06 15:24:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-e1fa6d97-137c-49ba-95e8-ac6b3637e5b9 req-c6f3afe4-1586-40f3-9934-0704bcd0d312 tempest-ServerActionsTestOtherA-1409404420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-9a321d18-d577-47b6-b042-a4bf84eb92a7" returned: 0 in 0.419s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:24:53 devstack cinder-volume[87132]: DEBUG cinder.coordination [req-e1fa6d97-137c-49ba-95e8-ac6b3637e5b9 req-c6f3afe4-1586-40f3-9934-0704bcd0d312 tempest-ServerActionsTestOtherA-1409404420 None] Lock "cinder-quobyte-9a321d18-d577-47b6-b042-a4bf84eb92a7" released by "delete_volume" :: held 1.060s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:24:53 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-ede27286-94da-4499-a926-0d6076f356cb tempest-ServerActionsTestOtherA-1409404420 None] Acquiring lock "cinder-135c21e6-615b-4d80-81f0-bfac6e82d15c-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:24:53 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-ede27286-94da-4499-a926-0d6076f356cb tempest-ServerActionsTestOtherA-1409404420 None] Lock "cinder-135c21e6-615b-4d80-81f0-bfac6e82d15c-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:24:53 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-ede27286-94da-4499-a926-0d6076f356cb tempest-ServerActionsTestOtherA-1409404420 None] Acquiring lock "cinder-quobyte-135c21e6-615b-4d80-81f0-bfac6e82d15c" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:24:53 devstack cinder-volume[87132]: DEBUG cinder.quota [req-e1fa6d97-137c-49ba-95e8-ac6b3637e5b9 req-c6f3afe4-1586-40f3-9934-0704bcd0d312 tempest-ServerActionsTestOtherA-1409404420 None] Created reservations ['6ace045b-cbaf-4ef0-9dcf-ec0a7861babc', '180e9a88-99e5-4cdf-a6c3-944f3d233590', 'd8627cfb-3adc-4397-8e65-c661c54b344f', 'd5f40c34-813d-4f1a-8eaa-642823fed034'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:24:53 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-ede27286-94da-4499-a926-0d6076f356cb tempest-ServerActionsTestOtherA-1409404420 None] Lock "cinder-quobyte-135c21e6-615b-4d80-81f0-bfac6e82d15c" acquired by "delete_volume" :: waited 0.036s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:24:54 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[db59833a-a6f3-4973-9a01-673a5bf03128]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:24:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ede27286-94da-4499-a926-0d6076f356cb tempest-ServerActionsTestOtherA-1409404420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-135c21e6-615b-4d80-81f0-bfac6e82d15c {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:24:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-e1fa6d97-137c-49ba-95e8-ac6b3637e5b9 req-c6f3afe4-1586-40f3-9934-0704bcd0d312 tempest-ServerActionsTestOtherA-1409404420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:24:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-e1fa6d97-137c-49ba-95e8-ac6b3637e5b9 req-c6f3afe4-1586-40f3-9934-0704bcd0d312 tempest-ServerActionsTestOtherA-1409404420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:24:54 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [req-e1fa6d97-137c-49ba-95e8-ac6b3637e5b9 req-c6f3afe4-1586-40f3-9934-0704bcd0d312 tempest-ServerActionsTestOtherA-1409404420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:24:54 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [req-e1fa6d97-137c-49ba-95e8-ac6b3637e5b9 req-c6f3afe4-1586-40f3-9934-0704bcd0d312 tempest-ServerActionsTestOtherA-1409404420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:24:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-e1fa6d97-137c-49ba-95e8-ac6b3637e5b9 req-c6f3afe4-1586-40f3-9934-0704bcd0d312 tempest-ServerActionsTestOtherA-1409404420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:24:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-e1fa6d97-137c-49ba-95e8-ac6b3637e5b9 req-c6f3afe4-1586-40f3-9934-0704bcd0d312 tempest-ServerActionsTestOtherA-1409404420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:24:54 devstack sudo[94834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-135c21e6-615b-4d80-81f0-bfac6e82d15c Nov 06 15:24:54 devstack sudo[94834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:24:54 devstack sudo[94835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:24:54 devstack sudo[94835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:24:54 devstack sudo[94835]: pam_unix(sudo:session): session closed for user root Nov 06 15:24:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-e1fa6d97-137c-49ba-95e8-ac6b3637e5b9 req-c6f3afe4-1586-40f3-9934-0704bcd0d312 tempest-ServerActionsTestOtherA-1409404420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.411s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:24:54 devstack cinder-volume[87132]: DEBUG cinder.manager [req-e1fa6d97-137c-49ba-95e8-ac6b3637e5b9 req-c6f3afe4-1586-40f3-9934-0704bcd0d312 tempest-ServerActionsTestOtherA-1409404420 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:24:54 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-e1fa6d97-137c-49ba-95e8-ac6b3637e5b9 req-c6f3afe4-1586-40f3-9934-0704bcd0d312 tempest-ServerActionsTestOtherA-1409404420 None] Deleted volume successfully. Nov 06 15:24:54 devstack cinder-volume[87132]: DEBUG cinder.coordination [req-e1fa6d97-137c-49ba-95e8-ac6b3637e5b9 req-c6f3afe4-1586-40f3-9934-0704bcd0d312 tempest-ServerActionsTestOtherA-1409404420 None] Lock "cinder-9a321d18-d577-47b6-b042-a4bf84eb92a7-delete_volume" released by "delete_volume" :: held 2.006s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:24:54 devstack sudo[94834]: pam_unix(sudo:session): session closed for user root Nov 06 15:24:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ede27286-94da-4499-a926-0d6076f356cb tempest-ServerActionsTestOtherA-1409404420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-135c21e6-615b-4d80-81f0-bfac6e82d15c" returned: 0 in 0.609s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:24:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ede27286-94da-4499-a926-0d6076f356cb tempest-ServerActionsTestOtherA-1409404420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-135c21e6-615b-4d80-81f0-bfac6e82d15c {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:24:54 devstack sudo[94842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-135c21e6-615b-4d80-81f0-bfac6e82d15c Nov 06 15:24:54 devstack sudo[94842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:24:54 devstack sudo[94842]: pam_unix(sudo:session): session closed for user root Nov 06 15:24:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ede27286-94da-4499-a926-0d6076f356cb tempest-ServerActionsTestOtherA-1409404420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-135c21e6-615b-4d80-81f0-bfac6e82d15c" returned: 0 in 0.291s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:24:54 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-ede27286-94da-4499-a926-0d6076f356cb tempest-ServerActionsTestOtherA-1409404420 None] Lock "cinder-quobyte-135c21e6-615b-4d80-81f0-bfac6e82d15c" released by "delete_volume" :: held 0.969s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:24:54 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-ede27286-94da-4499-a926-0d6076f356cb tempest-ServerActionsTestOtherA-1409404420 None] Created reservations ['e38f76c0-f787-4ebc-8239-a6afe79a8939', '5586bc41-01d2-4372-a996-6794cea3872c', 'f5f67b70-d823-4a17-b393-8169b7fa1192', '902a7383-784f-40b9-ab2d-653c70d322a5'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:24:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ede27286-94da-4499-a926-0d6076f356cb tempest-ServerActionsTestOtherA-1409404420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:24:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ede27286-94da-4499-a926-0d6076f356cb tempest-ServerActionsTestOtherA-1409404420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:24:55 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-ede27286-94da-4499-a926-0d6076f356cb tempest-ServerActionsTestOtherA-1409404420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:24:55 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-ede27286-94da-4499-a926-0d6076f356cb tempest-ServerActionsTestOtherA-1409404420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:24:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ede27286-94da-4499-a926-0d6076f356cb tempest-ServerActionsTestOtherA-1409404420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:24:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ede27286-94da-4499-a926-0d6076f356cb tempest-ServerActionsTestOtherA-1409404420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:24:55 devstack sudo[94846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:24:55 devstack sudo[94846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:24:55 devstack sudo[94846]: pam_unix(sudo:session): session closed for user root Nov 06 15:24:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ede27286-94da-4499-a926-0d6076f356cb tempest-ServerActionsTestOtherA-1409404420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.332s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:24:55 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-ede27286-94da-4499-a926-0d6076f356cb tempest-ServerActionsTestOtherA-1409404420 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:24:55 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-ede27286-94da-4499-a926-0d6076f356cb tempest-ServerActionsTestOtherA-1409404420 None] Deleted volume successfully. Nov 06 15:24:55 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-ede27286-94da-4499-a926-0d6076f356cb tempest-ServerActionsTestOtherA-1409404420 None] Lock "cinder-135c21e6-615b-4d80-81f0-bfac6e82d15c-delete_volume" released by "delete_volume" :: held 1.602s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:25:05 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:UPDATE=149,cinder:SELECT=136,cinder:INSERT=46,cinder:DELETE=11 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 15:25:05 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:UPDATE=126,cinder:SELECT=103,cinder:DELETE=10,cinder:INSERT=31 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 15:25:08 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 15:25:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:25:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:25:08 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:25:08 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:25:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:25:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:25:08 devstack sudo[94892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:25:08 devstack sudo[94892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:25:08 devstack sudo[94892]: pam_unix(sudo:session): session closed for user root Nov 06 15:25:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.283s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:25:08 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:25:08 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Running periodic task VolumeManager._thread_info {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 15:25:08 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] thread count: 28 {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 15:25:08 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] thread info: [<_MainThread(MainThread, started 140011251929216)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 06 15:25:15 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc762632-95e2-4ab8-aa8c-0cf3ecafc3a7 tempest-VolumesSnapshotTestJSON-1486814120 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:25:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-bc762632-95e2-4ab8-aa8c-0cf3ecafc3a7 tempest-VolumesSnapshotTestJSON-1486814120 None] Flow 'volume_create_manager' (84b54081-deed-4aa3-8ddf-612526dd257f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:25:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-bc762632-95e2-4ab8-aa8c-0cf3ecafc3a7 tempest-VolumesSnapshotTestJSON-1486814120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee3ab380-708f-4fc8-bb68-6421854ec86d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:25:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-bc762632-95e2-4ab8-aa8c-0cf3ecafc3a7 tempest-VolumesSnapshotTestJSON-1486814120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee3ab380-708f-4fc8-bb68-6421854ec86d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:25:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-533238087',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bee140f-e644-4471-ac56-226e3d79ff97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d46a704379244812b425cfa29943fdb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:25:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:25:15Z,use_quota=True,user_id='481d1eaabb624d6c958d88d08f23e8fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:25:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-bc762632-95e2-4ab8-aa8c-0cf3ecafc3a7 tempest-VolumesSnapshotTestJSON-1486814120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76b5ad23-761b-4d4b-9262-b799a5dfde21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:25:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-bc762632-95e2-4ab8-aa8c-0cf3ecafc3a7 tempest-VolumesSnapshotTestJSON-1486814120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76b5ad23-761b-4d4b-9262-b799a5dfde21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:25:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-bc762632-95e2-4ab8-aa8c-0cf3ecafc3a7 tempest-VolumesSnapshotTestJSON-1486814120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d806165c-a27d-4510-9264-417c179c1b6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:25:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-bc762632-95e2-4ab8-aa8c-0cf3ecafc3a7 tempest-VolumesSnapshotTestJSON-1486814120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d806165c-a27d-4510-9264-417c179c1b6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2bee140f-e644-4471-ac56-226e3d79ff97', 'volume_name': 'volume-2bee140f-e644-4471-ac56-226e3d79ff97', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:25:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-bc762632-95e2-4ab8-aa8c-0cf3ecafc3a7 tempest-VolumesSnapshotTestJSON-1486814120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5e92f87-bd8e-4b85-8200-c2710b1a8423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:25:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-bc762632-95e2-4ab8-aa8c-0cf3ecafc3a7 tempest-VolumesSnapshotTestJSON-1486814120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5e92f87-bd8e-4b85-8200-c2710b1a8423) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:25:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-bc762632-95e2-4ab8-aa8c-0cf3ecafc3a7 tempest-VolumesSnapshotTestJSON-1486814120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97da6235-ef51-46c1-af12-6fe43ab4ac15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:25:15 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-bc762632-95e2-4ab8-aa8c-0cf3ecafc3a7 tempest-VolumesSnapshotTestJSON-1486814120 None] Volume 2bee140f-e644-4471-ac56-226e3d79ff97: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2bee140f-e644-4471-ac56-226e3d79ff97', 'volume_size': 1} Nov 06 15:25:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-bc762632-95e2-4ab8-aa8c-0cf3ecafc3a7 tempest-VolumesSnapshotTestJSON-1486814120 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:25:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-bc762632-95e2-4ab8-aa8c-0cf3ecafc3a7 tempest-VolumesSnapshotTestJSON-1486814120 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:25:15 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-bc762632-95e2-4ab8-aa8c-0cf3ecafc3a7 tempest-VolumesSnapshotTestJSON-1486814120 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:25:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-533238087',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bee140f-e644-4471-ac56-226e3d79ff97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d46a704379244812b425cfa29943fdb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:25:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:25:15Z,use_quota=True,user_id='481d1eaabb624d6c958d88d08f23e8fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:25:15 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-bc762632-95e2-4ab8-aa8c-0cf3ecafc3a7 tempest-VolumesSnapshotTestJSON-1486814120 None] Creating volume 2bee140f-e644-4471-ac56-226e3d79ff97 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:25:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-bc762632-95e2-4ab8-aa8c-0cf3ecafc3a7 tempest-VolumesSnapshotTestJSON-1486814120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:25:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-bc762632-95e2-4ab8-aa8c-0cf3ecafc3a7 tempest-VolumesSnapshotTestJSON-1486814120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:25:15 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-bc762632-95e2-4ab8-aa8c-0cf3ecafc3a7 tempest-VolumesSnapshotTestJSON-1486814120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:25:15 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-bc762632-95e2-4ab8-aa8c-0cf3ecafc3a7 tempest-VolumesSnapshotTestJSON-1486814120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:25:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-bc762632-95e2-4ab8-aa8c-0cf3ecafc3a7 tempest-VolumesSnapshotTestJSON-1486814120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:25:15 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-bc762632-95e2-4ab8-aa8c-0cf3ecafc3a7 tempest-VolumesSnapshotTestJSON-1486814120 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:25:15 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-bc762632-95e2-4ab8-aa8c-0cf3ecafc3a7 tempest-VolumesSnapshotTestJSON-1486814120 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:25:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bc762632-95e2-4ab8-aa8c-0cf3ecafc3a7 tempest-VolumesSnapshotTestJSON-1486814120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-2bee140f-e644-4471-ac56-226e3d79ff97 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:25:15 devstack sudo[94899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-2bee140f-e644-4471-ac56-226e3d79ff97 1073741824 Nov 06 15:25:15 devstack sudo[94899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:25:15 devstack sudo[94899]: pam_unix(sudo:session): session closed for user root Nov 06 15:25:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bc762632-95e2-4ab8-aa8c-0cf3ecafc3a7 tempest-VolumesSnapshotTestJSON-1486814120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-2bee140f-e644-4471-ac56-226e3d79ff97 1073741824" returned: 0 in 0.452s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:25:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bc762632-95e2-4ab8-aa8c-0cf3ecafc3a7 tempest-VolumesSnapshotTestJSON-1486814120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-2bee140f-e644-4471-ac56-226e3d79ff97 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:25:15 devstack sudo[94904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-2bee140f-e644-4471-ac56-226e3d79ff97 Nov 06 15:25:15 devstack sudo[94904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:25:16 devstack sudo[94904]: pam_unix(sudo:session): session closed for user root Nov 06 15:25:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bc762632-95e2-4ab8-aa8c-0cf3ecafc3a7 tempest-VolumesSnapshotTestJSON-1486814120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-2bee140f-e644-4471-ac56-226e3d79ff97" returned: 0 in 0.378s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:25:16 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-bc762632-95e2-4ab8-aa8c-0cf3ecafc3a7 tempest-VolumesSnapshotTestJSON-1486814120 None] <== create_volume: return (884ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:25:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-bc762632-95e2-4ab8-aa8c-0cf3ecafc3a7 tempest-VolumesSnapshotTestJSON-1486814120 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.887s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:25:16 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-bc762632-95e2-4ab8-aa8c-0cf3ecafc3a7 tempest-VolumesSnapshotTestJSON-1486814120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97da6235-ef51-46c1-af12-6fe43ab4ac15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2bee140f-e644-4471-ac56-226e3d79ff97', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:25:16 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-bc762632-95e2-4ab8-aa8c-0cf3ecafc3a7 tempest-VolumesSnapshotTestJSON-1486814120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (772b524c-a068-4217-bfbf-598bb9107f98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:25:16 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-bc762632-95e2-4ab8-aa8c-0cf3ecafc3a7 tempest-VolumesSnapshotTestJSON-1486814120 None] Volume volume-2bee140f-e644-4471-ac56-226e3d79ff97 (2bee140f-e644-4471-ac56-226e3d79ff97): created successfully Nov 06 15:25:16 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-bc762632-95e2-4ab8-aa8c-0cf3ecafc3a7 tempest-VolumesSnapshotTestJSON-1486814120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (772b524c-a068-4217-bfbf-598bb9107f98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:25:16 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-bc762632-95e2-4ab8-aa8c-0cf3ecafc3a7 tempest-VolumesSnapshotTestJSON-1486814120 None] Flow 'volume_create_manager' (84b54081-deed-4aa3-8ddf-612526dd257f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:25:16 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-bc762632-95e2-4ab8-aa8c-0cf3ecafc3a7 tempest-VolumesSnapshotTestJSON-1486814120 None] Created volume successfully. Nov 06 15:25:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e0528e19-dfa1-444f-9f01-f23d4dbd9ee2 tempest-VolumesSnapshotTestJSON-1486814120 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:25:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e0528e19-dfa1-444f-9f01-f23d4dbd9ee2 tempest-VolumesSnapshotTestJSON-1486814120 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:25:17 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-e0528e19-dfa1-444f-9f01-f23d4dbd9ee2 tempest-VolumesSnapshotTestJSON-1486814120 None] Creating offline snapshot 07ac2c2b-e084-449b-9e7e-78dd1f10a8a9 of volume 2bee140f-e644-4471-ac56-226e3d79ff97 {{(pid=87132) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 15:25:17 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[16f662d1-12ab-42cd-8543-9ce92aeeca0a]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:25:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e0528e19-dfa1-444f-9f01-f23d4dbd9ee2 tempest-VolumesSnapshotTestJSON-1486814120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-2bee140f-e644-4471-ac56-226e3d79ff97 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:25:18 devstack sudo[95323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-2bee140f-e644-4471-ac56-226e3d79ff97 Nov 06 15:25:18 devstack sudo[95323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:25:18 devstack sudo[95323]: pam_unix(sudo:session): session closed for user root Nov 06 15:25:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e0528e19-dfa1-444f-9f01-f23d4dbd9ee2 tempest-VolumesSnapshotTestJSON-1486814120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-2bee140f-e644-4471-ac56-226e3d79ff97" returned: 0 in 0.485s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:25:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e0528e19-dfa1-444f-9f01-f23d4dbd9ee2 tempest-VolumesSnapshotTestJSON-1486814120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-2bee140f-e644-4471-ac56-226e3d79ff97,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-2bee140f-e644-4471-ac56-226e3d79ff97.07ac2c2b-e084-449b-9e7e-78dd1f10a8a9 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:25:18 devstack sudo[95328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-2bee140f-e644-4471-ac56-226e3d79ff97,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-2bee140f-e644-4471-ac56-226e3d79ff97.07ac2c2b-e084-449b-9e7e-78dd1f10a8a9 1G Nov 06 15:25:18 devstack sudo[95328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:25:19 devstack sudo[95328]: pam_unix(sudo:session): session closed for user root Nov 06 15:25:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e0528e19-dfa1-444f-9f01-f23d4dbd9ee2 tempest-VolumesSnapshotTestJSON-1486814120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-2bee140f-e644-4471-ac56-226e3d79ff97,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-2bee140f-e644-4471-ac56-226e3d79ff97.07ac2c2b-e084-449b-9e7e-78dd1f10a8a9 1G" returned: 0 in 0.622s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:25:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e0528e19-dfa1-444f-9f01-f23d4dbd9ee2 tempest-VolumesSnapshotTestJSON-1486814120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2bee140f-e644-4471-ac56-226e3d79ff97 -F qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-2bee140f-e644-4471-ac56-226e3d79ff97.07ac2c2b-e084-449b-9e7e-78dd1f10a8a9 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:25:19 devstack sudo[95335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2bee140f-e644-4471-ac56-226e3d79ff97 -F qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-2bee140f-e644-4471-ac56-226e3d79ff97.07ac2c2b-e084-449b-9e7e-78dd1f10a8a9 Nov 06 15:25:19 devstack sudo[95335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:25:19 devstack sudo[95335]: pam_unix(sudo:session): session closed for user root Nov 06 15:25:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e0528e19-dfa1-444f-9f01-f23d4dbd9ee2 tempest-VolumesSnapshotTestJSON-1486814120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2bee140f-e644-4471-ac56-226e3d79ff97 -F qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-2bee140f-e644-4471-ac56-226e3d79ff97.07ac2c2b-e084-449b-9e7e-78dd1f10a8a9" returned: 0 in 0.462s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:25:19 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-e0528e19-dfa1-444f-9f01-f23d4dbd9ee2 tempest-VolumesSnapshotTestJSON-1486814120 None] /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-2bee140f-e644-4471-ac56-226e3d79ff97.07ac2c2b-e084-449b-9e7e-78dd1f10a8a9 is being set with open permissions: ugo+rw Nov 06 15:25:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e0528e19-dfa1-444f-9f01-f23d4dbd9ee2 tempest-VolumesSnapshotTestJSON-1486814120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-2bee140f-e644-4471-ac56-226e3d79ff97.07ac2c2b-e084-449b-9e7e-78dd1f10a8a9 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:25:19 devstack sudo[95340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-2bee140f-e644-4471-ac56-226e3d79ff97.07ac2c2b-e084-449b-9e7e-78dd1f10a8a9 Nov 06 15:25:19 devstack sudo[95340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:25:19 devstack sudo[95340]: pam_unix(sudo:session): session closed for user root Nov 06 15:25:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e0528e19-dfa1-444f-9f01-f23d4dbd9ee2 tempest-VolumesSnapshotTestJSON-1486814120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-2bee140f-e644-4471-ac56-226e3d79ff97.07ac2c2b-e084-449b-9e7e-78dd1f10a8a9" returned: 0 in 0.376s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:25:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e0528e19-dfa1-444f-9f01-f23d4dbd9ee2 tempest-VolumesSnapshotTestJSON-1486814120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-2bee140f-e644-4471-ac56-226e3d79ff97.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:25:20 devstack sudo[95343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-2bee140f-e644-4471-ac56-226e3d79ff97.info Nov 06 15:25:20 devstack sudo[95343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:25:20 devstack sudo[95343]: pam_unix(sudo:session): session closed for user root Nov 06 15:25:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e0528e19-dfa1-444f-9f01-f23d4dbd9ee2 tempest-VolumesSnapshotTestJSON-1486814120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-2bee140f-e644-4471-ac56-226e3d79ff97.info" returned: 0 in 0.307s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:25:20 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-e0528e19-dfa1-444f-9f01-f23d4dbd9ee2 tempest-VolumesSnapshotTestJSON-1486814120 None] /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-2bee140f-e644-4471-ac56-226e3d79ff97.info is being set with open permissions: ugo+rw Nov 06 15:25:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e0528e19-dfa1-444f-9f01-f23d4dbd9ee2 tempest-VolumesSnapshotTestJSON-1486814120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-2bee140f-e644-4471-ac56-226e3d79ff97.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:25:20 devstack sudo[95346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-2bee140f-e644-4471-ac56-226e3d79ff97.info Nov 06 15:25:20 devstack sudo[95346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:25:20 devstack sudo[95346]: pam_unix(sudo:session): session closed for user root Nov 06 15:25:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e0528e19-dfa1-444f-9f01-f23d4dbd9ee2 tempest-VolumesSnapshotTestJSON-1486814120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-2bee140f-e644-4471-ac56-226e3d79ff97.info" returned: 0 in 0.291s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:25:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e0528e19-dfa1-444f-9f01-f23d4dbd9ee2 tempest-VolumesSnapshotTestJSON-1486814120 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.706s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:25:20 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-e0528e19-dfa1-444f-9f01-f23d4dbd9ee2 tempest-VolumesSnapshotTestJSON-1486814120 None] Create snapshot completed successfully Nov 06 15:25:21 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-54304985-2aa0-4f91-b53e-2fdadd2939cb tempest-VolumesSnapshotTestJSON-1486814120 None] Acquiring lock "cinder-07ac2c2b-e084-449b-9e7e-78dd1f10a8a9-delete_snapshot" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:25:21 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-54304985-2aa0-4f91-b53e-2fdadd2939cb tempest-VolumesSnapshotTestJSON-1486814120 None] Lock "cinder-07ac2c2b-e084-449b-9e7e-78dd1f10a8a9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:25:21 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-54304985-2aa0-4f91-b53e-2fdadd2939cb tempest-VolumesSnapshotTestJSON-1486814120 None] Acquiring lock "cinder-quobyte-2bee140f-e644-4471-ac56-226e3d79ff97" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:25:21 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-54304985-2aa0-4f91-b53e-2fdadd2939cb tempest-VolumesSnapshotTestJSON-1486814120 None] Lock "cinder-quobyte-2bee140f-e644-4471-ac56-226e3d79ff97" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:25:21 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-54304985-2aa0-4f91-b53e-2fdadd2939cb tempest-VolumesSnapshotTestJSON-1486814120 None] Acquiring lock "cinder-quobyte-07ac2c2b-e084-449b-9e7e-78dd1f10a8a9" by "_delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:25:21 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-54304985-2aa0-4f91-b53e-2fdadd2939cb tempest-VolumesSnapshotTestJSON-1486814120 None] Lock "cinder-quobyte-07ac2c2b-e084-449b-9e7e-78dd1f10a8a9" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:25:21 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-54304985-2aa0-4f91-b53e-2fdadd2939cb tempest-VolumesSnapshotTestJSON-1486814120 None] Deleting offline snapshot 07ac2c2b-e084-449b-9e7e-78dd1f10a8a9 of volume 2bee140f-e644-4471-ac56-226e3d79ff97 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 15:25:21 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-54304985-2aa0-4f91-b53e-2fdadd2939cb tempest-VolumesSnapshotTestJSON-1486814120 None] snapshot_file for this snap is: volume-2bee140f-e644-4471-ac56-226e3d79ff97.07ac2c2b-e084-449b-9e7e-78dd1f10a8a9 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 15:25:21 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9cc3912-7baf-4529-9a27-29e7252f7494]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:25:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-54304985-2aa0-4f91-b53e-2fdadd2939cb tempest-VolumesSnapshotTestJSON-1486814120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-2bee140f-e644-4471-ac56-226e3d79ff97.07ac2c2b-e084-449b-9e7e-78dd1f10a8a9 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:25:21 devstack sudo[95349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-2bee140f-e644-4471-ac56-226e3d79ff97.07ac2c2b-e084-449b-9e7e-78dd1f10a8a9 Nov 06 15:25:21 devstack sudo[95349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:25:22 devstack sudo[95349]: pam_unix(sudo:session): session closed for user root Nov 06 15:25:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-54304985-2aa0-4f91-b53e-2fdadd2939cb tempest-VolumesSnapshotTestJSON-1486814120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-2bee140f-e644-4471-ac56-226e3d79ff97.07ac2c2b-e084-449b-9e7e-78dd1f10a8a9" returned: 0 in 0.508s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:25:22 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-54304985-2aa0-4f91-b53e-2fdadd2939cb tempest-VolumesSnapshotTestJSON-1486814120 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2bee140f-e644-4471-ac56-226e3d79ff97(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 15:25:22 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ee9561e-7be0-4a59-bce6-0f53c29dbf9d]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:25:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-54304985-2aa0-4f91-b53e-2fdadd2939cb tempest-VolumesSnapshotTestJSON-1486814120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-2bee140f-e644-4471-ac56-226e3d79ff97 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:25:22 devstack sudo[95354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-2bee140f-e644-4471-ac56-226e3d79ff97 Nov 06 15:25:22 devstack sudo[95354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:25:22 devstack sudo[95354]: pam_unix(sudo:session): session closed for user root Nov 06 15:25:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-54304985-2aa0-4f91-b53e-2fdadd2939cb tempest-VolumesSnapshotTestJSON-1486814120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-2bee140f-e644-4471-ac56-226e3d79ff97" returned: 0 in 0.455s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:25:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-54304985-2aa0-4f91-b53e-2fdadd2939cb tempest-VolumesSnapshotTestJSON-1486814120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-2bee140f-e644-4471-ac56-226e3d79ff97.07ac2c2b-e084-449b-9e7e-78dd1f10a8a9 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:25:22 devstack sudo[95359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-2bee140f-e644-4471-ac56-226e3d79ff97.07ac2c2b-e084-449b-9e7e-78dd1f10a8a9 Nov 06 15:25:22 devstack sudo[95359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:25:22 devstack sudo[95359]: pam_unix(sudo:session): session closed for user root Nov 06 15:25:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-54304985-2aa0-4f91-b53e-2fdadd2939cb tempest-VolumesSnapshotTestJSON-1486814120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-2bee140f-e644-4471-ac56-226e3d79ff97.07ac2c2b-e084-449b-9e7e-78dd1f10a8a9" returned: 0 in 0.378s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:25:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-54304985-2aa0-4f91-b53e-2fdadd2939cb tempest-VolumesSnapshotTestJSON-1486814120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-2bee140f-e644-4471-ac56-226e3d79ff97.07ac2c2b-e084-449b-9e7e-78dd1f10a8a9 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:25:23 devstack sudo[95364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-2bee140f-e644-4471-ac56-226e3d79ff97.07ac2c2b-e084-449b-9e7e-78dd1f10a8a9 Nov 06 15:25:23 devstack sudo[95364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:25:23 devstack sudo[95364]: pam_unix(sudo:session): session closed for user root Nov 06 15:25:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-54304985-2aa0-4f91-b53e-2fdadd2939cb tempest-VolumesSnapshotTestJSON-1486814120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-2bee140f-e644-4471-ac56-226e3d79ff97.07ac2c2b-e084-449b-9e7e-78dd1f10a8a9" returned: 0 in 0.302s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:25:23 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-54304985-2aa0-4f91-b53e-2fdadd2939cb tempest-VolumesSnapshotTestJSON-1486814120 None] Lock "cinder-quobyte-07ac2c2b-e084-449b-9e7e-78dd1f10a8a9" released by "_delete_snapshot" :: held 1.822s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:25:23 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-54304985-2aa0-4f91-b53e-2fdadd2939cb tempest-VolumesSnapshotTestJSON-1486814120 None] Lock "cinder-quobyte-2bee140f-e644-4471-ac56-226e3d79ff97" released by "delete_snapshot" :: held 1.877s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:25:23 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-54304985-2aa0-4f91-b53e-2fdadd2939cb tempest-VolumesSnapshotTestJSON-1486814120 None] Created reservations ['c8aa081b-7eb9-4990-be78-36dd3254cc50', '4a9b184c-d472-423f-9946-4810260bb80f', '7ca680f4-51e8-4b4e-ab05-ef67a437c5d5', 'd34b3a15-fe22-42e4-af00-a9673d0ee542'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:25:23 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-54304985-2aa0-4f91-b53e-2fdadd2939cb tempest-VolumesSnapshotTestJSON-1486814120 None] Delete snapshot completed successfully. Nov 06 15:25:23 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-54304985-2aa0-4f91-b53e-2fdadd2939cb tempest-VolumesSnapshotTestJSON-1486814120 None] Lock "cinder-07ac2c2b-e084-449b-9e7e-78dd1f10a8a9-delete_snapshot" released by "delete_snapshot" :: held 2.165s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:25:24 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-533047ba-8cb8-4c1e-88d9-18962ce6f67c tempest-VolumesSnapshotTestJSON-1486814120 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:25:24 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-533047ba-8cb8-4c1e-88d9-18962ce6f67c tempest-VolumesSnapshotTestJSON-1486814120 None] Flow 'volume_create_manager' (d4117a97-0782-43b6-b719-e39c55c3f29d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:25:24 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-533047ba-8cb8-4c1e-88d9-18962ce6f67c tempest-VolumesSnapshotTestJSON-1486814120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee00e507-7726-48f7-bcd9-c15fbf20abb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:25:24 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-533047ba-8cb8-4c1e-88d9-18962ce6f67c tempest-VolumesSnapshotTestJSON-1486814120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee00e507-7726-48f7-bcd9-c15fbf20abb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:25:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-309218788',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85daf56d-002a-469d-8355-b38d853ec8ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d46a704379244812b425cfa29943fdb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:25:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:25:24Z,use_quota=True,user_id='481d1eaabb624d6c958d88d08f23e8fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:25:24 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-533047ba-8cb8-4c1e-88d9-18962ce6f67c tempest-VolumesSnapshotTestJSON-1486814120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52caf3e4-bddf-4b1b-a4a3-b428fd0d6f79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:25:24 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-533047ba-8cb8-4c1e-88d9-18962ce6f67c tempest-VolumesSnapshotTestJSON-1486814120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52caf3e4-bddf-4b1b-a4a3-b428fd0d6f79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:25:24 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-533047ba-8cb8-4c1e-88d9-18962ce6f67c tempest-VolumesSnapshotTestJSON-1486814120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19f3c923-b238-44aa-ac44-39eecd403b34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:25:24 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-533047ba-8cb8-4c1e-88d9-18962ce6f67c tempest-VolumesSnapshotTestJSON-1486814120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19f3c923-b238-44aa-ac44-39eecd403b34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85daf56d-002a-469d-8355-b38d853ec8ee', 'volume_name': 'volume-85daf56d-002a-469d-8355-b38d853ec8ee', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:25:24 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-533047ba-8cb8-4c1e-88d9-18962ce6f67c tempest-VolumesSnapshotTestJSON-1486814120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c60eae03-ad73-47eb-8a74-4121ac8ecf44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:25:24 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-533047ba-8cb8-4c1e-88d9-18962ce6f67c tempest-VolumesSnapshotTestJSON-1486814120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c60eae03-ad73-47eb-8a74-4121ac8ecf44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:25:24 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-533047ba-8cb8-4c1e-88d9-18962ce6f67c tempest-VolumesSnapshotTestJSON-1486814120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e28bedc8-9a6f-4699-ba2d-3e0f626838e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:25:24 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-533047ba-8cb8-4c1e-88d9-18962ce6f67c tempest-VolumesSnapshotTestJSON-1486814120 None] Volume 85daf56d-002a-469d-8355-b38d853ec8ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85daf56d-002a-469d-8355-b38d853ec8ee', 'volume_size': 1} Nov 06 15:25:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-533047ba-8cb8-4c1e-88d9-18962ce6f67c tempest-VolumesSnapshotTestJSON-1486814120 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:25:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-533047ba-8cb8-4c1e-88d9-18962ce6f67c tempest-VolumesSnapshotTestJSON-1486814120 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:25:24 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-533047ba-8cb8-4c1e-88d9-18962ce6f67c tempest-VolumesSnapshotTestJSON-1486814120 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:25:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-309218788',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85daf56d-002a-469d-8355-b38d853ec8ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d46a704379244812b425cfa29943fdb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:25:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:25:24Z,use_quota=True,user_id='481d1eaabb624d6c958d88d08f23e8fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:25:24 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-533047ba-8cb8-4c1e-88d9-18962ce6f67c tempest-VolumesSnapshotTestJSON-1486814120 None] Creating volume 85daf56d-002a-469d-8355-b38d853ec8ee {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:25:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-533047ba-8cb8-4c1e-88d9-18962ce6f67c tempest-VolumesSnapshotTestJSON-1486814120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:25:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-533047ba-8cb8-4c1e-88d9-18962ce6f67c tempest-VolumesSnapshotTestJSON-1486814120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:25:24 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-533047ba-8cb8-4c1e-88d9-18962ce6f67c tempest-VolumesSnapshotTestJSON-1486814120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:25:24 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-533047ba-8cb8-4c1e-88d9-18962ce6f67c tempest-VolumesSnapshotTestJSON-1486814120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:25:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-533047ba-8cb8-4c1e-88d9-18962ce6f67c tempest-VolumesSnapshotTestJSON-1486814120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:25:24 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-533047ba-8cb8-4c1e-88d9-18962ce6f67c tempest-VolumesSnapshotTestJSON-1486814120 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:25:24 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-533047ba-8cb8-4c1e-88d9-18962ce6f67c tempest-VolumesSnapshotTestJSON-1486814120 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:25:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-533047ba-8cb8-4c1e-88d9-18962ce6f67c tempest-VolumesSnapshotTestJSON-1486814120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-85daf56d-002a-469d-8355-b38d853ec8ee 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:25:24 devstack sudo[95367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-85daf56d-002a-469d-8355-b38d853ec8ee 1073741824 Nov 06 15:25:24 devstack sudo[95367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:25:25 devstack sudo[95367]: pam_unix(sudo:session): session closed for user root Nov 06 15:25:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-533047ba-8cb8-4c1e-88d9-18962ce6f67c tempest-VolumesSnapshotTestJSON-1486814120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-85daf56d-002a-469d-8355-b38d853ec8ee 1073741824" returned: 0 in 0.638s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:25:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-533047ba-8cb8-4c1e-88d9-18962ce6f67c tempest-VolumesSnapshotTestJSON-1486814120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-85daf56d-002a-469d-8355-b38d853ec8ee {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:25:25 devstack sudo[95374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-85daf56d-002a-469d-8355-b38d853ec8ee Nov 06 15:25:25 devstack sudo[95374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:25:25 devstack sudo[95374]: pam_unix(sudo:session): session closed for user root Nov 06 15:25:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-533047ba-8cb8-4c1e-88d9-18962ce6f67c tempest-VolumesSnapshotTestJSON-1486814120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-85daf56d-002a-469d-8355-b38d853ec8ee" returned: 0 in 0.326s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:25:25 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-533047ba-8cb8-4c1e-88d9-18962ce6f67c tempest-VolumesSnapshotTestJSON-1486814120 None] <== create_volume: return (1118ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:25:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-533047ba-8cb8-4c1e-88d9-18962ce6f67c tempest-VolumesSnapshotTestJSON-1486814120 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.122s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:25:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-533047ba-8cb8-4c1e-88d9-18962ce6f67c tempest-VolumesSnapshotTestJSON-1486814120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e28bedc8-9a6f-4699-ba2d-3e0f626838e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85daf56d-002a-469d-8355-b38d853ec8ee', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:25:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-533047ba-8cb8-4c1e-88d9-18962ce6f67c tempest-VolumesSnapshotTestJSON-1486814120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a554dd71-edd1-4c03-bb74-7ba4ae89dcfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:25:25 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-533047ba-8cb8-4c1e-88d9-18962ce6f67c tempest-VolumesSnapshotTestJSON-1486814120 None] Volume volume-85daf56d-002a-469d-8355-b38d853ec8ee (85daf56d-002a-469d-8355-b38d853ec8ee): created successfully Nov 06 15:25:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-533047ba-8cb8-4c1e-88d9-18962ce6f67c tempest-VolumesSnapshotTestJSON-1486814120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a554dd71-edd1-4c03-bb74-7ba4ae89dcfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:25:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-533047ba-8cb8-4c1e-88d9-18962ce6f67c tempest-VolumesSnapshotTestJSON-1486814120 None] Flow 'volume_create_manager' (d4117a97-0782-43b6-b719-e39c55c3f29d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:25:25 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-533047ba-8cb8-4c1e-88d9-18962ce6f67c tempest-VolumesSnapshotTestJSON-1486814120 None] Created volume successfully. Nov 06 15:25:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8101f72c-db0f-4c42-9eb6-87e9dec05453 tempest-VolumesSnapshotTestJSON-1486814120 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:25:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8101f72c-db0f-4c42-9eb6-87e9dec05453 tempest-VolumesSnapshotTestJSON-1486814120 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:25:26 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-8101f72c-db0f-4c42-9eb6-87e9dec05453 tempest-VolumesSnapshotTestJSON-1486814120 None] Creating offline snapshot 0e4968c6-1bb7-436a-a258-511843b1b0e4 of volume 85daf56d-002a-469d-8355-b38d853ec8ee {{(pid=87132) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 15:25:26 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[34406a93-f97c-43df-be53-c582eb50541f]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:25:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8101f72c-db0f-4c42-9eb6-87e9dec05453 tempest-VolumesSnapshotTestJSON-1486814120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-85daf56d-002a-469d-8355-b38d853ec8ee {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:25:26 devstack sudo[95377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-85daf56d-002a-469d-8355-b38d853ec8ee Nov 06 15:25:26 devstack sudo[95377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:25:27 devstack sudo[95377]: pam_unix(sudo:session): session closed for user root Nov 06 15:25:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8101f72c-db0f-4c42-9eb6-87e9dec05453 tempest-VolumesSnapshotTestJSON-1486814120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-85daf56d-002a-469d-8355-b38d853ec8ee" returned: 0 in 0.395s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:25:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8101f72c-db0f-4c42-9eb6-87e9dec05453 tempest-VolumesSnapshotTestJSON-1486814120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-85daf56d-002a-469d-8355-b38d853ec8ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-85daf56d-002a-469d-8355-b38d853ec8ee.0e4968c6-1bb7-436a-a258-511843b1b0e4 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:25:27 devstack sudo[95382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-85daf56d-002a-469d-8355-b38d853ec8ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-85daf56d-002a-469d-8355-b38d853ec8ee.0e4968c6-1bb7-436a-a258-511843b1b0e4 1G Nov 06 15:25:27 devstack sudo[95382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:25:27 devstack sudo[95382]: pam_unix(sudo:session): session closed for user root Nov 06 15:25:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8101f72c-db0f-4c42-9eb6-87e9dec05453 tempest-VolumesSnapshotTestJSON-1486814120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-85daf56d-002a-469d-8355-b38d853ec8ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-85daf56d-002a-469d-8355-b38d853ec8ee.0e4968c6-1bb7-436a-a258-511843b1b0e4 1G" returned: 0 in 0.487s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:25:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8101f72c-db0f-4c42-9eb6-87e9dec05453 tempest-VolumesSnapshotTestJSON-1486814120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-85daf56d-002a-469d-8355-b38d853ec8ee -F qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-85daf56d-002a-469d-8355-b38d853ec8ee.0e4968c6-1bb7-436a-a258-511843b1b0e4 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:25:27 devstack sudo[95388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-85daf56d-002a-469d-8355-b38d853ec8ee -F qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-85daf56d-002a-469d-8355-b38d853ec8ee.0e4968c6-1bb7-436a-a258-511843b1b0e4 Nov 06 15:25:27 devstack sudo[95388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:25:27 devstack sudo[95388]: pam_unix(sudo:session): session closed for user root Nov 06 15:25:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8101f72c-db0f-4c42-9eb6-87e9dec05453 tempest-VolumesSnapshotTestJSON-1486814120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-85daf56d-002a-469d-8355-b38d853ec8ee -F qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-85daf56d-002a-469d-8355-b38d853ec8ee.0e4968c6-1bb7-436a-a258-511843b1b0e4" returned: 0 in 0.345s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:25:27 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-8101f72c-db0f-4c42-9eb6-87e9dec05453 tempest-VolumesSnapshotTestJSON-1486814120 None] /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-85daf56d-002a-469d-8355-b38d853ec8ee.0e4968c6-1bb7-436a-a258-511843b1b0e4 is being set with open permissions: ugo+rw Nov 06 15:25:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8101f72c-db0f-4c42-9eb6-87e9dec05453 tempest-VolumesSnapshotTestJSON-1486814120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-85daf56d-002a-469d-8355-b38d853ec8ee.0e4968c6-1bb7-436a-a258-511843b1b0e4 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:25:27 devstack sudo[95394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-85daf56d-002a-469d-8355-b38d853ec8ee.0e4968c6-1bb7-436a-a258-511843b1b0e4 Nov 06 15:25:27 devstack sudo[95394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:25:28 devstack sudo[95394]: pam_unix(sudo:session): session closed for user root Nov 06 15:25:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8101f72c-db0f-4c42-9eb6-87e9dec05453 tempest-VolumesSnapshotTestJSON-1486814120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-85daf56d-002a-469d-8355-b38d853ec8ee.0e4968c6-1bb7-436a-a258-511843b1b0e4" returned: 0 in 0.287s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:25:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8101f72c-db0f-4c42-9eb6-87e9dec05453 tempest-VolumesSnapshotTestJSON-1486814120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-85daf56d-002a-469d-8355-b38d853ec8ee.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:25:28 devstack sudo[95397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-85daf56d-002a-469d-8355-b38d853ec8ee.info Nov 06 15:25:28 devstack sudo[95397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:25:28 devstack sudo[95397]: pam_unix(sudo:session): session closed for user root Nov 06 15:25:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8101f72c-db0f-4c42-9eb6-87e9dec05453 tempest-VolumesSnapshotTestJSON-1486814120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-85daf56d-002a-469d-8355-b38d853ec8ee.info" returned: 0 in 0.266s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:25:28 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-8101f72c-db0f-4c42-9eb6-87e9dec05453 tempest-VolumesSnapshotTestJSON-1486814120 None] /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-85daf56d-002a-469d-8355-b38d853ec8ee.info is being set with open permissions: ugo+rw Nov 06 15:25:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8101f72c-db0f-4c42-9eb6-87e9dec05453 tempest-VolumesSnapshotTestJSON-1486814120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-85daf56d-002a-469d-8355-b38d853ec8ee.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:25:28 devstack sudo[95400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-85daf56d-002a-469d-8355-b38d853ec8ee.info Nov 06 15:25:28 devstack sudo[95400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:25:28 devstack sudo[95400]: pam_unix(sudo:session): session closed for user root Nov 06 15:25:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8101f72c-db0f-4c42-9eb6-87e9dec05453 tempest-VolumesSnapshotTestJSON-1486814120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-85daf56d-002a-469d-8355-b38d853ec8ee.info" returned: 0 in 0.325s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:25:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8101f72c-db0f-4c42-9eb6-87e9dec05453 tempest-VolumesSnapshotTestJSON-1486814120 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.233s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:25:28 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-8101f72c-db0f-4c42-9eb6-87e9dec05453 tempest-VolumesSnapshotTestJSON-1486814120 None] Create snapshot completed successfully Nov 06 15:25:30 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd41fd32-6454-4d57-8f82-e1bbff16a5ef tempest-VolumesSnapshotTestJSON-1486814120 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:25:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-cd41fd32-6454-4d57-8f82-e1bbff16a5ef tempest-VolumesSnapshotTestJSON-1486814120 None] Flow 'volume_create_manager' (904915f2-d661-46d0-8df6-c63df11c58c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:25:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-cd41fd32-6454-4d57-8f82-e1bbff16a5ef tempest-VolumesSnapshotTestJSON-1486814120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea351c7f-fbf3-49d6-b918-585a55caf190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:25:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-cd41fd32-6454-4d57-8f82-e1bbff16a5ef tempest-VolumesSnapshotTestJSON-1486814120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea351c7f-fbf3-49d6-b918-585a55caf190) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:25:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-430939587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=907b3b22-5811-4d82-b2e6-e2dbff1960a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d46a704379244812b425cfa29943fdb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:25:30Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=0e4968c6-1bb7-436a-a258-511843b1b0e4,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:25:30Z,use_quota=True,user_id='481d1eaabb624d6c958d88d08f23e8fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:25:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-cd41fd32-6454-4d57-8f82-e1bbff16a5ef tempest-VolumesSnapshotTestJSON-1486814120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0eca4075-08ce-46a7-a045-6b9cbd4fc8da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:25:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-cd41fd32-6454-4d57-8f82-e1bbff16a5ef tempest-VolumesSnapshotTestJSON-1486814120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0eca4075-08ce-46a7-a045-6b9cbd4fc8da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:25:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-cd41fd32-6454-4d57-8f82-e1bbff16a5ef tempest-VolumesSnapshotTestJSON-1486814120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c70cd4e-5e44-424f-b971-97ee65004c8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:25:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-cd41fd32-6454-4d57-8f82-e1bbff16a5ef tempest-VolumesSnapshotTestJSON-1486814120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c70cd4e-5e44-424f-b971-97ee65004c8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '907b3b22-5811-4d82-b2e6-e2dbff1960a7', 'volume_name': 'volume-907b3b22-5811-4d82-b2e6-e2dbff1960a7', 'volume_size': 2, 'snapshot_id': '0e4968c6-1bb7-436a-a258-511843b1b0e4'}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:25:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-cd41fd32-6454-4d57-8f82-e1bbff16a5ef tempest-VolumesSnapshotTestJSON-1486814120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3a33977-ca5d-4840-9b3a-87fb71085f67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:25:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-cd41fd32-6454-4d57-8f82-e1bbff16a5ef tempest-VolumesSnapshotTestJSON-1486814120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3a33977-ca5d-4840-9b3a-87fb71085f67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:25:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-cd41fd32-6454-4d57-8f82-e1bbff16a5ef tempest-VolumesSnapshotTestJSON-1486814120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b92c4e6-e043-4e8a-b838-263ea2c2225a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:25:30 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-cd41fd32-6454-4d57-8f82-e1bbff16a5ef tempest-VolumesSnapshotTestJSON-1486814120 None] Volume 907b3b22-5811-4d82-b2e6-e2dbff1960a7: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-907b3b22-5811-4d82-b2e6-e2dbff1960a7', 'volume_size': 2, 'snapshot_id': '0e4968c6-1bb7-436a-a258-511843b1b0e4'} Nov 06 15:25:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-cd41fd32-6454-4d57-8f82-e1bbff16a5ef tempest-VolumesSnapshotTestJSON-1486814120 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:25:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-cd41fd32-6454-4d57-8f82-e1bbff16a5ef tempest-VolumesSnapshotTestJSON-1486814120 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:25:30 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-cd41fd32-6454-4d57-8f82-e1bbff16a5ef tempest-VolumesSnapshotTestJSON-1486814120 None] Acquiring lock "cinder-quobyte-0e4968c6-1bb7-436a-a258-511843b1b0e4-907b3b22-5811-4d82-b2e6-e2dbff1960a7" by "_create_volume_from_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:25:30 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-cd41fd32-6454-4d57-8f82-e1bbff16a5ef tempest-VolumesSnapshotTestJSON-1486814120 None] Lock "cinder-quobyte-0e4968c6-1bb7-436a-a258-511843b1b0e4-907b3b22-5811-4d82-b2e6-e2dbff1960a7" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:25:30 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-cd41fd32-6454-4d57-8f82-e1bbff16a5ef tempest-VolumesSnapshotTestJSON-1486814120 None] Creating volume 907b3b22-5811-4d82-b2e6-e2dbff1960a7 from snapshot 0e4968c6-1bb7-436a-a258-511843b1b0e4 {{(pid=87132) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 06 15:25:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-cd41fd32-6454-4d57-8f82-e1bbff16a5ef tempest-VolumesSnapshotTestJSON-1486814120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:25:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-cd41fd32-6454-4d57-8f82-e1bbff16a5ef tempest-VolumesSnapshotTestJSON-1486814120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:25:30 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-cd41fd32-6454-4d57-8f82-e1bbff16a5ef tempest-VolumesSnapshotTestJSON-1486814120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:25:30 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-cd41fd32-6454-4d57-8f82-e1bbff16a5ef tempest-VolumesSnapshotTestJSON-1486814120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:25:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-cd41fd32-6454-4d57-8f82-e1bbff16a5ef tempest-VolumesSnapshotTestJSON-1486814120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:25:30 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-cd41fd32-6454-4d57-8f82-e1bbff16a5ef tempest-VolumesSnapshotTestJSON-1486814120 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:25:30 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-cd41fd32-6454-4d57-8f82-e1bbff16a5ef tempest-VolumesSnapshotTestJSON-1486814120 None] Acquiring lock "cinder-quobyte-907b3b22-5811-4d82-b2e6-e2dbff1960a7" by "_copy_volume_from_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:25:30 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-cd41fd32-6454-4d57-8f82-e1bbff16a5ef tempest-VolumesSnapshotTestJSON-1486814120 None] Lock "cinder-quobyte-907b3b22-5811-4d82-b2e6-e2dbff1960a7" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:25:30 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-cd41fd32-6454-4d57-8f82-e1bbff16a5ef tempest-VolumesSnapshotTestJSON-1486814120 None] snapshot: 0e4968c6-1bb7-436a-a258-511843b1b0e4, volume: 907b3b22-5811-4d82-b2e6-e2dbff1960a7, {{(pid=87132) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 06 15:25:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-cd41fd32-6454-4d57-8f82-e1bbff16a5ef tempest-VolumesSnapshotTestJSON-1486814120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:25:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-cd41fd32-6454-4d57-8f82-e1bbff16a5ef tempest-VolumesSnapshotTestJSON-1486814120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:25:30 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-cd41fd32-6454-4d57-8f82-e1bbff16a5ef tempest-VolumesSnapshotTestJSON-1486814120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:25:30 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-cd41fd32-6454-4d57-8f82-e1bbff16a5ef tempest-VolumesSnapshotTestJSON-1486814120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:25:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-cd41fd32-6454-4d57-8f82-e1bbff16a5ef tempest-VolumesSnapshotTestJSON-1486814120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:25:30 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[763d8085-0bd4-4050-9195-a85e875a4848]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:25:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-cd41fd32-6454-4d57-8f82-e1bbff16a5ef tempest-VolumesSnapshotTestJSON-1486814120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-85daf56d-002a-469d-8355-b38d853ec8ee.0e4968c6-1bb7-436a-a258-511843b1b0e4 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:25:30 devstack sudo[95403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-85daf56d-002a-469d-8355-b38d853ec8ee.0e4968c6-1bb7-436a-a258-511843b1b0e4 Nov 06 15:25:30 devstack sudo[95403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:25:31 devstack sudo[95403]: pam_unix(sudo:session): session closed for user root Nov 06 15:25:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-cd41fd32-6454-4d57-8f82-e1bbff16a5ef tempest-VolumesSnapshotTestJSON-1486814120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-85daf56d-002a-469d-8355-b38d853ec8ee.0e4968c6-1bb7-436a-a258-511843b1b0e4" returned: 0 in 0.444s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:25:31 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-cd41fd32-6454-4d57-8f82-e1bbff16a5ef tempest-VolumesSnapshotTestJSON-1486814120 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-85daf56d-002a-469d-8355-b38d853ec8ee(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 15:25:31 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[6307c0ec-0568-4f12-8126-e1b194e48ef7]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:25:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-cd41fd32-6454-4d57-8f82-e1bbff16a5ef tempest-VolumesSnapshotTestJSON-1486814120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-85daf56d-002a-469d-8355-b38d853ec8ee {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:25:31 devstack sudo[95408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-85daf56d-002a-469d-8355-b38d853ec8ee Nov 06 15:25:31 devstack sudo[95408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:25:31 devstack sudo[95408]: pam_unix(sudo:session): session closed for user root Nov 06 15:25:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-cd41fd32-6454-4d57-8f82-e1bbff16a5ef tempest-VolumesSnapshotTestJSON-1486814120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-85daf56d-002a-469d-8355-b38d853ec8ee" returned: 0 in 0.449s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:25:31 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-cd41fd32-6454-4d57-8f82-e1bbff16a5ef tempest-VolumesSnapshotTestJSON-1486814120 None] will copy from snapshot at /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-85daf56d-002a-469d-8355-b38d853ec8ee {{(pid=87132) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 06 15:25:31 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-cd41fd32-6454-4d57-8f82-e1bbff16a5ef tempest-VolumesSnapshotTestJSON-1486814120 None] Creating direct copy from snapshot {{(pid=87132) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 06 15:25:31 devstack cinder-volume[87132]: DEBUG cinder.utils [None req-cd41fd32-6454-4d57-8f82-e1bbff16a5ef tempest-VolumesSnapshotTestJSON-1486814120 None] Path /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-907b3b22-5811-4d82-b2e6-e2dbff1960a7 not found in is_blk_device check {{(pid=87132) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 06 15:25:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-cd41fd32-6454-4d57-8f82-e1bbff16a5ef tempest-VolumesSnapshotTestJSON-1486814120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-85daf56d-002a-469d-8355-b38d853ec8ee /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-907b3b22-5811-4d82-b2e6-e2dbff1960a7 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:25:31 devstack sudo[95413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-85daf56d-002a-469d-8355-b38d853ec8ee /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-907b3b22-5811-4d82-b2e6-e2dbff1960a7 Nov 06 15:25:31 devstack sudo[95413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:25:40 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:SELECT=20,cinder:UPDATE=13,cinder:DELETE=2,cinder:INSERT=4 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 15:25:40 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:UPDATE=18,cinder:SELECT=29,cinder:INSERT=4,cinder:DELETE=2 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 15:25:41 devstack sudo[95413]: pam_unix(sudo:session): session closed for user root Nov 06 15:25:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-cd41fd32-6454-4d57-8f82-e1bbff16a5ef tempest-VolumesSnapshotTestJSON-1486814120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-85daf56d-002a-469d-8355-b38d853ec8ee /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-907b3b22-5811-4d82-b2e6-e2dbff1960a7" returned: 0 in 9.701s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:25:41 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-cd41fd32-6454-4d57-8f82-e1bbff16a5ef tempest-VolumesSnapshotTestJSON-1486814120 None] Image conversion details: src /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-85daf56d-002a-469d-8355-b38d853ec8ee, size 1024.00 MB, duration 9.70 sec, destination /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-907b3b22-5811-4d82-b2e6-e2dbff1960a7 {{(pid=87132) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 06 15:25:41 devstack cinder-volume[87132]: INFO cinder.image.image_utils [None req-cd41fd32-6454-4d57-8f82-e1bbff16a5ef tempest-VolumesSnapshotTestJSON-1486814120 None] Converted 1024.00 MB image at 105.55 MB/s Nov 06 15:25:41 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-cd41fd32-6454-4d57-8f82-e1bbff16a5ef tempest-VolumesSnapshotTestJSON-1486814120 None] /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-907b3b22-5811-4d82-b2e6-e2dbff1960a7 is being set with open permissions: ugo+rw Nov 06 15:25:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-cd41fd32-6454-4d57-8f82-e1bbff16a5ef tempest-VolumesSnapshotTestJSON-1486814120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-907b3b22-5811-4d82-b2e6-e2dbff1960a7 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:25:41 devstack sudo[95431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-907b3b22-5811-4d82-b2e6-e2dbff1960a7 Nov 06 15:25:41 devstack sudo[95431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:25:41 devstack sudo[95431]: pam_unix(sudo:session): session closed for user root Nov 06 15:25:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-cd41fd32-6454-4d57-8f82-e1bbff16a5ef tempest-VolumesSnapshotTestJSON-1486814120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-907b3b22-5811-4d82-b2e6-e2dbff1960a7" returned: 0 in 0.374s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:25:41 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-cd41fd32-6454-4d57-8f82-e1bbff16a5ef tempest-VolumesSnapshotTestJSON-1486814120 None] Lock "cinder-quobyte-907b3b22-5811-4d82-b2e6-e2dbff1960a7" released by "_copy_volume_from_snapshot" :: held 11.080s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:25:41 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-cd41fd32-6454-4d57-8f82-e1bbff16a5ef tempest-VolumesSnapshotTestJSON-1486814120 None] Lock "cinder-quobyte-0e4968c6-1bb7-436a-a258-511843b1b0e4-907b3b22-5811-4d82-b2e6-e2dbff1960a7" released by "_create_volume_from_snapshot" :: held 11.177s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:25:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-cd41fd32-6454-4d57-8f82-e1bbff16a5ef tempest-VolumesSnapshotTestJSON-1486814120 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.198s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:25:41 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-cd41fd32-6454-4d57-8f82-e1bbff16a5ef tempest-VolumesSnapshotTestJSON-1486814120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b92c4e6-e043-4e8a-b838-263ea2c2225a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-907b3b22-5811-4d82-b2e6-e2dbff1960a7', 'volume_size': 2, 'snapshot_id': '0e4968c6-1bb7-436a-a258-511843b1b0e4'}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:25:41 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-cd41fd32-6454-4d57-8f82-e1bbff16a5ef tempest-VolumesSnapshotTestJSON-1486814120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdbc10d7-e64e-47b9-8d36-5ad96e915881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:25:41 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-cd41fd32-6454-4d57-8f82-e1bbff16a5ef tempest-VolumesSnapshotTestJSON-1486814120 None] Volume volume-907b3b22-5811-4d82-b2e6-e2dbff1960a7 (907b3b22-5811-4d82-b2e6-e2dbff1960a7): created successfully Nov 06 15:25:41 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-cd41fd32-6454-4d57-8f82-e1bbff16a5ef tempest-VolumesSnapshotTestJSON-1486814120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdbc10d7-e64e-47b9-8d36-5ad96e915881) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:25:41 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-cd41fd32-6454-4d57-8f82-e1bbff16a5ef tempest-VolumesSnapshotTestJSON-1486814120 None] Flow 'volume_create_manager' (904915f2-d661-46d0-8df6-c63df11c58c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:25:41 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-cd41fd32-6454-4d57-8f82-e1bbff16a5ef tempest-VolumesSnapshotTestJSON-1486814120 None] Created volume successfully. Nov 06 15:25:42 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-75dd061d-6579-487a-8035-8aa6f7409255 tempest-VolumesSnapshotTestJSON-1486814120 None] Acquiring lock "cinder-907b3b22-5811-4d82-b2e6-e2dbff1960a7-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:25:43 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-75dd061d-6579-487a-8035-8aa6f7409255 tempest-VolumesSnapshotTestJSON-1486814120 None] Lock "cinder-907b3b22-5811-4d82-b2e6-e2dbff1960a7-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:25:43 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-75dd061d-6579-487a-8035-8aa6f7409255 tempest-VolumesSnapshotTestJSON-1486814120 None] Acquiring lock "cinder-quobyte-907b3b22-5811-4d82-b2e6-e2dbff1960a7" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:25:43 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-75dd061d-6579-487a-8035-8aa6f7409255 tempest-VolumesSnapshotTestJSON-1486814120 None] Lock "cinder-quobyte-907b3b22-5811-4d82-b2e6-e2dbff1960a7" acquired by "delete_volume" :: waited 0.019s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:25:43 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c81c0ba-c13a-457c-8d1f-7aa2f3f6fcf3]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:25:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-75dd061d-6579-487a-8035-8aa6f7409255 tempest-VolumesSnapshotTestJSON-1486814120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-907b3b22-5811-4d82-b2e6-e2dbff1960a7 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:25:43 devstack sudo[95450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-907b3b22-5811-4d82-b2e6-e2dbff1960a7 Nov 06 15:25:43 devstack sudo[95450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:25:43 devstack sudo[95450]: pam_unix(sudo:session): session closed for user root Nov 06 15:25:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-75dd061d-6579-487a-8035-8aa6f7409255 tempest-VolumesSnapshotTestJSON-1486814120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-907b3b22-5811-4d82-b2e6-e2dbff1960a7" returned: 0 in 0.424s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:25:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-75dd061d-6579-487a-8035-8aa6f7409255 tempest-VolumesSnapshotTestJSON-1486814120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-907b3b22-5811-4d82-b2e6-e2dbff1960a7 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:25:43 devstack sudo[95456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-907b3b22-5811-4d82-b2e6-e2dbff1960a7 Nov 06 15:25:43 devstack sudo[95456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:25:43 devstack sudo[95456]: pam_unix(sudo:session): session closed for user root Nov 06 15:25:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-75dd061d-6579-487a-8035-8aa6f7409255 tempest-VolumesSnapshotTestJSON-1486814120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-907b3b22-5811-4d82-b2e6-e2dbff1960a7" returned: 0 in 0.265s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:25:43 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-75dd061d-6579-487a-8035-8aa6f7409255 tempest-VolumesSnapshotTestJSON-1486814120 None] Lock "cinder-quobyte-907b3b22-5811-4d82-b2e6-e2dbff1960a7" released by "delete_volume" :: held 0.754s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:25:43 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-75dd061d-6579-487a-8035-8aa6f7409255 tempest-VolumesSnapshotTestJSON-1486814120 None] Created reservations ['1fb12eba-af1b-47db-8d47-ea3fafdac83b', '53ba84c6-c0fb-4996-afe6-7ab876c5410b', '8241ce0e-c90b-4f9e-ae03-9ccf62889271', 'de6e42d4-7bb5-4251-8288-846472d2fc40'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:25:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-75dd061d-6579-487a-8035-8aa6f7409255 tempest-VolumesSnapshotTestJSON-1486814120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:25:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-75dd061d-6579-487a-8035-8aa6f7409255 tempest-VolumesSnapshotTestJSON-1486814120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:25:43 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-75dd061d-6579-487a-8035-8aa6f7409255 tempest-VolumesSnapshotTestJSON-1486814120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:25:43 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-75dd061d-6579-487a-8035-8aa6f7409255 tempest-VolumesSnapshotTestJSON-1486814120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:25:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-75dd061d-6579-487a-8035-8aa6f7409255 tempest-VolumesSnapshotTestJSON-1486814120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:25:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-75dd061d-6579-487a-8035-8aa6f7409255 tempest-VolumesSnapshotTestJSON-1486814120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:25:44 devstack sudo[95459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:25:44 devstack sudo[95459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:25:44 devstack sudo[95459]: pam_unix(sudo:session): session closed for user root Nov 06 15:25:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-75dd061d-6579-487a-8035-8aa6f7409255 tempest-VolumesSnapshotTestJSON-1486814120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.308s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:25:44 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-75dd061d-6579-487a-8035-8aa6f7409255 tempest-VolumesSnapshotTestJSON-1486814120 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:25:44 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-75dd061d-6579-487a-8035-8aa6f7409255 tempest-VolumesSnapshotTestJSON-1486814120 None] Deleted volume successfully. Nov 06 15:25:44 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e294295d-43df-4af7-ac75-7aab09d0489b tempest-VolumesSnapshotTestJSON-1486814120 None] Acquiring lock "cinder-0e4968c6-1bb7-436a-a258-511843b1b0e4-delete_snapshot" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:25:44 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e294295d-43df-4af7-ac75-7aab09d0489b tempest-VolumesSnapshotTestJSON-1486814120 None] Lock "cinder-0e4968c6-1bb7-436a-a258-511843b1b0e4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:25:44 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e294295d-43df-4af7-ac75-7aab09d0489b tempest-VolumesSnapshotTestJSON-1486814120 None] Acquiring lock "cinder-quobyte-85daf56d-002a-469d-8355-b38d853ec8ee" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:25:44 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-75dd061d-6579-487a-8035-8aa6f7409255 tempest-VolumesSnapshotTestJSON-1486814120 None] Lock "cinder-907b3b22-5811-4d82-b2e6-e2dbff1960a7-delete_volume" released by "delete_volume" :: held 1.330s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:25:44 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e294295d-43df-4af7-ac75-7aab09d0489b tempest-VolumesSnapshotTestJSON-1486814120 None] Lock "cinder-quobyte-85daf56d-002a-469d-8355-b38d853ec8ee" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:25:44 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e294295d-43df-4af7-ac75-7aab09d0489b tempest-VolumesSnapshotTestJSON-1486814120 None] Acquiring lock "cinder-quobyte-0e4968c6-1bb7-436a-a258-511843b1b0e4" by "_delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:25:44 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e294295d-43df-4af7-ac75-7aab09d0489b tempest-VolumesSnapshotTestJSON-1486814120 None] Lock "cinder-quobyte-0e4968c6-1bb7-436a-a258-511843b1b0e4" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:25:44 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-e294295d-43df-4af7-ac75-7aab09d0489b tempest-VolumesSnapshotTestJSON-1486814120 None] Deleting offline snapshot 0e4968c6-1bb7-436a-a258-511843b1b0e4 of volume 85daf56d-002a-469d-8355-b38d853ec8ee {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 15:25:44 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-e294295d-43df-4af7-ac75-7aab09d0489b tempest-VolumesSnapshotTestJSON-1486814120 None] snapshot_file for this snap is: volume-85daf56d-002a-469d-8355-b38d853ec8ee.0e4968c6-1bb7-436a-a258-511843b1b0e4 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 15:25:44 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[1525a4d9-c45a-4b3a-b98b-d9b342225ec8]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:25:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e294295d-43df-4af7-ac75-7aab09d0489b tempest-VolumesSnapshotTestJSON-1486814120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-85daf56d-002a-469d-8355-b38d853ec8ee.0e4968c6-1bb7-436a-a258-511843b1b0e4 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:25:44 devstack sudo[95463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-85daf56d-002a-469d-8355-b38d853ec8ee.0e4968c6-1bb7-436a-a258-511843b1b0e4 Nov 06 15:25:44 devstack sudo[95463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:25:44 devstack sudo[95463]: pam_unix(sudo:session): session closed for user root Nov 06 15:25:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e294295d-43df-4af7-ac75-7aab09d0489b tempest-VolumesSnapshotTestJSON-1486814120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-85daf56d-002a-469d-8355-b38d853ec8ee.0e4968c6-1bb7-436a-a258-511843b1b0e4" returned: 0 in 0.399s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:25:44 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-e294295d-43df-4af7-ac75-7aab09d0489b tempest-VolumesSnapshotTestJSON-1486814120 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-85daf56d-002a-469d-8355-b38d853ec8ee(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 15:25:44 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa464973-95dc-4625-94ca-e644211e49af]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:25:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e294295d-43df-4af7-ac75-7aab09d0489b tempest-VolumesSnapshotTestJSON-1486814120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-85daf56d-002a-469d-8355-b38d853ec8ee {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:25:45 devstack sudo[95470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-85daf56d-002a-469d-8355-b38d853ec8ee Nov 06 15:25:45 devstack sudo[95470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:25:45 devstack sudo[95470]: pam_unix(sudo:session): session closed for user root Nov 06 15:25:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e294295d-43df-4af7-ac75-7aab09d0489b tempest-VolumesSnapshotTestJSON-1486814120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-85daf56d-002a-469d-8355-b38d853ec8ee" returned: 0 in 0.948s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:25:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e294295d-43df-4af7-ac75-7aab09d0489b tempest-VolumesSnapshotTestJSON-1486814120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-85daf56d-002a-469d-8355-b38d853ec8ee.0e4968c6-1bb7-436a-a258-511843b1b0e4 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:25:45 devstack sudo[95519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-85daf56d-002a-469d-8355-b38d853ec8ee.0e4968c6-1bb7-436a-a258-511843b1b0e4 Nov 06 15:25:45 devstack sudo[95519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:25:46 devstack sudo[95519]: pam_unix(sudo:session): session closed for user root Nov 06 15:25:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e294295d-43df-4af7-ac75-7aab09d0489b tempest-VolumesSnapshotTestJSON-1486814120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-85daf56d-002a-469d-8355-b38d853ec8ee.0e4968c6-1bb7-436a-a258-511843b1b0e4" returned: 0 in 0.778s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:25:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e294295d-43df-4af7-ac75-7aab09d0489b tempest-VolumesSnapshotTestJSON-1486814120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-85daf56d-002a-469d-8355-b38d853ec8ee.0e4968c6-1bb7-436a-a258-511843b1b0e4 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:25:46 devstack sudo[95547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-85daf56d-002a-469d-8355-b38d853ec8ee.0e4968c6-1bb7-436a-a258-511843b1b0e4 Nov 06 15:25:46 devstack sudo[95547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:25:47 devstack sudo[95547]: pam_unix(sudo:session): session closed for user root Nov 06 15:25:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e294295d-43df-4af7-ac75-7aab09d0489b tempest-VolumesSnapshotTestJSON-1486814120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-85daf56d-002a-469d-8355-b38d853ec8ee.0e4968c6-1bb7-436a-a258-511843b1b0e4" returned: 0 in 0.447s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:25:47 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e294295d-43df-4af7-ac75-7aab09d0489b tempest-VolumesSnapshotTestJSON-1486814120 None] Lock "cinder-quobyte-0e4968c6-1bb7-436a-a258-511843b1b0e4" released by "_delete_snapshot" :: held 2.760s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:25:47 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e294295d-43df-4af7-ac75-7aab09d0489b tempest-VolumesSnapshotTestJSON-1486814120 None] Lock "cinder-quobyte-85daf56d-002a-469d-8355-b38d853ec8ee" released by "delete_snapshot" :: held 2.790s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:25:47 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-e294295d-43df-4af7-ac75-7aab09d0489b tempest-VolumesSnapshotTestJSON-1486814120 None] Created reservations ['b150d85a-367f-4b56-8d68-760883c85e44', 'bc649ac4-32a5-4b9e-9ad7-76589d6b3d4c', '87c79016-232c-4651-b5a2-a02a093611fd', '717def99-6375-4215-a76e-e273d2f7b105'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:25:47 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-e294295d-43df-4af7-ac75-7aab09d0489b tempest-VolumesSnapshotTestJSON-1486814120 None] Delete snapshot completed successfully. Nov 06 15:25:47 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e294295d-43df-4af7-ac75-7aab09d0489b tempest-VolumesSnapshotTestJSON-1486814120 None] Lock "cinder-0e4968c6-1bb7-436a-a258-511843b1b0e4-delete_snapshot" released by "delete_snapshot" :: held 3.074s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:25:47 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-f8359ceb-7421-4ae2-83c5-d4bce0f95684 tempest-VolumesSnapshotTestJSON-1486814120 None] Acquiring lock "cinder-85daf56d-002a-469d-8355-b38d853ec8ee-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:25:47 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-f8359ceb-7421-4ae2-83c5-d4bce0f95684 tempest-VolumesSnapshotTestJSON-1486814120 None] Lock "cinder-85daf56d-002a-469d-8355-b38d853ec8ee-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:25:48 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-f8359ceb-7421-4ae2-83c5-d4bce0f95684 tempest-VolumesSnapshotTestJSON-1486814120 None] Acquiring lock "cinder-quobyte-85daf56d-002a-469d-8355-b38d853ec8ee" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:25:48 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-f8359ceb-7421-4ae2-83c5-d4bce0f95684 tempest-VolumesSnapshotTestJSON-1486814120 None] Lock "cinder-quobyte-85daf56d-002a-469d-8355-b38d853ec8ee" acquired by "delete_volume" :: waited 0.062s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:25:48 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fca75f4-efce-456d-95c6-98befa784545]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:25:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f8359ceb-7421-4ae2-83c5-d4bce0f95684 tempest-VolumesSnapshotTestJSON-1486814120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-85daf56d-002a-469d-8355-b38d853ec8ee {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:25:48 devstack sudo[95558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-85daf56d-002a-469d-8355-b38d853ec8ee Nov 06 15:25:48 devstack sudo[95558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:25:48 devstack sudo[95558]: pam_unix(sudo:session): session closed for user root Nov 06 15:25:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f8359ceb-7421-4ae2-83c5-d4bce0f95684 tempest-VolumesSnapshotTestJSON-1486814120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-85daf56d-002a-469d-8355-b38d853ec8ee" returned: 0 in 0.637s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:25:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f8359ceb-7421-4ae2-83c5-d4bce0f95684 tempest-VolumesSnapshotTestJSON-1486814120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-85daf56d-002a-469d-8355-b38d853ec8ee {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:25:48 devstack sudo[95573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-85daf56d-002a-469d-8355-b38d853ec8ee Nov 06 15:25:48 devstack sudo[95573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:25:49 devstack sudo[95573]: pam_unix(sudo:session): session closed for user root Nov 06 15:25:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f8359ceb-7421-4ae2-83c5-d4bce0f95684 tempest-VolumesSnapshotTestJSON-1486814120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-85daf56d-002a-469d-8355-b38d853ec8ee" returned: 0 in 0.513s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:25:49 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-f8359ceb-7421-4ae2-83c5-d4bce0f95684 tempest-VolumesSnapshotTestJSON-1486814120 None] Lock "cinder-quobyte-85daf56d-002a-469d-8355-b38d853ec8ee" released by "delete_volume" :: held 1.338s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:25:49 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-f8359ceb-7421-4ae2-83c5-d4bce0f95684 tempest-VolumesSnapshotTestJSON-1486814120 None] Created reservations ['55452d4f-7f42-446c-b88c-324550f7c150', 'f3ada292-3b8c-4cf3-babb-843a580fcd7d', '74ef837b-5bbc-4d73-a8ae-e01f7c5605ff', 'd1460e7e-3d19-48ec-8fb6-abf3a072cc23'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:25:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f8359ceb-7421-4ae2-83c5-d4bce0f95684 tempest-VolumesSnapshotTestJSON-1486814120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:25:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f8359ceb-7421-4ae2-83c5-d4bce0f95684 tempest-VolumesSnapshotTestJSON-1486814120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:25:49 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-f8359ceb-7421-4ae2-83c5-d4bce0f95684 tempest-VolumesSnapshotTestJSON-1486814120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:25:49 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-f8359ceb-7421-4ae2-83c5-d4bce0f95684 tempest-VolumesSnapshotTestJSON-1486814120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:25:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f8359ceb-7421-4ae2-83c5-d4bce0f95684 tempest-VolumesSnapshotTestJSON-1486814120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:25:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f8359ceb-7421-4ae2-83c5-d4bce0f95684 tempest-VolumesSnapshotTestJSON-1486814120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:25:49 devstack sudo[95585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:25:49 devstack sudo[95585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:25:50 devstack sudo[95585]: pam_unix(sudo:session): session closed for user root Nov 06 15:25:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f8359ceb-7421-4ae2-83c5-d4bce0f95684 tempest-VolumesSnapshotTestJSON-1486814120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.344s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:25:50 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-f8359ceb-7421-4ae2-83c5-d4bce0f95684 tempest-VolumesSnapshotTestJSON-1486814120 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:25:50 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-f8359ceb-7421-4ae2-83c5-d4bce0f95684 tempest-VolumesSnapshotTestJSON-1486814120 None] Deleted volume successfully. Nov 06 15:25:50 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-f8359ceb-7421-4ae2-83c5-d4bce0f95684 tempest-VolumesSnapshotTestJSON-1486814120 None] Lock "cinder-85daf56d-002a-469d-8355-b38d853ec8ee-delete_volume" released by "delete_volume" :: held 2.175s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:25:51 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9e0e0ee-5376-48af-97e9-33ff5709a3e2 tempest-VolumesSnapshotTestJSON-1486814120 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:25:51 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b9e0e0ee-5376-48af-97e9-33ff5709a3e2 tempest-VolumesSnapshotTestJSON-1486814120 None] Flow 'volume_create_manager' (a5026e04-cead-498a-8642-30b2920f1751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:25:51 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b9e0e0ee-5376-48af-97e9-33ff5709a3e2 tempest-VolumesSnapshotTestJSON-1486814120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4dbb76c7-434d-40d6-a3ce-dbee74358c98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:25:51 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b9e0e0ee-5376-48af-97e9-33ff5709a3e2 tempest-VolumesSnapshotTestJSON-1486814120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4dbb76c7-434d-40d6-a3ce-dbee74358c98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:25:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1489523019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50a1e8fd-cb4f-4f84-abb1-af25f9024db8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d46a704379244812b425cfa29943fdb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:25:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:25:51Z,use_quota=True,user_id='481d1eaabb624d6c958d88d08f23e8fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:25:51 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b9e0e0ee-5376-48af-97e9-33ff5709a3e2 tempest-VolumesSnapshotTestJSON-1486814120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84e5aced-8696-4970-95a3-3f3e105f3b8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:25:51 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b9e0e0ee-5376-48af-97e9-33ff5709a3e2 tempest-VolumesSnapshotTestJSON-1486814120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84e5aced-8696-4970-95a3-3f3e105f3b8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:25:51 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b9e0e0ee-5376-48af-97e9-33ff5709a3e2 tempest-VolumesSnapshotTestJSON-1486814120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b49dc682-1406-4413-bba5-9507cdb0b367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:25:51 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b9e0e0ee-5376-48af-97e9-33ff5709a3e2 tempest-VolumesSnapshotTestJSON-1486814120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b49dc682-1406-4413-bba5-9507cdb0b367) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50a1e8fd-cb4f-4f84-abb1-af25f9024db8', 'volume_name': 'volume-50a1e8fd-cb4f-4f84-abb1-af25f9024db8', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:25:51 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b9e0e0ee-5376-48af-97e9-33ff5709a3e2 tempest-VolumesSnapshotTestJSON-1486814120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a81d662-78ee-41ad-916e-97dca7c581e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:25:51 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b9e0e0ee-5376-48af-97e9-33ff5709a3e2 tempest-VolumesSnapshotTestJSON-1486814120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a81d662-78ee-41ad-916e-97dca7c581e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:25:51 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b9e0e0ee-5376-48af-97e9-33ff5709a3e2 tempest-VolumesSnapshotTestJSON-1486814120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba9fd009-16a4-4fa1-95c1-ddfa969e2e9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:25:51 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-b9e0e0ee-5376-48af-97e9-33ff5709a3e2 tempest-VolumesSnapshotTestJSON-1486814120 None] Volume 50a1e8fd-cb4f-4f84-abb1-af25f9024db8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50a1e8fd-cb4f-4f84-abb1-af25f9024db8', 'volume_size': 1} Nov 06 15:25:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b9e0e0ee-5376-48af-97e9-33ff5709a3e2 tempest-VolumesSnapshotTestJSON-1486814120 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:25:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b9e0e0ee-5376-48af-97e9-33ff5709a3e2 tempest-VolumesSnapshotTestJSON-1486814120 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:25:51 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-b9e0e0ee-5376-48af-97e9-33ff5709a3e2 tempest-VolumesSnapshotTestJSON-1486814120 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:25:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1489523019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50a1e8fd-cb4f-4f84-abb1-af25f9024db8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d46a704379244812b425cfa29943fdb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:25:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:25:51Z,use_quota=True,user_id='481d1eaabb624d6c958d88d08f23e8fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:25:51 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-b9e0e0ee-5376-48af-97e9-33ff5709a3e2 tempest-VolumesSnapshotTestJSON-1486814120 None] Creating volume 50a1e8fd-cb4f-4f84-abb1-af25f9024db8 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:25:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b9e0e0ee-5376-48af-97e9-33ff5709a3e2 tempest-VolumesSnapshotTestJSON-1486814120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:25:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b9e0e0ee-5376-48af-97e9-33ff5709a3e2 tempest-VolumesSnapshotTestJSON-1486814120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:25:51 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-b9e0e0ee-5376-48af-97e9-33ff5709a3e2 tempest-VolumesSnapshotTestJSON-1486814120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:25:51 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-b9e0e0ee-5376-48af-97e9-33ff5709a3e2 tempest-VolumesSnapshotTestJSON-1486814120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:25:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b9e0e0ee-5376-48af-97e9-33ff5709a3e2 tempest-VolumesSnapshotTestJSON-1486814120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:25:51 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-b9e0e0ee-5376-48af-97e9-33ff5709a3e2 tempest-VolumesSnapshotTestJSON-1486814120 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:25:51 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-b9e0e0ee-5376-48af-97e9-33ff5709a3e2 tempest-VolumesSnapshotTestJSON-1486814120 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:25:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b9e0e0ee-5376-48af-97e9-33ff5709a3e2 tempest-VolumesSnapshotTestJSON-1486814120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-50a1e8fd-cb4f-4f84-abb1-af25f9024db8 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:25:51 devstack sudo[95588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-50a1e8fd-cb4f-4f84-abb1-af25f9024db8 1073741824 Nov 06 15:25:51 devstack sudo[95588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:25:52 devstack sudo[95588]: pam_unix(sudo:session): session closed for user root Nov 06 15:25:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b9e0e0ee-5376-48af-97e9-33ff5709a3e2 tempest-VolumesSnapshotTestJSON-1486814120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-50a1e8fd-cb4f-4f84-abb1-af25f9024db8 1073741824" returned: 0 in 0.731s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:25:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b9e0e0ee-5376-48af-97e9-33ff5709a3e2 tempest-VolumesSnapshotTestJSON-1486814120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-50a1e8fd-cb4f-4f84-abb1-af25f9024db8 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:25:52 devstack sudo[95597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-50a1e8fd-cb4f-4f84-abb1-af25f9024db8 Nov 06 15:25:52 devstack sudo[95597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:25:52 devstack sudo[95597]: pam_unix(sudo:session): session closed for user root Nov 06 15:25:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b9e0e0ee-5376-48af-97e9-33ff5709a3e2 tempest-VolumesSnapshotTestJSON-1486814120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-50a1e8fd-cb4f-4f84-abb1-af25f9024db8" returned: 0 in 0.516s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:25:52 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-b9e0e0ee-5376-48af-97e9-33ff5709a3e2 tempest-VolumesSnapshotTestJSON-1486814120 None] <== create_volume: return (1323ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:25:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b9e0e0ee-5376-48af-97e9-33ff5709a3e2 tempest-VolumesSnapshotTestJSON-1486814120 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.325s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:25:52 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b9e0e0ee-5376-48af-97e9-33ff5709a3e2 tempest-VolumesSnapshotTestJSON-1486814120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba9fd009-16a4-4fa1-95c1-ddfa969e2e9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50a1e8fd-cb4f-4f84-abb1-af25f9024db8', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:25:52 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b9e0e0ee-5376-48af-97e9-33ff5709a3e2 tempest-VolumesSnapshotTestJSON-1486814120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0afacbd7-5dc9-4036-991c-fc18880cab77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:25:52 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-b9e0e0ee-5376-48af-97e9-33ff5709a3e2 tempest-VolumesSnapshotTestJSON-1486814120 None] Volume volume-50a1e8fd-cb4f-4f84-abb1-af25f9024db8 (50a1e8fd-cb4f-4f84-abb1-af25f9024db8): created successfully Nov 06 15:25:52 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b9e0e0ee-5376-48af-97e9-33ff5709a3e2 tempest-VolumesSnapshotTestJSON-1486814120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0afacbd7-5dc9-4036-991c-fc18880cab77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:25:52 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b9e0e0ee-5376-48af-97e9-33ff5709a3e2 tempest-VolumesSnapshotTestJSON-1486814120 None] Flow 'volume_create_manager' (a5026e04-cead-498a-8642-30b2920f1751) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:25:52 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-b9e0e0ee-5376-48af-97e9-33ff5709a3e2 tempest-VolumesSnapshotTestJSON-1486814120 None] Created volume successfully. Nov 06 15:25:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5a9edb4d-aaeb-4709-ab64-82d72beb7426 tempest-VolumesSnapshotTestJSON-1486814120 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:25:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5a9edb4d-aaeb-4709-ab64-82d72beb7426 tempest-VolumesSnapshotTestJSON-1486814120 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:25:53 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-5a9edb4d-aaeb-4709-ab64-82d72beb7426 tempest-VolumesSnapshotTestJSON-1486814120 None] Creating offline snapshot b2ec06a6-827a-4652-a161-7c9335ae3551 of volume 50a1e8fd-cb4f-4f84-abb1-af25f9024db8 {{(pid=87132) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 15:25:53 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[66db13e9-3ed5-410a-9c5b-9330d965aaa7]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:25:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5a9edb4d-aaeb-4709-ab64-82d72beb7426 tempest-VolumesSnapshotTestJSON-1486814120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-50a1e8fd-cb4f-4f84-abb1-af25f9024db8 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:25:54 devstack sudo[95637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-50a1e8fd-cb4f-4f84-abb1-af25f9024db8 Nov 06 15:25:54 devstack sudo[95637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:25:54 devstack sudo[95637]: pam_unix(sudo:session): session closed for user root Nov 06 15:25:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5a9edb4d-aaeb-4709-ab64-82d72beb7426 tempest-VolumesSnapshotTestJSON-1486814120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-50a1e8fd-cb4f-4f84-abb1-af25f9024db8" returned: 0 in 0.723s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:25:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5a9edb4d-aaeb-4709-ab64-82d72beb7426 tempest-VolumesSnapshotTestJSON-1486814120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-50a1e8fd-cb4f-4f84-abb1-af25f9024db8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-50a1e8fd-cb4f-4f84-abb1-af25f9024db8.b2ec06a6-827a-4652-a161-7c9335ae3551 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:25:54 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3b9a3da-ece0-4155-a5c6-862f0798a435 tempest-VolumesActionsTest-2124293081 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:25:54 devstack sudo[95642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-50a1e8fd-cb4f-4f84-abb1-af25f9024db8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-50a1e8fd-cb4f-4f84-abb1-af25f9024db8.b2ec06a6-827a-4652-a161-7c9335ae3551 1G Nov 06 15:25:54 devstack sudo[95642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:25:54 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c3b9a3da-ece0-4155-a5c6-862f0798a435 tempest-VolumesActionsTest-2124293081 None] Flow 'volume_create_manager' (b5f9ed94-c2bb-47e0-b223-8201d6a181f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:25:54 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c3b9a3da-ece0-4155-a5c6-862f0798a435 tempest-VolumesActionsTest-2124293081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf3a2d30-83e1-4d0b-ac16-8276c3b096ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:25:54 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c3b9a3da-ece0-4155-a5c6-862f0798a435 tempest-VolumesActionsTest-2124293081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf3a2d30-83e1-4d0b-ac16-8276c3b096ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:25:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1346148955',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=195d657d-ada6-43cd-8b10-a43ff3c43b62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d0b6abc042242be823fc382d007712a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:25:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:25:55Z,use_quota=True,user_id='abff5ddd914544e7a269405c2ec272b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:25:54 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c3b9a3da-ece0-4155-a5c6-862f0798a435 tempest-VolumesActionsTest-2124293081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78ef1522-27a4-4bb9-a39d-c59348eaa37a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:25:54 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c3b9a3da-ece0-4155-a5c6-862f0798a435 tempest-VolumesActionsTest-2124293081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78ef1522-27a4-4bb9-a39d-c59348eaa37a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:25:54 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c3b9a3da-ece0-4155-a5c6-862f0798a435 tempest-VolumesActionsTest-2124293081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54c06025-faac-4560-be0d-6be708e299de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:25:54 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c3b9a3da-ece0-4155-a5c6-862f0798a435 tempest-VolumesActionsTest-2124293081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54c06025-faac-4560-be0d-6be708e299de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '195d657d-ada6-43cd-8b10-a43ff3c43b62', 'volume_name': 'volume-195d657d-ada6-43cd-8b10-a43ff3c43b62', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:25:54 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c3b9a3da-ece0-4155-a5c6-862f0798a435 tempest-VolumesActionsTest-2124293081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (392ab8be-2e87-40a4-a02a-c09487eff9fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:25:54 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c3b9a3da-ece0-4155-a5c6-862f0798a435 tempest-VolumesActionsTest-2124293081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (392ab8be-2e87-40a4-a02a-c09487eff9fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:25:54 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c3b9a3da-ece0-4155-a5c6-862f0798a435 tempest-VolumesActionsTest-2124293081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f900a35e-d144-4dac-a0d4-7fc858ee5d4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:25:54 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-c3b9a3da-ece0-4155-a5c6-862f0798a435 tempest-VolumesActionsTest-2124293081 None] Volume 195d657d-ada6-43cd-8b10-a43ff3c43b62: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-195d657d-ada6-43cd-8b10-a43ff3c43b62', 'volume_size': 1} Nov 06 15:25:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c3b9a3da-ece0-4155-a5c6-862f0798a435 tempest-VolumesActionsTest-2124293081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:25:55 devstack sudo[95642]: pam_unix(sudo:session): session closed for user root Nov 06 15:25:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5a9edb4d-aaeb-4709-ab64-82d72beb7426 tempest-VolumesSnapshotTestJSON-1486814120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-50a1e8fd-cb4f-4f84-abb1-af25f9024db8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-50a1e8fd-cb4f-4f84-abb1-af25f9024db8.b2ec06a6-827a-4652-a161-7c9335ae3551 1G" returned: 0 in 1.000s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:25:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5a9edb4d-aaeb-4709-ab64-82d72beb7426 tempest-VolumesSnapshotTestJSON-1486814120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-50a1e8fd-cb4f-4f84-abb1-af25f9024db8 -F qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-50a1e8fd-cb4f-4f84-abb1-af25f9024db8.b2ec06a6-827a-4652-a161-7c9335ae3551 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:25:55 devstack sudo[95679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-50a1e8fd-cb4f-4f84-abb1-af25f9024db8 -F qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-50a1e8fd-cb4f-4f84-abb1-af25f9024db8.b2ec06a6-827a-4652-a161-7c9335ae3551 Nov 06 15:25:55 devstack sudo[95679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:25:56 devstack sudo[95679]: pam_unix(sudo:session): session closed for user root Nov 06 15:25:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5a9edb4d-aaeb-4709-ab64-82d72beb7426 tempest-VolumesSnapshotTestJSON-1486814120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-50a1e8fd-cb4f-4f84-abb1-af25f9024db8 -F qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-50a1e8fd-cb4f-4f84-abb1-af25f9024db8.b2ec06a6-827a-4652-a161-7c9335ae3551" returned: 0 in 0.842s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:25:56 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-5a9edb4d-aaeb-4709-ab64-82d72beb7426 tempest-VolumesSnapshotTestJSON-1486814120 None] /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-50a1e8fd-cb4f-4f84-abb1-af25f9024db8.b2ec06a6-827a-4652-a161-7c9335ae3551 is being set with open permissions: ugo+rw Nov 06 15:25:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5a9edb4d-aaeb-4709-ab64-82d72beb7426 tempest-VolumesSnapshotTestJSON-1486814120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-50a1e8fd-cb4f-4f84-abb1-af25f9024db8.b2ec06a6-827a-4652-a161-7c9335ae3551 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:25:56 devstack sudo[95712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-50a1e8fd-cb4f-4f84-abb1-af25f9024db8.b2ec06a6-827a-4652-a161-7c9335ae3551 Nov 06 15:25:56 devstack sudo[95712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:25:57 devstack sudo[95712]: pam_unix(sudo:session): session closed for user root Nov 06 15:25:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5a9edb4d-aaeb-4709-ab64-82d72beb7426 tempest-VolumesSnapshotTestJSON-1486814120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-50a1e8fd-cb4f-4f84-abb1-af25f9024db8.b2ec06a6-827a-4652-a161-7c9335ae3551" returned: 0 in 0.928s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:25:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5a9edb4d-aaeb-4709-ab64-82d72beb7426 tempest-VolumesSnapshotTestJSON-1486814120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-50a1e8fd-cb4f-4f84-abb1-af25f9024db8.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:25:57 devstack sudo[95728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-50a1e8fd-cb4f-4f84-abb1-af25f9024db8.info Nov 06 15:25:57 devstack sudo[95728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:25:57 devstack sudo[95728]: pam_unix(sudo:session): session closed for user root Nov 06 15:25:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5a9edb4d-aaeb-4709-ab64-82d72beb7426 tempest-VolumesSnapshotTestJSON-1486814120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-50a1e8fd-cb4f-4f84-abb1-af25f9024db8.info" returned: 0 in 0.470s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:25:57 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-5a9edb4d-aaeb-4709-ab64-82d72beb7426 tempest-VolumesSnapshotTestJSON-1486814120 None] /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-50a1e8fd-cb4f-4f84-abb1-af25f9024db8.info is being set with open permissions: ugo+rw Nov 06 15:25:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5a9edb4d-aaeb-4709-ab64-82d72beb7426 tempest-VolumesSnapshotTestJSON-1486814120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-50a1e8fd-cb4f-4f84-abb1-af25f9024db8.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:25:58 devstack sudo[95736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-50a1e8fd-cb4f-4f84-abb1-af25f9024db8.info Nov 06 15:25:58 devstack sudo[95736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:25:58 devstack sudo[95736]: pam_unix(sudo:session): session closed for user root Nov 06 15:25:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5a9edb4d-aaeb-4709-ab64-82d72beb7426 tempest-VolumesSnapshotTestJSON-1486814120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-50a1e8fd-cb4f-4f84-abb1-af25f9024db8.info" returned: 0 in 0.503s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:25:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5a9edb4d-aaeb-4709-ab64-82d72beb7426 tempest-VolumesSnapshotTestJSON-1486814120 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.655s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:25:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c3b9a3da-ece0-4155-a5c6-862f0798a435 tempest-VolumesActionsTest-2124293081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.637s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:25:58 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c3b9a3da-ece0-4155-a5c6-862f0798a435 tempest-VolumesActionsTest-2124293081 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:25:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1346148955',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=195d657d-ada6-43cd-8b10-a43ff3c43b62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d0b6abc042242be823fc382d007712a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:25:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:25:55Z,use_quota=True,user_id='abff5ddd914544e7a269405c2ec272b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:25:58 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-c3b9a3da-ece0-4155-a5c6-862f0798a435 tempest-VolumesActionsTest-2124293081 None] Creating volume 195d657d-ada6-43cd-8b10-a43ff3c43b62 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:25:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c3b9a3da-ece0-4155-a5c6-862f0798a435 tempest-VolumesActionsTest-2124293081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:25:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c3b9a3da-ece0-4155-a5c6-862f0798a435 tempest-VolumesActionsTest-2124293081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:25:58 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c3b9a3da-ece0-4155-a5c6-862f0798a435 tempest-VolumesActionsTest-2124293081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:25:58 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c3b9a3da-ece0-4155-a5c6-862f0798a435 tempest-VolumesActionsTest-2124293081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:25:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c3b9a3da-ece0-4155-a5c6-862f0798a435 tempest-VolumesActionsTest-2124293081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:25:58 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c3b9a3da-ece0-4155-a5c6-862f0798a435 tempest-VolumesActionsTest-2124293081 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:25:58 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-c3b9a3da-ece0-4155-a5c6-862f0798a435 tempest-VolumesActionsTest-2124293081 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:25:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c3b9a3da-ece0-4155-a5c6-862f0798a435 tempest-VolumesActionsTest-2124293081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-195d657d-ada6-43cd-8b10-a43ff3c43b62 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:25:58 devstack sudo[95744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-195d657d-ada6-43cd-8b10-a43ff3c43b62 1073741824 Nov 06 15:25:58 devstack sudo[95744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:25:58 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-5a9edb4d-aaeb-4709-ab64-82d72beb7426 tempest-VolumesSnapshotTestJSON-1486814120 None] Create snapshot completed successfully Nov 06 15:25:59 devstack sudo[95744]: pam_unix(sudo:session): session closed for user root Nov 06 15:25:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c3b9a3da-ece0-4155-a5c6-862f0798a435 tempest-VolumesActionsTest-2124293081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-195d657d-ada6-43cd-8b10-a43ff3c43b62 1073741824" returned: 0 in 0.720s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:25:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c3b9a3da-ece0-4155-a5c6-862f0798a435 tempest-VolumesActionsTest-2124293081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-195d657d-ada6-43cd-8b10-a43ff3c43b62 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:25:59 devstack sudo[95758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-195d657d-ada6-43cd-8b10-a43ff3c43b62 Nov 06 15:25:59 devstack sudo[95758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:25:59 devstack sudo[95758]: pam_unix(sudo:session): session closed for user root Nov 06 15:25:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c3b9a3da-ece0-4155-a5c6-862f0798a435 tempest-VolumesActionsTest-2124293081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-195d657d-ada6-43cd-8b10-a43ff3c43b62" returned: 0 in 0.491s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:25:59 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c3b9a3da-ece0-4155-a5c6-862f0798a435 tempest-VolumesActionsTest-2124293081 None] <== create_volume: return (1315ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:25:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c3b9a3da-ece0-4155-a5c6-862f0798a435 tempest-VolumesActionsTest-2124293081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.324s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:25:59 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c3b9a3da-ece0-4155-a5c6-862f0798a435 tempest-VolumesActionsTest-2124293081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f900a35e-d144-4dac-a0d4-7fc858ee5d4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-195d657d-ada6-43cd-8b10-a43ff3c43b62', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:25:59 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c3b9a3da-ece0-4155-a5c6-862f0798a435 tempest-VolumesActionsTest-2124293081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1de6406b-583c-4334-b312-71a25bfc1e39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:25:59 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-c3b9a3da-ece0-4155-a5c6-862f0798a435 tempest-VolumesActionsTest-2124293081 None] Volume volume-195d657d-ada6-43cd-8b10-a43ff3c43b62 (195d657d-ada6-43cd-8b10-a43ff3c43b62): created successfully Nov 06 15:25:59 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c3b9a3da-ece0-4155-a5c6-862f0798a435 tempest-VolumesActionsTest-2124293081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1de6406b-583c-4334-b312-71a25bfc1e39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:25:59 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c3b9a3da-ece0-4155-a5c6-862f0798a435 tempest-VolumesActionsTest-2124293081 None] Flow 'volume_create_manager' (b5f9ed94-c2bb-47e0-b223-8201d6a181f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:26:00 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-c3b9a3da-ece0-4155-a5c6-862f0798a435 tempest-VolumesActionsTest-2124293081 None] Created volume successfully. Nov 06 15:26:00 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-3f3dd426-2a8b-4027-803b-2b6ae56c1a57 tempest-VolumesActionsTest-2124293081 None] Acquiring lock "cinder-195d657d-ada6-43cd-8b10-a43ff3c43b62" by "attach_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:26:00 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-3f3dd426-2a8b-4027-803b-2b6ae56c1a57 tempest-VolumesActionsTest-2124293081 None] Lock "cinder-195d657d-ada6-43cd-8b10-a43ff3c43b62" acquired by "attach_volume" :: waited 0.025s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:26:00 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-3f3dd426-2a8b-4027-803b-2b6ae56c1a57 tempest-VolumesActionsTest-2124293081 None] Attaching volume 195d657d-ada6-43cd-8b10-a43ff3c43b62 to instance 4d028e60-5950-4734-ad54-79231a664f88 at mountpoint /dev/vdb on host None. Nov 06 15:26:00 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-3f3dd426-2a8b-4027-803b-2b6ae56c1a57 tempest-VolumesActionsTest-2124293081 None] Attach volume completed successfully. Nov 06 15:26:00 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-3f3dd426-2a8b-4027-803b-2b6ae56c1a57 tempest-VolumesActionsTest-2124293081 None] Lock "cinder-195d657d-ada6-43cd-8b10-a43ff3c43b62" released by "attach_volume" :: held 0.206s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:26:00 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-8606c102-41ad-4260-9797-03db391bd338 tempest-VolumesSnapshotTestJSON-1486814120 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:26:00 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8606c102-41ad-4260-9797-03db391bd338 tempest-VolumesSnapshotTestJSON-1486814120 None] Flow 'volume_create_manager' (7bb48325-1a99-43d2-b0d8-23f46782d304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:26:00 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8606c102-41ad-4260-9797-03db391bd338 tempest-VolumesSnapshotTestJSON-1486814120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a5017c8-a1e4-49c0-9740-7f692a5adf82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:26:00 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8606c102-41ad-4260-9797-03db391bd338 tempest-VolumesSnapshotTestJSON-1486814120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a5017c8-a1e4-49c0-9740-7f692a5adf82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:26:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-343849194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=728a7a45-4540-4d1d-b350-f07c69c60d96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d46a704379244812b425cfa29943fdb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:26:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b2ec06a6-827a-4652-a161-7c9335ae3551,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:26:01Z,use_quota=True,user_id='481d1eaabb624d6c958d88d08f23e8fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:26:00 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8606c102-41ad-4260-9797-03db391bd338 tempest-VolumesSnapshotTestJSON-1486814120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e47f7119-a30c-40ce-a3e3-53e79fb33156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:26:00 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8606c102-41ad-4260-9797-03db391bd338 tempest-VolumesSnapshotTestJSON-1486814120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e47f7119-a30c-40ce-a3e3-53e79fb33156) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:26:00 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8606c102-41ad-4260-9797-03db391bd338 tempest-VolumesSnapshotTestJSON-1486814120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4acd390-a36c-4620-9702-130826261c91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:26:00 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8606c102-41ad-4260-9797-03db391bd338 tempest-VolumesSnapshotTestJSON-1486814120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4acd390-a36c-4620-9702-130826261c91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '728a7a45-4540-4d1d-b350-f07c69c60d96', 'volume_name': 'volume-728a7a45-4540-4d1d-b350-f07c69c60d96', 'volume_size': 1, 'snapshot_id': 'b2ec06a6-827a-4652-a161-7c9335ae3551'}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:26:00 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8606c102-41ad-4260-9797-03db391bd338 tempest-VolumesSnapshotTestJSON-1486814120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a7b2423-3826-4c41-ae5d-cded63a8a5c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:26:00 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8606c102-41ad-4260-9797-03db391bd338 tempest-VolumesSnapshotTestJSON-1486814120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a7b2423-3826-4c41-ae5d-cded63a8a5c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:26:00 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8606c102-41ad-4260-9797-03db391bd338 tempest-VolumesSnapshotTestJSON-1486814120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40e71d35-a724-4c34-b55b-c973059c4cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:26:00 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-8606c102-41ad-4260-9797-03db391bd338 tempest-VolumesSnapshotTestJSON-1486814120 None] Volume 728a7a45-4540-4d1d-b350-f07c69c60d96: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-728a7a45-4540-4d1d-b350-f07c69c60d96', 'volume_size': 1, 'snapshot_id': 'b2ec06a6-827a-4652-a161-7c9335ae3551'} Nov 06 15:26:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8606c102-41ad-4260-9797-03db391bd338 tempest-VolumesSnapshotTestJSON-1486814120 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:26:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8606c102-41ad-4260-9797-03db391bd338 tempest-VolumesSnapshotTestJSON-1486814120 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:26:00 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-8606c102-41ad-4260-9797-03db391bd338 tempest-VolumesSnapshotTestJSON-1486814120 None] Acquiring lock "cinder-quobyte-b2ec06a6-827a-4652-a161-7c9335ae3551-728a7a45-4540-4d1d-b350-f07c69c60d96" by "_create_volume_from_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:26:00 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-8606c102-41ad-4260-9797-03db391bd338 tempest-VolumesSnapshotTestJSON-1486814120 None] Lock "cinder-quobyte-b2ec06a6-827a-4652-a161-7c9335ae3551-728a7a45-4540-4d1d-b350-f07c69c60d96" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:26:00 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-8606c102-41ad-4260-9797-03db391bd338 tempest-VolumesSnapshotTestJSON-1486814120 None] Creating volume 728a7a45-4540-4d1d-b350-f07c69c60d96 from snapshot b2ec06a6-827a-4652-a161-7c9335ae3551 {{(pid=87132) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 06 15:26:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8606c102-41ad-4260-9797-03db391bd338 tempest-VolumesSnapshotTestJSON-1486814120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:26:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8606c102-41ad-4260-9797-03db391bd338 tempest-VolumesSnapshotTestJSON-1486814120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:26:00 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-8606c102-41ad-4260-9797-03db391bd338 tempest-VolumesSnapshotTestJSON-1486814120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:26:00 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-8606c102-41ad-4260-9797-03db391bd338 tempest-VolumesSnapshotTestJSON-1486814120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:26:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8606c102-41ad-4260-9797-03db391bd338 tempest-VolumesSnapshotTestJSON-1486814120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:26:00 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-8606c102-41ad-4260-9797-03db391bd338 tempest-VolumesSnapshotTestJSON-1486814120 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:26:00 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-8606c102-41ad-4260-9797-03db391bd338 tempest-VolumesSnapshotTestJSON-1486814120 None] Acquiring lock "cinder-quobyte-728a7a45-4540-4d1d-b350-f07c69c60d96" by "_copy_volume_from_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:26:00 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-8606c102-41ad-4260-9797-03db391bd338 tempest-VolumesSnapshotTestJSON-1486814120 None] Lock "cinder-quobyte-728a7a45-4540-4d1d-b350-f07c69c60d96" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:26:00 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-8606c102-41ad-4260-9797-03db391bd338 tempest-VolumesSnapshotTestJSON-1486814120 None] snapshot: b2ec06a6-827a-4652-a161-7c9335ae3551, volume: 728a7a45-4540-4d1d-b350-f07c69c60d96, {{(pid=87132) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 06 15:26:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8606c102-41ad-4260-9797-03db391bd338 tempest-VolumesSnapshotTestJSON-1486814120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:26:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8606c102-41ad-4260-9797-03db391bd338 tempest-VolumesSnapshotTestJSON-1486814120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:26:00 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-8606c102-41ad-4260-9797-03db391bd338 tempest-VolumesSnapshotTestJSON-1486814120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:26:00 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-8606c102-41ad-4260-9797-03db391bd338 tempest-VolumesSnapshotTestJSON-1486814120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:26:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8606c102-41ad-4260-9797-03db391bd338 tempest-VolumesSnapshotTestJSON-1486814120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:26:00 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[f20b912a-688a-4aed-9922-b5dbc918d596]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:26:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8606c102-41ad-4260-9797-03db391bd338 tempest-VolumesSnapshotTestJSON-1486814120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-50a1e8fd-cb4f-4f84-abb1-af25f9024db8.b2ec06a6-827a-4652-a161-7c9335ae3551 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:26:01 devstack sudo[95789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-50a1e8fd-cb4f-4f84-abb1-af25f9024db8.b2ec06a6-827a-4652-a161-7c9335ae3551 Nov 06 15:26:01 devstack sudo[95789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:26:01 devstack sudo[95789]: pam_unix(sudo:session): session closed for user root Nov 06 15:26:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8606c102-41ad-4260-9797-03db391bd338 tempest-VolumesSnapshotTestJSON-1486814120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-50a1e8fd-cb4f-4f84-abb1-af25f9024db8.b2ec06a6-827a-4652-a161-7c9335ae3551" returned: 0 in 0.884s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:26:01 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-8606c102-41ad-4260-9797-03db391bd338 tempest-VolumesSnapshotTestJSON-1486814120 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-50a1e8fd-cb4f-4f84-abb1-af25f9024db8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 15:26:01 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[de0eab40-d23d-4354-b1e0-fcf96b45bd0e]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:26:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8606c102-41ad-4260-9797-03db391bd338 tempest-VolumesSnapshotTestJSON-1486814120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-50a1e8fd-cb4f-4f84-abb1-af25f9024db8 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:26:01 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-a5e2a70b-3814-40ff-abb7-56458fe99b77 tempest-VolumesActionsTest-2061083264 None] Terminate volume connection completed successfully. Nov 06 15:26:01 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a5e2a70b-3814-40ff-abb7-56458fe99b77 tempest-VolumesActionsTest-2061083264 None] Acquiring lock "cinder-195d657d-ada6-43cd-8b10-a43ff3c43b62-detach_volume" by "detach_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:26:01 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a5e2a70b-3814-40ff-abb7-56458fe99b77 tempest-VolumesActionsTest-2061083264 None] Lock "cinder-195d657d-ada6-43cd-8b10-a43ff3c43b62-detach_volume" acquired by "detach_volume" :: waited 0.022s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:26:02 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-a5e2a70b-3814-40ff-abb7-56458fe99b77 tempest-VolumesActionsTest-2061083264 None] Detaching volume 195d657d-ada6-43cd-8b10-a43ff3c43b62 from instance 4d028e60-5950-4734-ad54-79231a664f88. Nov 06 15:26:02 devstack sudo[95796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-50a1e8fd-cb4f-4f84-abb1-af25f9024db8 Nov 06 15:26:02 devstack sudo[95796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:26:02 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-a5e2a70b-3814-40ff-abb7-56458fe99b77 tempest-VolumesActionsTest-2061083264 None] Detach volume completed successfully. Nov 06 15:26:02 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a5e2a70b-3814-40ff-abb7-56458fe99b77 tempest-VolumesActionsTest-2061083264 None] Lock "cinder-195d657d-ada6-43cd-8b10-a43ff3c43b62-detach_volume" released by "detach_volume" :: held 0.169s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:26:02 devstack sudo[95796]: pam_unix(sudo:session): session closed for user root Nov 06 15:26:02 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c8f3b84c-5ac0-4fb1-8c95-7ae5623e6be4 tempest-VolumesActionsTest-2124293081 None] Acquiring lock "cinder-195d657d-ada6-43cd-8b10-a43ff3c43b62-detach_volume" by "detach_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:26:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8606c102-41ad-4260-9797-03db391bd338 tempest-VolumesSnapshotTestJSON-1486814120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-50a1e8fd-cb4f-4f84-abb1-af25f9024db8" returned: 0 in 0.676s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:26:02 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-8606c102-41ad-4260-9797-03db391bd338 tempest-VolumesSnapshotTestJSON-1486814120 None] will copy from snapshot at /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-50a1e8fd-cb4f-4f84-abb1-af25f9024db8 {{(pid=87132) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 06 15:26:02 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-8606c102-41ad-4260-9797-03db391bd338 tempest-VolumesSnapshotTestJSON-1486814120 None] Creating direct copy from snapshot {{(pid=87132) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 06 15:26:02 devstack cinder-volume[87132]: DEBUG cinder.utils [None req-8606c102-41ad-4260-9797-03db391bd338 tempest-VolumesSnapshotTestJSON-1486814120 None] Path /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-728a7a45-4540-4d1d-b350-f07c69c60d96 not found in is_blk_device check {{(pid=87132) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 06 15:26:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8606c102-41ad-4260-9797-03db391bd338 tempest-VolumesSnapshotTestJSON-1486814120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-50a1e8fd-cb4f-4f84-abb1-af25f9024db8 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-728a7a45-4540-4d1d-b350-f07c69c60d96 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:26:02 devstack sudo[95802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-50a1e8fd-cb4f-4f84-abb1-af25f9024db8 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-728a7a45-4540-4d1d-b350-f07c69c60d96 Nov 06 15:26:02 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c8f3b84c-5ac0-4fb1-8c95-7ae5623e6be4 tempest-VolumesActionsTest-2124293081 None] Lock "cinder-195d657d-ada6-43cd-8b10-a43ff3c43b62-detach_volume" acquired by "detach_volume" :: waited 0.058s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:26:02 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-c8f3b84c-5ac0-4fb1-8c95-7ae5623e6be4 tempest-VolumesActionsTest-2124293081 None] Volume detach called, but volume not attached. Nov 06 15:26:02 devstack sudo[95802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:26:02 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c8f3b84c-5ac0-4fb1-8c95-7ae5623e6be4 tempest-VolumesActionsTest-2124293081 None] Lock "cinder-195d657d-ada6-43cd-8b10-a43ff3c43b62-detach_volume" released by "detach_volume" :: held 0.033s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:26:02 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-fe84cf1a-8c44-4aac-a368-4b537bc6eb62 tempest-VolumesActionsTest-2124293081 None] Acquiring lock "cinder-195d657d-ada6-43cd-8b10-a43ff3c43b62-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:26:02 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-fe84cf1a-8c44-4aac-a368-4b537bc6eb62 tempest-VolumesActionsTest-2124293081 None] Lock "cinder-195d657d-ada6-43cd-8b10-a43ff3c43b62-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:26:03 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-fe84cf1a-8c44-4aac-a368-4b537bc6eb62 tempest-VolumesActionsTest-2124293081 None] Acquiring lock "cinder-quobyte-195d657d-ada6-43cd-8b10-a43ff3c43b62" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:26:03 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-fe84cf1a-8c44-4aac-a368-4b537bc6eb62 tempest-VolumesActionsTest-2124293081 None] Lock "cinder-quobyte-195d657d-ada6-43cd-8b10-a43ff3c43b62" acquired by "delete_volume" :: waited 0.037s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:26:03 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[b057e315-0c2c-4f2a-b9b1-723fefd2ea02]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:26:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-fe84cf1a-8c44-4aac-a368-4b537bc6eb62 tempest-VolumesActionsTest-2124293081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-195d657d-ada6-43cd-8b10-a43ff3c43b62 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:26:03 devstack sudo[95808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-195d657d-ada6-43cd-8b10-a43ff3c43b62 Nov 06 15:26:03 devstack sudo[95808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:26:04 devstack sudo[95808]: pam_unix(sudo:session): session closed for user root Nov 06 15:26:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-fe84cf1a-8c44-4aac-a368-4b537bc6eb62 tempest-VolumesActionsTest-2124293081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-195d657d-ada6-43cd-8b10-a43ff3c43b62" returned: 0 in 0.957s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:26:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-fe84cf1a-8c44-4aac-a368-4b537bc6eb62 tempest-VolumesActionsTest-2124293081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-195d657d-ada6-43cd-8b10-a43ff3c43b62 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:26:04 devstack sudo[95819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-195d657d-ada6-43cd-8b10-a43ff3c43b62 Nov 06 15:26:04 devstack sudo[95819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:26:04 devstack sudo[95819]: pam_unix(sudo:session): session closed for user root Nov 06 15:26:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-fe84cf1a-8c44-4aac-a368-4b537bc6eb62 tempest-VolumesActionsTest-2124293081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-195d657d-ada6-43cd-8b10-a43ff3c43b62" returned: 0 in 0.763s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:26:04 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-fe84cf1a-8c44-4aac-a368-4b537bc6eb62 tempest-VolumesActionsTest-2124293081 None] Lock "cinder-quobyte-195d657d-ada6-43cd-8b10-a43ff3c43b62" released by "delete_volume" :: held 1.837s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:26:05 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-fe84cf1a-8c44-4aac-a368-4b537bc6eb62 tempest-VolumesActionsTest-2124293081 None] Created reservations ['c9622e50-2de9-4885-bf14-abb4912897f5', 'e9aa432f-37f9-4d1c-92ab-11bd23d0bf77', '54d12a2f-6202-48c1-a592-32b82b54a2e2', '79e59a00-dd96-4b68-a451-01fc4d145b76'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:26:05 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-24ff60f4-2277-4e48-8b73-47adb1e2dd0f tempest-TestStampPattern-2123587362 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:26:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-24ff60f4-2277-4e48-8b73-47adb1e2dd0f tempest-TestStampPattern-2123587362 None] Flow 'volume_create_manager' (5838b322-ef81-4e98-96c4-513973420123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:26:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-24ff60f4-2277-4e48-8b73-47adb1e2dd0f tempest-TestStampPattern-2123587362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b497330-8df4-496e-bc58-47f78a5c4406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:26:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-fe84cf1a-8c44-4aac-a368-4b537bc6eb62 tempest-VolumesActionsTest-2124293081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:26:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-fe84cf1a-8c44-4aac-a368-4b537bc6eb62 tempest-VolumesActionsTest-2124293081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:26:05 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-fe84cf1a-8c44-4aac-a368-4b537bc6eb62 tempest-VolumesActionsTest-2124293081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:26:05 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-fe84cf1a-8c44-4aac-a368-4b537bc6eb62 tempest-VolumesActionsTest-2124293081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:26:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-fe84cf1a-8c44-4aac-a368-4b537bc6eb62 tempest-VolumesActionsTest-2124293081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:26:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-fe84cf1a-8c44-4aac-a368-4b537bc6eb62 tempest-VolumesActionsTest-2124293081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:26:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-24ff60f4-2277-4e48-8b73-47adb1e2dd0f tempest-TestStampPattern-2123587362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b497330-8df4-496e-bc58-47f78a5c4406) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:26:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1444679072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70555739-c658-4506-9144-58189ae89625,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b9e9e9c5e2743ef89ba1b2dcb92ad26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:26:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:26:05Z,use_quota=True,user_id='1ae967d13b81479296624dbd445e877c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:26:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-24ff60f4-2277-4e48-8b73-47adb1e2dd0f tempest-TestStampPattern-2123587362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d86224c8-4532-4eb4-8eb2-16be78c0f34b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:26:05 devstack sudo[95824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:26:05 devstack sudo[95824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:26:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-24ff60f4-2277-4e48-8b73-47adb1e2dd0f tempest-TestStampPattern-2123587362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d86224c8-4532-4eb4-8eb2-16be78c0f34b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:26:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-24ff60f4-2277-4e48-8b73-47adb1e2dd0f tempest-TestStampPattern-2123587362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bbc764a-ab03-4254-a48c-23ca1b0b06fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:26:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-24ff60f4-2277-4e48-8b73-47adb1e2dd0f tempest-TestStampPattern-2123587362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bbc764a-ab03-4254-a48c-23ca1b0b06fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70555739-c658-4506-9144-58189ae89625', 'volume_name': 'volume-70555739-c658-4506-9144-58189ae89625', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:26:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-24ff60f4-2277-4e48-8b73-47adb1e2dd0f tempest-TestStampPattern-2123587362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38b2b119-256f-46cb-8c52-0d5a7045a900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:26:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-24ff60f4-2277-4e48-8b73-47adb1e2dd0f tempest-TestStampPattern-2123587362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38b2b119-256f-46cb-8c52-0d5a7045a900) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:26:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-24ff60f4-2277-4e48-8b73-47adb1e2dd0f tempest-TestStampPattern-2123587362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27ef8fb9-1a10-4c41-b176-c0a7b852ec64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:26:05 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-24ff60f4-2277-4e48-8b73-47adb1e2dd0f tempest-TestStampPattern-2123587362 None] Volume 70555739-c658-4506-9144-58189ae89625: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70555739-c658-4506-9144-58189ae89625', 'volume_size': 1} Nov 06 15:26:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-24ff60f4-2277-4e48-8b73-47adb1e2dd0f tempest-TestStampPattern-2123587362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:26:06 devstack sudo[95824]: pam_unix(sudo:session): session closed for user root Nov 06 15:26:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-fe84cf1a-8c44-4aac-a368-4b537bc6eb62 tempest-VolumesActionsTest-2124293081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 1.098s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:26:06 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-fe84cf1a-8c44-4aac-a368-4b537bc6eb62 tempest-VolumesActionsTest-2124293081 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:26:06 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-fe84cf1a-8c44-4aac-a368-4b537bc6eb62 tempest-VolumesActionsTest-2124293081 None] Deleted volume successfully. Nov 06 15:26:06 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-fe84cf1a-8c44-4aac-a368-4b537bc6eb62 tempest-VolumesActionsTest-2124293081 None] Lock "cinder-195d657d-ada6-43cd-8b10-a43ff3c43b62-delete_volume" released by "delete_volume" :: held 3.907s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:26:08 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 15:26:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:26:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:26:08 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:26:08 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:26:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:26:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:26:08 devstack sudo[95851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:26:08 devstack sudo[95851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:26:09 devstack sudo[95851]: pam_unix(sudo:session): session closed for user root Nov 06 15:26:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 1.179s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:26:09 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:26:09 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Running periodic task VolumeManager._thread_info {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 15:26:09 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] thread count: 28 {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 15:26:09 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] thread info: [<_MainThread(MainThread, started 140011251929216)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 06 15:26:15 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:UPDATE=50,cinder:INSERT=14,cinder:DELETE=2,cinder:SELECT=38 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 15:26:15 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae342732-042f-4cd6-a41e-225bddd34315 tempest-VolumesActionsTest-2124293081 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:26:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ae342732-042f-4cd6-a41e-225bddd34315 tempest-VolumesActionsTest-2124293081 None] Flow 'volume_create_manager' (fcfe2a66-1d5f-4263-ae6d-71376743feda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:26:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ae342732-042f-4cd6-a41e-225bddd34315 tempest-VolumesActionsTest-2124293081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2df0a9c-9e90-41ff-af76-3f2e1eb23db4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:26:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ae342732-042f-4cd6-a41e-225bddd34315 tempest-VolumesActionsTest-2124293081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2df0a9c-9e90-41ff-af76-3f2e1eb23db4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:26:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-687097120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b49a94ef-b49f-4998-bfe9-d82f8de789d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d0b6abc042242be823fc382d007712a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:26:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:26:16Z,use_quota=True,user_id='abff5ddd914544e7a269405c2ec272b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:26:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ae342732-042f-4cd6-a41e-225bddd34315 tempest-VolumesActionsTest-2124293081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79e3fee4-f06b-4da9-9f54-2a55e1545d88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:26:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ae342732-042f-4cd6-a41e-225bddd34315 tempest-VolumesActionsTest-2124293081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79e3fee4-f06b-4da9-9f54-2a55e1545d88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:26:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ae342732-042f-4cd6-a41e-225bddd34315 tempest-VolumesActionsTest-2124293081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f16cbd8-9265-4dee-be2e-a0f19180ed1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:26:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ae342732-042f-4cd6-a41e-225bddd34315 tempest-VolumesActionsTest-2124293081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f16cbd8-9265-4dee-be2e-a0f19180ed1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b49a94ef-b49f-4998-bfe9-d82f8de789d9', 'volume_name': 'volume-b49a94ef-b49f-4998-bfe9-d82f8de789d9', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:26:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ae342732-042f-4cd6-a41e-225bddd34315 tempest-VolumesActionsTest-2124293081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a19c22dc-aac7-4def-9fcc-69d230cce9fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:26:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ae342732-042f-4cd6-a41e-225bddd34315 tempest-VolumesActionsTest-2124293081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a19c22dc-aac7-4def-9fcc-69d230cce9fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:26:16 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ae342732-042f-4cd6-a41e-225bddd34315 tempest-VolumesActionsTest-2124293081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (998ff821-fb54-4431-b572-352c7ac33612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:26:16 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-ae342732-042f-4cd6-a41e-225bddd34315 tempest-VolumesActionsTest-2124293081 None] Volume b49a94ef-b49f-4998-bfe9-d82f8de789d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b49a94ef-b49f-4998-bfe9-d82f8de789d9', 'volume_size': 1} Nov 06 15:26:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ae342732-042f-4cd6-a41e-225bddd34315 tempest-VolumesActionsTest-2124293081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:26:16 devstack sudo[95802]: pam_unix(sudo:session): session closed for user root Nov 06 15:26:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8606c102-41ad-4260-9797-03db391bd338 tempest-VolumesSnapshotTestJSON-1486814120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-50a1e8fd-cb4f-4f84-abb1-af25f9024db8 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-728a7a45-4540-4d1d-b350-f07c69c60d96" returned: 0 in 13.717s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:26:16 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-8606c102-41ad-4260-9797-03db391bd338 tempest-VolumesSnapshotTestJSON-1486814120 None] Image conversion details: src /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-50a1e8fd-cb4f-4f84-abb1-af25f9024db8, size 1024.00 MB, duration 13.72 sec, destination /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-728a7a45-4540-4d1d-b350-f07c69c60d96 {{(pid=87132) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 06 15:26:16 devstack cinder-volume[87132]: INFO cinder.image.image_utils [None req-8606c102-41ad-4260-9797-03db391bd338 tempest-VolumesSnapshotTestJSON-1486814120 None] Converted 1024.00 MB image at 74.65 MB/s Nov 06 15:26:16 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-8606c102-41ad-4260-9797-03db391bd338 tempest-VolumesSnapshotTestJSON-1486814120 None] /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-728a7a45-4540-4d1d-b350-f07c69c60d96 is being set with open permissions: ugo+rw Nov 06 15:26:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8606c102-41ad-4260-9797-03db391bd338 tempest-VolumesSnapshotTestJSON-1486814120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-728a7a45-4540-4d1d-b350-f07c69c60d96 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:26:16 devstack sudo[95916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-728a7a45-4540-4d1d-b350-f07c69c60d96 Nov 06 15:26:16 devstack sudo[95916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:26:16 devstack sudo[95916]: pam_unix(sudo:session): session closed for user root Nov 06 15:26:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8606c102-41ad-4260-9797-03db391bd338 tempest-VolumesSnapshotTestJSON-1486814120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-728a7a45-4540-4d1d-b350-f07c69c60d96" returned: 0 in 0.348s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:26:16 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-8606c102-41ad-4260-9797-03db391bd338 tempest-VolumesSnapshotTestJSON-1486814120 None] Lock "cinder-quobyte-728a7a45-4540-4d1d-b350-f07c69c60d96" released by "_copy_volume_from_snapshot" :: held 15.802s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:26:16 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-8606c102-41ad-4260-9797-03db391bd338 tempest-VolumesSnapshotTestJSON-1486814120 None] Lock "cinder-quobyte-b2ec06a6-827a-4652-a161-7c9335ae3551-728a7a45-4540-4d1d-b350-f07c69c60d96" released by "_create_volume_from_snapshot" :: held 15.901s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:26:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8606c102-41ad-4260-9797-03db391bd338 tempest-VolumesSnapshotTestJSON-1486814120 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 15.920s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:26:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-24ff60f4-2277-4e48-8b73-47adb1e2dd0f tempest-TestStampPattern-2123587362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.802s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:26:16 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-24ff60f4-2277-4e48-8b73-47adb1e2dd0f tempest-TestStampPattern-2123587362 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:26:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1444679072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70555739-c658-4506-9144-58189ae89625,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b9e9e9c5e2743ef89ba1b2dcb92ad26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:26:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:26:05Z,use_quota=True,user_id='1ae967d13b81479296624dbd445e877c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:26:16 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-24ff60f4-2277-4e48-8b73-47adb1e2dd0f tempest-TestStampPattern-2123587362 None] Creating volume 70555739-c658-4506-9144-58189ae89625 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:26:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-24ff60f4-2277-4e48-8b73-47adb1e2dd0f tempest-TestStampPattern-2123587362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:26:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-24ff60f4-2277-4e48-8b73-47adb1e2dd0f tempest-TestStampPattern-2123587362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:26:16 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-24ff60f4-2277-4e48-8b73-47adb1e2dd0f tempest-TestStampPattern-2123587362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:26:16 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-24ff60f4-2277-4e48-8b73-47adb1e2dd0f tempest-TestStampPattern-2123587362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:26:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-24ff60f4-2277-4e48-8b73-47adb1e2dd0f tempest-TestStampPattern-2123587362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:26:16 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-24ff60f4-2277-4e48-8b73-47adb1e2dd0f tempest-TestStampPattern-2123587362 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:26:16 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-24ff60f4-2277-4e48-8b73-47adb1e2dd0f tempest-TestStampPattern-2123587362 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:26:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-24ff60f4-2277-4e48-8b73-47adb1e2dd0f tempest-TestStampPattern-2123587362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-70555739-c658-4506-9144-58189ae89625 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:26:16 devstack sudo[95924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-70555739-c658-4506-9144-58189ae89625 1073741824 Nov 06 15:26:16 devstack sudo[95924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:26:16 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8606c102-41ad-4260-9797-03db391bd338 tempest-VolumesSnapshotTestJSON-1486814120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40e71d35-a724-4c34-b55b-c973059c4cfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-728a7a45-4540-4d1d-b350-f07c69c60d96', 'volume_size': 1, 'snapshot_id': 'b2ec06a6-827a-4652-a161-7c9335ae3551'}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:26:16 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8606c102-41ad-4260-9797-03db391bd338 tempest-VolumesSnapshotTestJSON-1486814120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5b948d5-0cf3-4c30-8e51-b78e0410db9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:26:16 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-8606c102-41ad-4260-9797-03db391bd338 tempest-VolumesSnapshotTestJSON-1486814120 None] Volume volume-728a7a45-4540-4d1d-b350-f07c69c60d96 (728a7a45-4540-4d1d-b350-f07c69c60d96): created successfully Nov 06 15:26:16 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8606c102-41ad-4260-9797-03db391bd338 tempest-VolumesSnapshotTestJSON-1486814120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5b948d5-0cf3-4c30-8e51-b78e0410db9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:26:16 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8606c102-41ad-4260-9797-03db391bd338 tempest-VolumesSnapshotTestJSON-1486814120 None] Flow 'volume_create_manager' (7bb48325-1a99-43d2-b0d8-23f46782d304) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:26:16 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-8606c102-41ad-4260-9797-03db391bd338 tempest-VolumesSnapshotTestJSON-1486814120 None] Created volume successfully. Nov 06 15:26:17 devstack sudo[95924]: pam_unix(sudo:session): session closed for user root Nov 06 15:26:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-24ff60f4-2277-4e48-8b73-47adb1e2dd0f tempest-TestStampPattern-2123587362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-70555739-c658-4506-9144-58189ae89625 1073741824" returned: 0 in 0.526s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:26:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-24ff60f4-2277-4e48-8b73-47adb1e2dd0f tempest-TestStampPattern-2123587362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-70555739-c658-4506-9144-58189ae89625 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:26:17 devstack sudo[95931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-70555739-c658-4506-9144-58189ae89625 Nov 06 15:26:17 devstack sudo[95931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:26:17 devstack sudo[95931]: pam_unix(sudo:session): session closed for user root Nov 06 15:26:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-24ff60f4-2277-4e48-8b73-47adb1e2dd0f tempest-TestStampPattern-2123587362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-70555739-c658-4506-9144-58189ae89625" returned: 0 in 0.271s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:26:17 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-24ff60f4-2277-4e48-8b73-47adb1e2dd0f tempest-TestStampPattern-2123587362 None] <== create_volume: return (868ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:26:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-24ff60f4-2277-4e48-8b73-47adb1e2dd0f tempest-TestStampPattern-2123587362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.871s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:26:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ae342732-042f-4cd6-a41e-225bddd34315 tempest-VolumesActionsTest-2124293081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.491s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:26:17 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-ae342732-042f-4cd6-a41e-225bddd34315 tempest-VolumesActionsTest-2124293081 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:26:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-687097120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b49a94ef-b49f-4998-bfe9-d82f8de789d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d0b6abc042242be823fc382d007712a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:26:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:26:16Z,use_quota=True,user_id='abff5ddd914544e7a269405c2ec272b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:26:17 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-ae342732-042f-4cd6-a41e-225bddd34315 tempest-VolumesActionsTest-2124293081 None] Creating volume b49a94ef-b49f-4998-bfe9-d82f8de789d9 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:26:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ae342732-042f-4cd6-a41e-225bddd34315 tempest-VolumesActionsTest-2124293081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:26:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ae342732-042f-4cd6-a41e-225bddd34315 tempest-VolumesActionsTest-2124293081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:26:17 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-ae342732-042f-4cd6-a41e-225bddd34315 tempest-VolumesActionsTest-2124293081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:26:17 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-ae342732-042f-4cd6-a41e-225bddd34315 tempest-VolumesActionsTest-2124293081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:26:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ae342732-042f-4cd6-a41e-225bddd34315 tempest-VolumesActionsTest-2124293081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:26:17 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-ae342732-042f-4cd6-a41e-225bddd34315 tempest-VolumesActionsTest-2124293081 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:26:17 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-ae342732-042f-4cd6-a41e-225bddd34315 tempest-VolumesActionsTest-2124293081 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:26:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ae342732-042f-4cd6-a41e-225bddd34315 tempest-VolumesActionsTest-2124293081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b49a94ef-b49f-4998-bfe9-d82f8de789d9 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:26:17 devstack sudo[95934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b49a94ef-b49f-4998-bfe9-d82f8de789d9 1073741824 Nov 06 15:26:17 devstack sudo[95934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:26:17 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-24ff60f4-2277-4e48-8b73-47adb1e2dd0f tempest-TestStampPattern-2123587362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27ef8fb9-1a10-4c41-b176-c0a7b852ec64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70555739-c658-4506-9144-58189ae89625', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:26:17 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-24ff60f4-2277-4e48-8b73-47adb1e2dd0f tempest-TestStampPattern-2123587362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d641fb7f-30c1-4eb2-9112-7eb98bd276ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:26:17 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-24ff60f4-2277-4e48-8b73-47adb1e2dd0f tempest-TestStampPattern-2123587362 None] Volume volume-70555739-c658-4506-9144-58189ae89625 (70555739-c658-4506-9144-58189ae89625): created successfully Nov 06 15:26:17 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-24ff60f4-2277-4e48-8b73-47adb1e2dd0f tempest-TestStampPattern-2123587362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d641fb7f-30c1-4eb2-9112-7eb98bd276ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:26:17 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-24ff60f4-2277-4e48-8b73-47adb1e2dd0f tempest-TestStampPattern-2123587362 None] Flow 'volume_create_manager' (5838b322-ef81-4e98-96c4-513973420123) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:26:17 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-24ff60f4-2277-4e48-8b73-47adb1e2dd0f tempest-TestStampPattern-2123587362 None] Created volume successfully. Nov 06 15:26:18 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6cb2ba35-3b07-4e4a-b739-f6210b411e48 tempest-VolumesSnapshotTestJSON-1486814120 None] Acquiring lock "cinder-728a7a45-4540-4d1d-b350-f07c69c60d96-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:26:18 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6cb2ba35-3b07-4e4a-b739-f6210b411e48 tempest-VolumesSnapshotTestJSON-1486814120 None] Lock "cinder-728a7a45-4540-4d1d-b350-f07c69c60d96-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:26:18 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6cb2ba35-3b07-4e4a-b739-f6210b411e48 tempest-VolumesSnapshotTestJSON-1486814120 None] Acquiring lock "cinder-quobyte-728a7a45-4540-4d1d-b350-f07c69c60d96" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:26:18 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6cb2ba35-3b07-4e4a-b739-f6210b411e48 tempest-VolumesSnapshotTestJSON-1486814120 None] Lock "cinder-quobyte-728a7a45-4540-4d1d-b350-f07c69c60d96" acquired by "delete_volume" :: waited 0.035s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:26:18 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d478306-8df2-4d01-8f58-e578af9db4ca]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:26:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6cb2ba35-3b07-4e4a-b739-f6210b411e48 tempest-VolumesSnapshotTestJSON-1486814120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-728a7a45-4540-4d1d-b350-f07c69c60d96 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:26:18 devstack sudo[95967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-728a7a45-4540-4d1d-b350-f07c69c60d96 Nov 06 15:26:18 devstack sudo[95967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:26:18 devstack sudo[95934]: pam_unix(sudo:session): session closed for user root Nov 06 15:26:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ae342732-042f-4cd6-a41e-225bddd34315 tempest-VolumesActionsTest-2124293081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b49a94ef-b49f-4998-bfe9-d82f8de789d9 1073741824" returned: 0 in 0.920s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:26:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ae342732-042f-4cd6-a41e-225bddd34315 tempest-VolumesActionsTest-2124293081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b49a94ef-b49f-4998-bfe9-d82f8de789d9 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:26:18 devstack sudo[95981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b49a94ef-b49f-4998-bfe9-d82f8de789d9 Nov 06 15:26:18 devstack sudo[95981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:26:18 devstack sudo[95967]: pam_unix(sudo:session): session closed for user root Nov 06 15:26:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6cb2ba35-3b07-4e4a-b739-f6210b411e48 tempest-VolumesSnapshotTestJSON-1486814120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-728a7a45-4540-4d1d-b350-f07c69c60d96" returned: 0 in 0.651s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:26:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6cb2ba35-3b07-4e4a-b739-f6210b411e48 tempest-VolumesSnapshotTestJSON-1486814120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-728a7a45-4540-4d1d-b350-f07c69c60d96 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:26:18 devstack sudo[95981]: pam_unix(sudo:session): session closed for user root Nov 06 15:26:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ae342732-042f-4cd6-a41e-225bddd34315 tempest-VolumesActionsTest-2124293081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b49a94ef-b49f-4998-bfe9-d82f8de789d9" returned: 0 in 0.493s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:26:18 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-ae342732-042f-4cd6-a41e-225bddd34315 tempest-VolumesActionsTest-2124293081 None] <== create_volume: return (1476ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:26:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ae342732-042f-4cd6-a41e-225bddd34315 tempest-VolumesActionsTest-2124293081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.479s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:26:18 devstack sudo[95990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-728a7a45-4540-4d1d-b350-f07c69c60d96 Nov 06 15:26:18 devstack sudo[95990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:26:19 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ae342732-042f-4cd6-a41e-225bddd34315 tempest-VolumesActionsTest-2124293081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (998ff821-fb54-4431-b572-352c7ac33612) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b49a94ef-b49f-4998-bfe9-d82f8de789d9', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:26:19 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ae342732-042f-4cd6-a41e-225bddd34315 tempest-VolumesActionsTest-2124293081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (688599c8-0075-4ffb-818c-ffb8aafda26b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:26:19 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-ae342732-042f-4cd6-a41e-225bddd34315 tempest-VolumesActionsTest-2124293081 None] Volume volume-b49a94ef-b49f-4998-bfe9-d82f8de789d9 (b49a94ef-b49f-4998-bfe9-d82f8de789d9): created successfully Nov 06 15:26:19 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ae342732-042f-4cd6-a41e-225bddd34315 tempest-VolumesActionsTest-2124293081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (688599c8-0075-4ffb-818c-ffb8aafda26b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:26:19 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ae342732-042f-4cd6-a41e-225bddd34315 tempest-VolumesActionsTest-2124293081 None] Flow 'volume_create_manager' (fcfe2a66-1d5f-4263-ae6d-71376743feda) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:26:19 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-ae342732-042f-4cd6-a41e-225bddd34315 tempest-VolumesActionsTest-2124293081 None] Created volume successfully. Nov 06 15:26:19 devstack sudo[95990]: pam_unix(sudo:session): session closed for user root Nov 06 15:26:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6cb2ba35-3b07-4e4a-b739-f6210b411e48 tempest-VolumesSnapshotTestJSON-1486814120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-728a7a45-4540-4d1d-b350-f07c69c60d96" returned: 0 in 0.433s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:26:19 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6cb2ba35-3b07-4e4a-b739-f6210b411e48 tempest-VolumesSnapshotTestJSON-1486814120 None] Lock "cinder-quobyte-728a7a45-4540-4d1d-b350-f07c69c60d96" released by "delete_volume" :: held 1.168s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:26:19 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-6cb2ba35-3b07-4e4a-b739-f6210b411e48 tempest-VolumesSnapshotTestJSON-1486814120 None] Created reservations ['e5ddc66a-1265-4190-9413-2744571b431c', '6aed6fca-9f50-42b4-bb4c-7dc1e84b9659', '871263a7-9cc9-4b96-a6b3-b8672f34ae98', 'ef5d0d93-36d5-4412-8b77-203c6fe74d2c'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:26:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6cb2ba35-3b07-4e4a-b739-f6210b411e48 tempest-VolumesSnapshotTestJSON-1486814120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:26:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6cb2ba35-3b07-4e4a-b739-f6210b411e48 tempest-VolumesSnapshotTestJSON-1486814120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:26:19 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-6cb2ba35-3b07-4e4a-b739-f6210b411e48 tempest-VolumesSnapshotTestJSON-1486814120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:26:19 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-6cb2ba35-3b07-4e4a-b739-f6210b411e48 tempest-VolumesSnapshotTestJSON-1486814120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:26:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6cb2ba35-3b07-4e4a-b739-f6210b411e48 tempest-VolumesSnapshotTestJSON-1486814120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:26:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6cb2ba35-3b07-4e4a-b739-f6210b411e48 tempest-VolumesSnapshotTestJSON-1486814120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:26:19 devstack sudo[95996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:26:19 devstack sudo[95996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:26:20 devstack sudo[95996]: pam_unix(sudo:session): session closed for user root Nov 06 15:26:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6cb2ba35-3b07-4e4a-b739-f6210b411e48 tempest-VolumesSnapshotTestJSON-1486814120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.492s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:26:20 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-6cb2ba35-3b07-4e4a-b739-f6210b411e48 tempest-VolumesSnapshotTestJSON-1486814120 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:26:20 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-6cb2ba35-3b07-4e4a-b739-f6210b411e48 tempest-VolumesSnapshotTestJSON-1486814120 None] Deleted volume successfully. Nov 06 15:26:20 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6cb2ba35-3b07-4e4a-b739-f6210b411e48 tempest-VolumesSnapshotTestJSON-1486814120 None] Lock "cinder-728a7a45-4540-4d1d-b350-f07c69c60d96-delete_volume" released by "delete_volume" :: held 2.043s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:26:20 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b7f5f893-9e47-4a14-a689-c20cc460e050 tempest-VolumesActionsTest-2061083264 None] Acquiring lock "cinder-b49a94ef-b49f-4998-bfe9-d82f8de789d9-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:26:20 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-80f77141-1736-418e-8d0c-4f30609dc4b0 tempest-VolumesSnapshotTestJSON-1486814120 None] Acquiring lock "cinder-b2ec06a6-827a-4652-a161-7c9335ae3551-delete_snapshot" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:26:20 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b7f5f893-9e47-4a14-a689-c20cc460e050 tempest-VolumesActionsTest-2061083264 None] Lock "cinder-b49a94ef-b49f-4998-bfe9-d82f8de789d9-delete_volume" acquired by "delete_volume" :: waited 0.085s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:26:20 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-80f77141-1736-418e-8d0c-4f30609dc4b0 tempest-VolumesSnapshotTestJSON-1486814120 None] Lock "cinder-b2ec06a6-827a-4652-a161-7c9335ae3551-delete_snapshot" acquired by "delete_snapshot" :: waited 0.075s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:26:20 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-80f77141-1736-418e-8d0c-4f30609dc4b0 tempest-VolumesSnapshotTestJSON-1486814120 None] Acquiring lock "cinder-quobyte-50a1e8fd-cb4f-4f84-abb1-af25f9024db8" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:26:20 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-80f77141-1736-418e-8d0c-4f30609dc4b0 tempest-VolumesSnapshotTestJSON-1486814120 None] Lock "cinder-quobyte-50a1e8fd-cb4f-4f84-abb1-af25f9024db8" acquired by "delete_snapshot" :: waited 0.051s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:26:20 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-80f77141-1736-418e-8d0c-4f30609dc4b0 tempest-VolumesSnapshotTestJSON-1486814120 None] Acquiring lock "cinder-quobyte-b2ec06a6-827a-4652-a161-7c9335ae3551" by "_delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:26:20 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b7f5f893-9e47-4a14-a689-c20cc460e050 tempest-VolumesActionsTest-2061083264 None] Acquiring lock "cinder-quobyte-b49a94ef-b49f-4998-bfe9-d82f8de789d9" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:26:20 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-80f77141-1736-418e-8d0c-4f30609dc4b0 tempest-VolumesSnapshotTestJSON-1486814120 None] Lock "cinder-quobyte-b2ec06a6-827a-4652-a161-7c9335ae3551" acquired by "_delete_snapshot" :: waited 0.059s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:26:20 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-80f77141-1736-418e-8d0c-4f30609dc4b0 tempest-VolumesSnapshotTestJSON-1486814120 None] Deleting offline snapshot b2ec06a6-827a-4652-a161-7c9335ae3551 of volume 50a1e8fd-cb4f-4f84-abb1-af25f9024db8 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 15:26:20 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-80f77141-1736-418e-8d0c-4f30609dc4b0 tempest-VolumesSnapshotTestJSON-1486814120 None] snapshot_file for this snap is: volume-50a1e8fd-cb4f-4f84-abb1-af25f9024db8.b2ec06a6-827a-4652-a161-7c9335ae3551 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 15:26:20 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[32ec024a-0397-4d08-a929-066331a1bb0f]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:26:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-80f77141-1736-418e-8d0c-4f30609dc4b0 tempest-VolumesSnapshotTestJSON-1486814120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-50a1e8fd-cb4f-4f84-abb1-af25f9024db8.b2ec06a6-827a-4652-a161-7c9335ae3551 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:26:21 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b7f5f893-9e47-4a14-a689-c20cc460e050 tempest-VolumesActionsTest-2061083264 None] Lock "cinder-quobyte-b49a94ef-b49f-4998-bfe9-d82f8de789d9" acquired by "delete_volume" :: waited 0.146s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:26:21 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[e21287ae-1098-407b-85fb-ff9435e30faf]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:26:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b7f5f893-9e47-4a14-a689-c20cc460e050 tempest-VolumesActionsTest-2061083264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b49a94ef-b49f-4998-bfe9-d82f8de789d9 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:26:21 devstack sudo[96056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-50a1e8fd-cb4f-4f84-abb1-af25f9024db8.b2ec06a6-827a-4652-a161-7c9335ae3551 Nov 06 15:26:21 devstack sudo[96056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:26:21 devstack sudo[96061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b49a94ef-b49f-4998-bfe9-d82f8de789d9 Nov 06 15:26:21 devstack sudo[96061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:26:22 devstack sudo[96056]: pam_unix(sudo:session): session closed for user root Nov 06 15:26:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-80f77141-1736-418e-8d0c-4f30609dc4b0 tempest-VolumesSnapshotTestJSON-1486814120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-50a1e8fd-cb4f-4f84-abb1-af25f9024db8.b2ec06a6-827a-4652-a161-7c9335ae3551" returned: 0 in 1.051s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:26:22 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-80f77141-1736-418e-8d0c-4f30609dc4b0 tempest-VolumesSnapshotTestJSON-1486814120 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-50a1e8fd-cb4f-4f84-abb1-af25f9024db8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 15:26:22 devstack sudo[96061]: pam_unix(sudo:session): session closed for user root Nov 06 15:26:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b7f5f893-9e47-4a14-a689-c20cc460e050 tempest-VolumesActionsTest-2061083264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b49a94ef-b49f-4998-bfe9-d82f8de789d9" returned: 0 in 0.935s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:26:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b7f5f893-9e47-4a14-a689-c20cc460e050 tempest-VolumesActionsTest-2061083264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b49a94ef-b49f-4998-bfe9-d82f8de789d9 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:26:22 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc620df8-7519-44ff-904c-9f44162c5976]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:26:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-80f77141-1736-418e-8d0c-4f30609dc4b0 tempest-VolumesSnapshotTestJSON-1486814120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-50a1e8fd-cb4f-4f84-abb1-af25f9024db8 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:26:22 devstack sudo[96074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b49a94ef-b49f-4998-bfe9-d82f8de789d9 Nov 06 15:26:22 devstack sudo[96074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:26:22 devstack sudo[96076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-50a1e8fd-cb4f-4f84-abb1-af25f9024db8 Nov 06 15:26:22 devstack sudo[96076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:26:22 devstack sudo[96074]: pam_unix(sudo:session): session closed for user root Nov 06 15:26:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b7f5f893-9e47-4a14-a689-c20cc460e050 tempest-VolumesActionsTest-2061083264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b49a94ef-b49f-4998-bfe9-d82f8de789d9" returned: 0 in 0.598s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:26:22 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b7f5f893-9e47-4a14-a689-c20cc460e050 tempest-VolumesActionsTest-2061083264 None] Lock "cinder-quobyte-b49a94ef-b49f-4998-bfe9-d82f8de789d9" released by "delete_volume" :: held 1.725s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:26:22 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-b7f5f893-9e47-4a14-a689-c20cc460e050 tempest-VolumesActionsTest-2061083264 None] Created reservations ['7ca4c550-b11d-49fa-be0d-cc63270332a0', '14202f88-4656-472f-a8ef-1dcd8598a909', '01b69cbe-f6ca-4cac-af57-73d2623ec198', '48a1ab36-8d61-44be-9db1-86a90174a792'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:26:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b7f5f893-9e47-4a14-a689-c20cc460e050 tempest-VolumesActionsTest-2061083264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:26:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b7f5f893-9e47-4a14-a689-c20cc460e050 tempest-VolumesActionsTest-2061083264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:26:23 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-b7f5f893-9e47-4a14-a689-c20cc460e050 tempest-VolumesActionsTest-2061083264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:26:23 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-b7f5f893-9e47-4a14-a689-c20cc460e050 tempest-VolumesActionsTest-2061083264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:26:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b7f5f893-9e47-4a14-a689-c20cc460e050 tempest-VolumesActionsTest-2061083264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.064s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:26:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b7f5f893-9e47-4a14-a689-c20cc460e050 tempest-VolumesActionsTest-2061083264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:26:23 devstack sudo[96084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:26:23 devstack sudo[96084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:26:24 devstack sudo[96076]: pam_unix(sudo:session): session closed for user root Nov 06 15:26:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-80f77141-1736-418e-8d0c-4f30609dc4b0 tempest-VolumesSnapshotTestJSON-1486814120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-50a1e8fd-cb4f-4f84-abb1-af25f9024db8" returned: 0 in 1.984s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:26:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-80f77141-1736-418e-8d0c-4f30609dc4b0 tempest-VolumesSnapshotTestJSON-1486814120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-50a1e8fd-cb4f-4f84-abb1-af25f9024db8.b2ec06a6-827a-4652-a161-7c9335ae3551 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:26:24 devstack sudo[96088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-50a1e8fd-cb4f-4f84-abb1-af25f9024db8.b2ec06a6-827a-4652-a161-7c9335ae3551 Nov 06 15:26:24 devstack sudo[96088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:26:24 devstack sudo[96084]: pam_unix(sudo:session): session closed for user root Nov 06 15:26:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b7f5f893-9e47-4a14-a689-c20cc460e050 tempest-VolumesActionsTest-2061083264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 1.120s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:26:24 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-b7f5f893-9e47-4a14-a689-c20cc460e050 tempest-VolumesActionsTest-2061083264 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:26:24 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-b7f5f893-9e47-4a14-a689-c20cc460e050 tempest-VolumesActionsTest-2061083264 None] Deleted volume successfully. Nov 06 15:26:24 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b7f5f893-9e47-4a14-a689-c20cc460e050 tempest-VolumesActionsTest-2061083264 None] Lock "cinder-b49a94ef-b49f-4998-bfe9-d82f8de789d9-delete_volume" released by "delete_volume" :: held 3.769s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:26:24 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf201b67-cb43-41f3-81f0-06ed455bc57f tempest-VolumesActionsTest-2124293081 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:26:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-bf201b67-cb43-41f3-81f0-06ed455bc57f tempest-VolumesActionsTest-2124293081 None] Flow 'volume_create_manager' (386115c3-d0fe-4c1f-a725-f91e09c58b96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:26:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-bf201b67-cb43-41f3-81f0-06ed455bc57f tempest-VolumesActionsTest-2124293081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (484c572f-acc0-4b5c-90c1-09cb26828f95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:26:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-bf201b67-cb43-41f3-81f0-06ed455bc57f tempest-VolumesActionsTest-2124293081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (484c572f-acc0-4b5c-90c1-09cb26828f95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:26:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-466138079',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d49cdc84-0c74-4529-aece-5a22ae6b144e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d0b6abc042242be823fc382d007712a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:26:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:26:25Z,use_quota=True,user_id='abff5ddd914544e7a269405c2ec272b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:26:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-bf201b67-cb43-41f3-81f0-06ed455bc57f tempest-VolumesActionsTest-2124293081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66dbfe78-fca9-4649-9fde-24822c5caf53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:26:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-bf201b67-cb43-41f3-81f0-06ed455bc57f tempest-VolumesActionsTest-2124293081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66dbfe78-fca9-4649-9fde-24822c5caf53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:26:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-bf201b67-cb43-41f3-81f0-06ed455bc57f tempest-VolumesActionsTest-2124293081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa06ae34-0335-400f-a376-3c75e642ed6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:26:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-bf201b67-cb43-41f3-81f0-06ed455bc57f tempest-VolumesActionsTest-2124293081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa06ae34-0335-400f-a376-3c75e642ed6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd49cdc84-0c74-4529-aece-5a22ae6b144e', 'volume_name': 'volume-d49cdc84-0c74-4529-aece-5a22ae6b144e', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:26:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-bf201b67-cb43-41f3-81f0-06ed455bc57f tempest-VolumesActionsTest-2124293081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54374f58-9e50-4cc2-bfde-600622676cf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:26:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-bf201b67-cb43-41f3-81f0-06ed455bc57f tempest-VolumesActionsTest-2124293081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54374f58-9e50-4cc2-bfde-600622676cf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:26:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-bf201b67-cb43-41f3-81f0-06ed455bc57f tempest-VolumesActionsTest-2124293081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c24183c8-8939-4d8e-b35c-490ca267f4d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:26:25 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-bf201b67-cb43-41f3-81f0-06ed455bc57f tempest-VolumesActionsTest-2124293081 None] Volume d49cdc84-0c74-4529-aece-5a22ae6b144e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d49cdc84-0c74-4529-aece-5a22ae6b144e', 'volume_size': 1} Nov 06 15:26:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-bf201b67-cb43-41f3-81f0-06ed455bc57f tempest-VolumesActionsTest-2124293081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:26:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-bf201b67-cb43-41f3-81f0-06ed455bc57f tempest-VolumesActionsTest-2124293081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:26:25 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-bf201b67-cb43-41f3-81f0-06ed455bc57f tempest-VolumesActionsTest-2124293081 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:26:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-466138079',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d49cdc84-0c74-4529-aece-5a22ae6b144e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d0b6abc042242be823fc382d007712a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:26:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:26:25Z,use_quota=True,user_id='abff5ddd914544e7a269405c2ec272b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:26:25 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-bf201b67-cb43-41f3-81f0-06ed455bc57f tempest-VolumesActionsTest-2124293081 None] Creating volume d49cdc84-0c74-4529-aece-5a22ae6b144e {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:26:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-bf201b67-cb43-41f3-81f0-06ed455bc57f tempest-VolumesActionsTest-2124293081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:26:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-bf201b67-cb43-41f3-81f0-06ed455bc57f tempest-VolumesActionsTest-2124293081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:26:25 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-bf201b67-cb43-41f3-81f0-06ed455bc57f tempest-VolumesActionsTest-2124293081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:26:25 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-bf201b67-cb43-41f3-81f0-06ed455bc57f tempest-VolumesActionsTest-2124293081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:26:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-bf201b67-cb43-41f3-81f0-06ed455bc57f tempest-VolumesActionsTest-2124293081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:26:25 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-bf201b67-cb43-41f3-81f0-06ed455bc57f tempest-VolumesActionsTest-2124293081 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:26:25 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-bf201b67-cb43-41f3-81f0-06ed455bc57f tempest-VolumesActionsTest-2124293081 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:26:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bf201b67-cb43-41f3-81f0-06ed455bc57f tempest-VolumesActionsTest-2124293081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d49cdc84-0c74-4529-aece-5a22ae6b144e 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:26:25 devstack sudo[96116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d49cdc84-0c74-4529-aece-5a22ae6b144e 1073741824 Nov 06 15:26:25 devstack sudo[96116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:26:25 devstack sudo[96088]: pam_unix(sudo:session): session closed for user root Nov 06 15:26:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-80f77141-1736-418e-8d0c-4f30609dc4b0 tempest-VolumesSnapshotTestJSON-1486814120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-50a1e8fd-cb4f-4f84-abb1-af25f9024db8.b2ec06a6-827a-4652-a161-7c9335ae3551" returned: 0 in 1.262s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:26:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-80f77141-1736-418e-8d0c-4f30609dc4b0 tempest-VolumesSnapshotTestJSON-1486814120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-50a1e8fd-cb4f-4f84-abb1-af25f9024db8.b2ec06a6-827a-4652-a161-7c9335ae3551 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:26:25 devstack sudo[96119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-50a1e8fd-cb4f-4f84-abb1-af25f9024db8.b2ec06a6-827a-4652-a161-7c9335ae3551 Nov 06 15:26:25 devstack sudo[96119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:26:25 devstack sudo[96119]: pam_unix(sudo:session): session closed for user root Nov 06 15:26:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-80f77141-1736-418e-8d0c-4f30609dc4b0 tempest-VolumesSnapshotTestJSON-1486814120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-50a1e8fd-cb4f-4f84-abb1-af25f9024db8.b2ec06a6-827a-4652-a161-7c9335ae3551" returned: 0 in 0.638s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:26:26 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-80f77141-1736-418e-8d0c-4f30609dc4b0 tempest-VolumesSnapshotTestJSON-1486814120 None] Lock "cinder-quobyte-b2ec06a6-827a-4652-a161-7c9335ae3551" released by "_delete_snapshot" :: held 5.213s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:26:26 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-80f77141-1736-418e-8d0c-4f30609dc4b0 tempest-VolumesSnapshotTestJSON-1486814120 None] Lock "cinder-quobyte-50a1e8fd-cb4f-4f84-abb1-af25f9024db8" released by "delete_snapshot" :: held 5.294s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:26:26 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-80f77141-1736-418e-8d0c-4f30609dc4b0 tempest-VolumesSnapshotTestJSON-1486814120 None] Created reservations ['e5de27ea-1bd5-49ee-8457-dd4a987f6a25', '5c3bfe71-9ed6-4241-af0c-53adc3709100', '77d9f690-4912-40eb-a18f-64ce6c009a8b', '14ae904a-41d0-4b71-b844-90f82ed47769'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:26:26 devstack sudo[96116]: pam_unix(sudo:session): session closed for user root Nov 06 15:26:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bf201b67-cb43-41f3-81f0-06ed455bc57f tempest-VolumesActionsTest-2124293081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d49cdc84-0c74-4529-aece-5a22ae6b144e 1073741824" returned: 0 in 1.022s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:26:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bf201b67-cb43-41f3-81f0-06ed455bc57f tempest-VolumesActionsTest-2124293081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d49cdc84-0c74-4529-aece-5a22ae6b144e {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:26:26 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-80f77141-1736-418e-8d0c-4f30609dc4b0 tempest-VolumesSnapshotTestJSON-1486814120 None] Delete snapshot completed successfully. Nov 06 15:26:26 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-80f77141-1736-418e-8d0c-4f30609dc4b0 tempest-VolumesSnapshotTestJSON-1486814120 None] Lock "cinder-b2ec06a6-827a-4652-a161-7c9335ae3551-delete_snapshot" released by "delete_snapshot" :: held 5.607s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:26:26 devstack sudo[96128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d49cdc84-0c74-4529-aece-5a22ae6b144e Nov 06 15:26:26 devstack sudo[96128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:26:26 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-04edcd39-c7dc-4d30-8ac6-de62191250ff tempest-VolumesSnapshotTestJSON-1486814120 None] Acquiring lock "cinder-50a1e8fd-cb4f-4f84-abb1-af25f9024db8-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:26:26 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-04edcd39-c7dc-4d30-8ac6-de62191250ff tempest-VolumesSnapshotTestJSON-1486814120 None] Lock "cinder-50a1e8fd-cb4f-4f84-abb1-af25f9024db8-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:26:26 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-04edcd39-c7dc-4d30-8ac6-de62191250ff tempest-VolumesSnapshotTestJSON-1486814120 None] Acquiring lock "cinder-quobyte-50a1e8fd-cb4f-4f84-abb1-af25f9024db8" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:26:26 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-04edcd39-c7dc-4d30-8ac6-de62191250ff tempest-VolumesSnapshotTestJSON-1486814120 None] Lock "cinder-quobyte-50a1e8fd-cb4f-4f84-abb1-af25f9024db8" acquired by "delete_volume" :: waited 0.037s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:26:26 devstack sudo[96128]: pam_unix(sudo:session): session closed for user root Nov 06 15:26:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bf201b67-cb43-41f3-81f0-06ed455bc57f tempest-VolumesActionsTest-2124293081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d49cdc84-0c74-4529-aece-5a22ae6b144e" returned: 0 in 0.564s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:26:26 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-bf201b67-cb43-41f3-81f0-06ed455bc57f tempest-VolumesActionsTest-2124293081 None] <== create_volume: return (1678ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:26:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-bf201b67-cb43-41f3-81f0-06ed455bc57f tempest-VolumesActionsTest-2124293081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.685s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:26:26 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[73009e6c-e4ee-4bc8-b0cd-07b144fc19b5]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:26:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-04edcd39-c7dc-4d30-8ac6-de62191250ff tempest-VolumesSnapshotTestJSON-1486814120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-50a1e8fd-cb4f-4f84-abb1-af25f9024db8 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:26:26 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-bf201b67-cb43-41f3-81f0-06ed455bc57f tempest-VolumesActionsTest-2124293081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c24183c8-8939-4d8e-b35c-490ca267f4d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d49cdc84-0c74-4529-aece-5a22ae6b144e', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:26:26 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-bf201b67-cb43-41f3-81f0-06ed455bc57f tempest-VolumesActionsTest-2124293081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5164f7ec-377d-4e53-b2f6-39bb9f9ace94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:26:27 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-bf201b67-cb43-41f3-81f0-06ed455bc57f tempest-VolumesActionsTest-2124293081 None] Volume volume-d49cdc84-0c74-4529-aece-5a22ae6b144e (d49cdc84-0c74-4529-aece-5a22ae6b144e): created successfully Nov 06 15:26:27 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-bf201b67-cb43-41f3-81f0-06ed455bc57f tempest-VolumesActionsTest-2124293081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5164f7ec-377d-4e53-b2f6-39bb9f9ace94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:26:27 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-bf201b67-cb43-41f3-81f0-06ed455bc57f tempest-VolumesActionsTest-2124293081 None] Flow 'volume_create_manager' (386115c3-d0fe-4c1f-a725-f91e09c58b96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:26:27 devstack sudo[96132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-50a1e8fd-cb4f-4f84-abb1-af25f9024db8 Nov 06 15:26:27 devstack sudo[96132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:26:27 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-bf201b67-cb43-41f3-81f0-06ed455bc57f tempest-VolumesActionsTest-2124293081 None] Created volume successfully. Nov 06 15:26:27 devstack sudo[96132]: pam_unix(sudo:session): session closed for user root Nov 06 15:26:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-04edcd39-c7dc-4d30-8ac6-de62191250ff tempest-VolumesSnapshotTestJSON-1486814120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-50a1e8fd-cb4f-4f84-abb1-af25f9024db8" returned: 0 in 0.488s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:26:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-04edcd39-c7dc-4d30-8ac6-de62191250ff tempest-VolumesSnapshotTestJSON-1486814120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-50a1e8fd-cb4f-4f84-abb1-af25f9024db8 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:26:27 devstack sudo[96139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-50a1e8fd-cb4f-4f84-abb1-af25f9024db8 Nov 06 15:26:27 devstack sudo[96139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:26:27 devstack sudo[96139]: pam_unix(sudo:session): session closed for user root Nov 06 15:26:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-04edcd39-c7dc-4d30-8ac6-de62191250ff tempest-VolumesSnapshotTestJSON-1486814120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-50a1e8fd-cb4f-4f84-abb1-af25f9024db8" returned: 0 in 0.331s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:26:27 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-04edcd39-c7dc-4d30-8ac6-de62191250ff tempest-VolumesSnapshotTestJSON-1486814120 None] Lock "cinder-quobyte-50a1e8fd-cb4f-4f84-abb1-af25f9024db8" released by "delete_volume" :: held 0.966s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:26:27 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-04edcd39-c7dc-4d30-8ac6-de62191250ff tempest-VolumesSnapshotTestJSON-1486814120 None] Created reservations ['4d5adb62-c46c-4503-bbe7-3044b3748b74', 'aa754787-b834-41ab-8b38-77732eb45583', '1695d488-0b57-41d5-98f5-674f36cc2f29', '1a1e0cee-657e-4c7d-8280-a32843458561'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:26:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-04edcd39-c7dc-4d30-8ac6-de62191250ff tempest-VolumesSnapshotTestJSON-1486814120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:26:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-04edcd39-c7dc-4d30-8ac6-de62191250ff tempest-VolumesSnapshotTestJSON-1486814120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:26:27 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-04edcd39-c7dc-4d30-8ac6-de62191250ff tempest-VolumesSnapshotTestJSON-1486814120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:26:27 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-04edcd39-c7dc-4d30-8ac6-de62191250ff tempest-VolumesSnapshotTestJSON-1486814120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:26:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-04edcd39-c7dc-4d30-8ac6-de62191250ff tempest-VolumesSnapshotTestJSON-1486814120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:26:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-04edcd39-c7dc-4d30-8ac6-de62191250ff tempest-VolumesSnapshotTestJSON-1486814120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:26:27 devstack sudo[96142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:26:27 devstack sudo[96142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:26:28 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e580dd5b-4d29-4575-b44a-5d3067a8e6e5 tempest-VolumesActionsTest-2061083264 None] Acquiring lock "cinder-d49cdc84-0c74-4529-aece-5a22ae6b144e-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:26:28 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e580dd5b-4d29-4575-b44a-5d3067a8e6e5 tempest-VolumesActionsTest-2061083264 None] Lock "cinder-d49cdc84-0c74-4529-aece-5a22ae6b144e-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:26:28 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e580dd5b-4d29-4575-b44a-5d3067a8e6e5 tempest-VolumesActionsTest-2061083264 None] Acquiring lock "cinder-quobyte-d49cdc84-0c74-4529-aece-5a22ae6b144e" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:26:28 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e580dd5b-4d29-4575-b44a-5d3067a8e6e5 tempest-VolumesActionsTest-2061083264 None] Lock "cinder-quobyte-d49cdc84-0c74-4529-aece-5a22ae6b144e" acquired by "delete_volume" :: waited 0.036s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:26:28 devstack sudo[96142]: pam_unix(sudo:session): session closed for user root Nov 06 15:26:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-04edcd39-c7dc-4d30-8ac6-de62191250ff tempest-VolumesSnapshotTestJSON-1486814120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.547s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:26:28 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-04edcd39-c7dc-4d30-8ac6-de62191250ff tempest-VolumesSnapshotTestJSON-1486814120 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:26:28 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c6d9eaf-e18c-4653-b369-965dc1967bb1]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:26:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e580dd5b-4d29-4575-b44a-5d3067a8e6e5 tempest-VolumesActionsTest-2061083264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d49cdc84-0c74-4529-aece-5a22ae6b144e {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:26:28 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-04edcd39-c7dc-4d30-8ac6-de62191250ff tempest-VolumesSnapshotTestJSON-1486814120 None] Deleted volume successfully. Nov 06 15:26:28 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-04edcd39-c7dc-4d30-8ac6-de62191250ff tempest-VolumesSnapshotTestJSON-1486814120 None] Lock "cinder-50a1e8fd-cb4f-4f84-abb1-af25f9024db8-delete_volume" released by "delete_volume" :: held 1.950s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:26:28 devstack sudo[96146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d49cdc84-0c74-4529-aece-5a22ae6b144e Nov 06 15:26:28 devstack sudo[96146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:26:29 devstack sudo[96146]: pam_unix(sudo:session): session closed for user root Nov 06 15:26:29 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-7af5d34a-6c98-4a6c-8ff9-8cad065f490f tempest-VolumesSnapshotTestJSON-1486814120 None] Acquiring lock "cinder-2bee140f-e644-4471-ac56-226e3d79ff97-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:26:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e580dd5b-4d29-4575-b44a-5d3067a8e6e5 tempest-VolumesActionsTest-2061083264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d49cdc84-0c74-4529-aece-5a22ae6b144e" returned: 0 in 0.681s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:26:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e580dd5b-4d29-4575-b44a-5d3067a8e6e5 tempest-VolumesActionsTest-2061083264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d49cdc84-0c74-4529-aece-5a22ae6b144e {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:26:29 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-7af5d34a-6c98-4a6c-8ff9-8cad065f490f tempest-VolumesSnapshotTestJSON-1486814120 None] Lock "cinder-2bee140f-e644-4471-ac56-226e3d79ff97-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:26:29 devstack sudo[96152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d49cdc84-0c74-4529-aece-5a22ae6b144e Nov 06 15:26:29 devstack sudo[96152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:26:29 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-7af5d34a-6c98-4a6c-8ff9-8cad065f490f tempest-VolumesSnapshotTestJSON-1486814120 None] Acquiring lock "cinder-quobyte-2bee140f-e644-4471-ac56-226e3d79ff97" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:26:29 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-7af5d34a-6c98-4a6c-8ff9-8cad065f490f tempest-VolumesSnapshotTestJSON-1486814120 None] Lock "cinder-quobyte-2bee140f-e644-4471-ac56-226e3d79ff97" acquired by "delete_volume" :: waited 0.036s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:26:29 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[27ed4142-7553-4884-8ef3-35140a607223]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:26:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7af5d34a-6c98-4a6c-8ff9-8cad065f490f tempest-VolumesSnapshotTestJSON-1486814120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-2bee140f-e644-4471-ac56-226e3d79ff97 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:26:29 devstack sudo[96152]: pam_unix(sudo:session): session closed for user root Nov 06 15:26:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e580dd5b-4d29-4575-b44a-5d3067a8e6e5 tempest-VolumesActionsTest-2061083264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d49cdc84-0c74-4529-aece-5a22ae6b144e" returned: 0 in 0.485s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:26:29 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e580dd5b-4d29-4575-b44a-5d3067a8e6e5 tempest-VolumesActionsTest-2061083264 None] Lock "cinder-quobyte-d49cdc84-0c74-4529-aece-5a22ae6b144e" released by "delete_volume" :: held 1.253s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:26:29 devstack sudo[96154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-2bee140f-e644-4471-ac56-226e3d79ff97 Nov 06 15:26:29 devstack sudo[96154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:26:29 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-e580dd5b-4d29-4575-b44a-5d3067a8e6e5 tempest-VolumesActionsTest-2061083264 None] Created reservations ['ea18d354-cbb8-4d9e-899f-418cbbbdeb22', '3a2dd827-4e92-48c0-9569-8fb000353d56', '0e062b2f-413b-4c9d-b5b5-b44731eb6ea0', 'd13ff8d4-ec6b-4265-9805-edcd9dc515ee'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:26:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e580dd5b-4d29-4575-b44a-5d3067a8e6e5 tempest-VolumesActionsTest-2061083264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:26:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e580dd5b-4d29-4575-b44a-5d3067a8e6e5 tempest-VolumesActionsTest-2061083264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:26:29 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e580dd5b-4d29-4575-b44a-5d3067a8e6e5 tempest-VolumesActionsTest-2061083264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:26:30 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e580dd5b-4d29-4575-b44a-5d3067a8e6e5 tempest-VolumesActionsTest-2061083264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:26:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e580dd5b-4d29-4575-b44a-5d3067a8e6e5 tempest-VolumesActionsTest-2061083264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:26:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e580dd5b-4d29-4575-b44a-5d3067a8e6e5 tempest-VolumesActionsTest-2061083264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:26:30 devstack sudo[96157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:26:30 devstack sudo[96157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:26:30 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e39bfb0-2d3a-45f0-a469-f5aa25469734 tempest-ServersNegativeTestJSON-51733469 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:26:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7e39bfb0-2d3a-45f0-a469-f5aa25469734 tempest-ServersNegativeTestJSON-51733469 None] Flow 'volume_create_manager' (d238a4cf-4c8e-4452-ae64-1c0f48f1c680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:26:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7e39bfb0-2d3a-45f0-a469-f5aa25469734 tempest-ServersNegativeTestJSON-51733469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75c4aea5-0f80-4b6f-8414-301aa5895521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:26:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7e39bfb0-2d3a-45f0-a469-f5aa25469734 tempest-ServersNegativeTestJSON-51733469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75c4aea5-0f80-4b6f-8414-301aa5895521) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:26:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1328073594',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a740d3ac-050a-4f05-885a-5c11dc501e2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a363c6c682dc4f129b0c1db3eaf16212',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:26:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:26:30Z,use_quota=True,user_id='ba4c2d0258934938bc8f173f8e7b4cd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:26:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7e39bfb0-2d3a-45f0-a469-f5aa25469734 tempest-ServersNegativeTestJSON-51733469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aed94be7-3705-4f4a-9728-cb293053729b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:26:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7e39bfb0-2d3a-45f0-a469-f5aa25469734 tempest-ServersNegativeTestJSON-51733469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aed94be7-3705-4f4a-9728-cb293053729b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:26:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7e39bfb0-2d3a-45f0-a469-f5aa25469734 tempest-ServersNegativeTestJSON-51733469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (253ed9fa-4e8d-4c86-a2cc-c6371034e122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:26:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7e39bfb0-2d3a-45f0-a469-f5aa25469734 tempest-ServersNegativeTestJSON-51733469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (253ed9fa-4e8d-4c86-a2cc-c6371034e122) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a740d3ac-050a-4f05-885a-5c11dc501e2d', 'volume_name': 'volume-a740d3ac-050a-4f05-885a-5c11dc501e2d', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:26:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7e39bfb0-2d3a-45f0-a469-f5aa25469734 tempest-ServersNegativeTestJSON-51733469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60d99c5a-7b94-4fc2-8731-caf6389437fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:26:30 devstack sudo[96154]: pam_unix(sudo:session): session closed for user root Nov 06 15:26:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7e39bfb0-2d3a-45f0-a469-f5aa25469734 tempest-ServersNegativeTestJSON-51733469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60d99c5a-7b94-4fc2-8731-caf6389437fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:26:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7e39bfb0-2d3a-45f0-a469-f5aa25469734 tempest-ServersNegativeTestJSON-51733469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6367bb3-6682-41a9-8e2e-bce98e93156e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:26:30 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-7e39bfb0-2d3a-45f0-a469-f5aa25469734 tempest-ServersNegativeTestJSON-51733469 None] Volume a740d3ac-050a-4f05-885a-5c11dc501e2d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a740d3ac-050a-4f05-885a-5c11dc501e2d', 'volume_size': 1} Nov 06 15:26:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7e39bfb0-2d3a-45f0-a469-f5aa25469734 tempest-ServersNegativeTestJSON-51733469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:26:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7e39bfb0-2d3a-45f0-a469-f5aa25469734 tempest-ServersNegativeTestJSON-51733469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:26:30 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-7e39bfb0-2d3a-45f0-a469-f5aa25469734 tempest-ServersNegativeTestJSON-51733469 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:26:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1328073594',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a740d3ac-050a-4f05-885a-5c11dc501e2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a363c6c682dc4f129b0c1db3eaf16212',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:26:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:26:30Z,use_quota=True,user_id='ba4c2d0258934938bc8f173f8e7b4cd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:26:30 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-7e39bfb0-2d3a-45f0-a469-f5aa25469734 tempest-ServersNegativeTestJSON-51733469 None] Creating volume a740d3ac-050a-4f05-885a-5c11dc501e2d {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:26:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7e39bfb0-2d3a-45f0-a469-f5aa25469734 tempest-ServersNegativeTestJSON-51733469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:26:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7e39bfb0-2d3a-45f0-a469-f5aa25469734 tempest-ServersNegativeTestJSON-51733469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:26:30 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-7e39bfb0-2d3a-45f0-a469-f5aa25469734 tempest-ServersNegativeTestJSON-51733469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:26:30 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-7e39bfb0-2d3a-45f0-a469-f5aa25469734 tempest-ServersNegativeTestJSON-51733469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:26:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7e39bfb0-2d3a-45f0-a469-f5aa25469734 tempest-ServersNegativeTestJSON-51733469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:26:30 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-7e39bfb0-2d3a-45f0-a469-f5aa25469734 tempest-ServersNegativeTestJSON-51733469 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:26:30 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-7e39bfb0-2d3a-45f0-a469-f5aa25469734 tempest-ServersNegativeTestJSON-51733469 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:26:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7e39bfb0-2d3a-45f0-a469-f5aa25469734 tempest-ServersNegativeTestJSON-51733469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a740d3ac-050a-4f05-885a-5c11dc501e2d 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:26:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7af5d34a-6c98-4a6c-8ff9-8cad065f490f tempest-VolumesSnapshotTestJSON-1486814120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-2bee140f-e644-4471-ac56-226e3d79ff97" returned: 0 in 0.809s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:26:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7af5d34a-6c98-4a6c-8ff9-8cad065f490f tempest-VolumesSnapshotTestJSON-1486814120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-2bee140f-e644-4471-ac56-226e3d79ff97 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:26:30 devstack sudo[96162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a740d3ac-050a-4f05-885a-5c11dc501e2d 1073741824 Nov 06 15:26:30 devstack sudo[96162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:26:30 devstack sudo[96163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-2bee140f-e644-4471-ac56-226e3d79ff97 Nov 06 15:26:30 devstack sudo[96163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:26:30 devstack sudo[96157]: pam_unix(sudo:session): session closed for user root Nov 06 15:26:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e580dd5b-4d29-4575-b44a-5d3067a8e6e5 tempest-VolumesActionsTest-2061083264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.454s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:26:30 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-e580dd5b-4d29-4575-b44a-5d3067a8e6e5 tempest-VolumesActionsTest-2061083264 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:26:30 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-e580dd5b-4d29-4575-b44a-5d3067a8e6e5 tempest-VolumesActionsTest-2061083264 None] Deleted volume successfully. Nov 06 15:26:30 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e580dd5b-4d29-4575-b44a-5d3067a8e6e5 tempest-VolumesActionsTest-2061083264 None] Lock "cinder-d49cdc84-0c74-4529-aece-5a22ae6b144e-delete_volume" released by "delete_volume" :: held 2.191s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:26:30 devstack sudo[96163]: pam_unix(sudo:session): session closed for user root Nov 06 15:26:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7af5d34a-6c98-4a6c-8ff9-8cad065f490f tempest-VolumesSnapshotTestJSON-1486814120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-2bee140f-e644-4471-ac56-226e3d79ff97" returned: 0 in 0.347s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:26:30 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-7af5d34a-6c98-4a6c-8ff9-8cad065f490f tempest-VolumesSnapshotTestJSON-1486814120 None] Lock "cinder-quobyte-2bee140f-e644-4471-ac56-226e3d79ff97" released by "delete_volume" :: held 1.294s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:26:30 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-7af5d34a-6c98-4a6c-8ff9-8cad065f490f tempest-VolumesSnapshotTestJSON-1486814120 None] Created reservations ['ac330266-9299-4284-b332-d8112c9cc16d', '16b382fc-b872-4398-b6c0-db0cde0ac364', 'ab1aa16c-16b3-4c61-93be-00c5676ee69b', '1fb0a778-ac7c-4e6c-8d60-50943511a00c'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:26:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7af5d34a-6c98-4a6c-8ff9-8cad065f490f tempest-VolumesSnapshotTestJSON-1486814120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:26:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7af5d34a-6c98-4a6c-8ff9-8cad065f490f tempest-VolumesSnapshotTestJSON-1486814120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:26:30 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-7af5d34a-6c98-4a6c-8ff9-8cad065f490f tempest-VolumesSnapshotTestJSON-1486814120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:26:30 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-7af5d34a-6c98-4a6c-8ff9-8cad065f490f tempest-VolumesSnapshotTestJSON-1486814120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:26:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7af5d34a-6c98-4a6c-8ff9-8cad065f490f tempest-VolumesSnapshotTestJSON-1486814120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:26:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7af5d34a-6c98-4a6c-8ff9-8cad065f490f tempest-VolumesSnapshotTestJSON-1486814120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:26:30 devstack sudo[96172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:26:30 devstack sudo[96172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:26:30 devstack sudo[96162]: pam_unix(sudo:session): session closed for user root Nov 06 15:26:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7e39bfb0-2d3a-45f0-a469-f5aa25469734 tempest-ServersNegativeTestJSON-51733469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a740d3ac-050a-4f05-885a-5c11dc501e2d 1073741824" returned: 0 in 0.621s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:26:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7e39bfb0-2d3a-45f0-a469-f5aa25469734 tempest-ServersNegativeTestJSON-51733469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a740d3ac-050a-4f05-885a-5c11dc501e2d {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:26:31 devstack sudo[96174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a740d3ac-050a-4f05-885a-5c11dc501e2d Nov 06 15:26:31 devstack sudo[96174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:26:31 devstack sudo[96172]: pam_unix(sudo:session): session closed for user root Nov 06 15:26:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7af5d34a-6c98-4a6c-8ff9-8cad065f490f tempest-VolumesSnapshotTestJSON-1486814120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.325s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:26:31 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-7af5d34a-6c98-4a6c-8ff9-8cad065f490f tempest-VolumesSnapshotTestJSON-1486814120 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:26:31 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-7af5d34a-6c98-4a6c-8ff9-8cad065f490f tempest-VolumesSnapshotTestJSON-1486814120 None] Deleted volume successfully. Nov 06 15:26:31 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-7af5d34a-6c98-4a6c-8ff9-8cad065f490f tempest-VolumesSnapshotTestJSON-1486814120 None] Lock "cinder-2bee140f-e644-4471-ac56-226e3d79ff97-delete_volume" released by "delete_volume" :: held 1.981s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:26:31 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-680d08e1-9872-4cc7-aac2-93becdeb266e tempest-VolumesActionsTest-2124293081 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:26:31 devstack sudo[96174]: pam_unix(sudo:session): session closed for user root Nov 06 15:26:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-680d08e1-9872-4cc7-aac2-93becdeb266e tempest-VolumesActionsTest-2124293081 None] Flow 'volume_create_manager' (09d70fb4-a5e6-4b9e-b1e6-bbde2a7cf66b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:26:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-680d08e1-9872-4cc7-aac2-93becdeb266e tempest-VolumesActionsTest-2124293081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9ab8079-262b-4b9f-822b-32d09767748a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:26:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7e39bfb0-2d3a-45f0-a469-f5aa25469734 tempest-ServersNegativeTestJSON-51733469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a740d3ac-050a-4f05-885a-5c11dc501e2d" returned: 0 in 0.437s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:26:31 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-7e39bfb0-2d3a-45f0-a469-f5aa25469734 tempest-ServersNegativeTestJSON-51733469 None] <== create_volume: return (1161ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:26:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7e39bfb0-2d3a-45f0-a469-f5aa25469734 tempest-ServersNegativeTestJSON-51733469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.165s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:26:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-680d08e1-9872-4cc7-aac2-93becdeb266e tempest-VolumesActionsTest-2124293081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9ab8079-262b-4b9f-822b-32d09767748a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:26:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-797931746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d854549-4656-4669-a769-6a479c2168a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d0b6abc042242be823fc382d007712a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:26:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:26:31Z,use_quota=True,user_id='abff5ddd914544e7a269405c2ec272b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:26:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-680d08e1-9872-4cc7-aac2-93becdeb266e tempest-VolumesActionsTest-2124293081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da6d98c6-d3b8-483d-9c29-463df43c9939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:26:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-680d08e1-9872-4cc7-aac2-93becdeb266e tempest-VolumesActionsTest-2124293081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da6d98c6-d3b8-483d-9c29-463df43c9939) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:26:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-680d08e1-9872-4cc7-aac2-93becdeb266e tempest-VolumesActionsTest-2124293081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c504e30-34b5-4ac1-bd57-777181935126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:26:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-680d08e1-9872-4cc7-aac2-93becdeb266e tempest-VolumesActionsTest-2124293081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c504e30-34b5-4ac1-bd57-777181935126) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d854549-4656-4669-a769-6a479c2168a5', 'volume_name': 'volume-2d854549-4656-4669-a769-6a479c2168a5', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:26:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-680d08e1-9872-4cc7-aac2-93becdeb266e tempest-VolumesActionsTest-2124293081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9713647-7ee0-4ab6-92f6-6877d42a9861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:26:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-680d08e1-9872-4cc7-aac2-93becdeb266e tempest-VolumesActionsTest-2124293081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9713647-7ee0-4ab6-92f6-6877d42a9861) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:26:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-680d08e1-9872-4cc7-aac2-93becdeb266e tempest-VolumesActionsTest-2124293081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96c0faa8-2e2e-4a4d-9c1b-19afff59306a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:26:31 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-680d08e1-9872-4cc7-aac2-93becdeb266e tempest-VolumesActionsTest-2124293081 None] Volume 2d854549-4656-4669-a769-6a479c2168a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d854549-4656-4669-a769-6a479c2168a5', 'volume_size': 1} Nov 06 15:26:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-680d08e1-9872-4cc7-aac2-93becdeb266e tempest-VolumesActionsTest-2124293081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:26:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-680d08e1-9872-4cc7-aac2-93becdeb266e tempest-VolumesActionsTest-2124293081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:26:31 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-680d08e1-9872-4cc7-aac2-93becdeb266e tempest-VolumesActionsTest-2124293081 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:26:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-797931746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d854549-4656-4669-a769-6a479c2168a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d0b6abc042242be823fc382d007712a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:26:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:26:31Z,use_quota=True,user_id='abff5ddd914544e7a269405c2ec272b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:26:31 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-680d08e1-9872-4cc7-aac2-93becdeb266e tempest-VolumesActionsTest-2124293081 None] Creating volume 2d854549-4656-4669-a769-6a479c2168a5 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:26:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-680d08e1-9872-4cc7-aac2-93becdeb266e tempest-VolumesActionsTest-2124293081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:26:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-680d08e1-9872-4cc7-aac2-93becdeb266e tempest-VolumesActionsTest-2124293081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:26:31 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-680d08e1-9872-4cc7-aac2-93becdeb266e tempest-VolumesActionsTest-2124293081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:26:31 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-680d08e1-9872-4cc7-aac2-93becdeb266e tempest-VolumesActionsTest-2124293081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:26:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-680d08e1-9872-4cc7-aac2-93becdeb266e tempest-VolumesActionsTest-2124293081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:26:31 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-680d08e1-9872-4cc7-aac2-93becdeb266e tempest-VolumesActionsTest-2124293081 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:26:31 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-680d08e1-9872-4cc7-aac2-93becdeb266e tempest-VolumesActionsTest-2124293081 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:26:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-680d08e1-9872-4cc7-aac2-93becdeb266e tempest-VolumesActionsTest-2124293081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-2d854549-4656-4669-a769-6a479c2168a5 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:26:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7e39bfb0-2d3a-45f0-a469-f5aa25469734 tempest-ServersNegativeTestJSON-51733469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6367bb3-6682-41a9-8e2e-bce98e93156e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a740d3ac-050a-4f05-885a-5c11dc501e2d', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:26:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7e39bfb0-2d3a-45f0-a469-f5aa25469734 tempest-ServersNegativeTestJSON-51733469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db34d846-70ac-4336-a564-321c4f922ce4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:26:31 devstack sudo[96178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-2d854549-4656-4669-a769-6a479c2168a5 1073741824 Nov 06 15:26:31 devstack sudo[96178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:26:31 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-7e39bfb0-2d3a-45f0-a469-f5aa25469734 tempest-ServersNegativeTestJSON-51733469 None] Volume volume-a740d3ac-050a-4f05-885a-5c11dc501e2d (a740d3ac-050a-4f05-885a-5c11dc501e2d): created successfully Nov 06 15:26:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7e39bfb0-2d3a-45f0-a469-f5aa25469734 tempest-ServersNegativeTestJSON-51733469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db34d846-70ac-4336-a564-321c4f922ce4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:26:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7e39bfb0-2d3a-45f0-a469-f5aa25469734 tempest-ServersNegativeTestJSON-51733469 None] Flow 'volume_create_manager' (d238a4cf-4c8e-4452-ae64-1c0f48f1c680) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:26:31 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-7e39bfb0-2d3a-45f0-a469-f5aa25469734 tempest-ServersNegativeTestJSON-51733469 None] Created volume successfully. Nov 06 15:26:32 devstack sudo[96178]: pam_unix(sudo:session): session closed for user root Nov 06 15:26:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-680d08e1-9872-4cc7-aac2-93becdeb266e tempest-VolumesActionsTest-2124293081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-2d854549-4656-4669-a769-6a479c2168a5 1073741824" returned: 0 in 0.535s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:26:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-680d08e1-9872-4cc7-aac2-93becdeb266e tempest-VolumesActionsTest-2124293081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-2d854549-4656-4669-a769-6a479c2168a5 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:26:32 devstack sudo[96184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-2d854549-4656-4669-a769-6a479c2168a5 Nov 06 15:26:32 devstack sudo[96184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:26:32 devstack sudo[96184]: pam_unix(sudo:session): session closed for user root Nov 06 15:26:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-680d08e1-9872-4cc7-aac2-93becdeb266e tempest-VolumesActionsTest-2124293081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-2d854549-4656-4669-a769-6a479c2168a5" returned: 0 in 0.435s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:26:32 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-680d08e1-9872-4cc7-aac2-93becdeb266e tempest-VolumesActionsTest-2124293081 None] <== create_volume: return (1030ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:26:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-680d08e1-9872-4cc7-aac2-93becdeb266e tempest-VolumesActionsTest-2124293081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.033s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:26:32 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-680d08e1-9872-4cc7-aac2-93becdeb266e tempest-VolumesActionsTest-2124293081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96c0faa8-2e2e-4a4d-9c1b-19afff59306a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d854549-4656-4669-a769-6a479c2168a5', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:26:32 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-680d08e1-9872-4cc7-aac2-93becdeb266e tempest-VolumesActionsTest-2124293081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a444aff-5fdb-4b77-973c-1b52dc6f8df7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:26:32 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-680d08e1-9872-4cc7-aac2-93becdeb266e tempest-VolumesActionsTest-2124293081 None] Volume volume-2d854549-4656-4669-a769-6a479c2168a5 (2d854549-4656-4669-a769-6a479c2168a5): created successfully Nov 06 15:26:32 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-680d08e1-9872-4cc7-aac2-93becdeb266e tempest-VolumesActionsTest-2124293081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a444aff-5fdb-4b77-973c-1b52dc6f8df7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:26:32 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-680d08e1-9872-4cc7-aac2-93becdeb266e tempest-VolumesActionsTest-2124293081 None] Flow 'volume_create_manager' (09d70fb4-a5e6-4b9e-b1e6-bbde2a7cf66b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:26:32 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-680d08e1-9872-4cc7-aac2-93becdeb266e tempest-VolumesActionsTest-2124293081 None] Created volume successfully. Nov 06 15:26:33 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-976861d5-70b9-4c35-8165-aad469bff297 tempest-ServersNegativeTestJSON-51733469 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:26:33 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-976861d5-70b9-4c35-8165-aad469bff297 tempest-ServersNegativeTestJSON-51733469 None] Flow 'volume_create_manager' (1f8bdbf9-1c45-4ffe-9f47-526c68dcc546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:26:33 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-976861d5-70b9-4c35-8165-aad469bff297 tempest-ServersNegativeTestJSON-51733469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c312e74d-60f4-4ad4-8da2-533fa21bb77e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:26:33 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-976861d5-70b9-4c35-8165-aad469bff297 tempest-ServersNegativeTestJSON-51733469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c312e74d-60f4-4ad4-8da2-533fa21bb77e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:26:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-15835414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d0c56ba-b877-471e-b496-327842586a02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a363c6c682dc4f129b0c1db3eaf16212',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:26:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:26:34Z,use_quota=True,user_id='ba4c2d0258934938bc8f173f8e7b4cd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:26:33 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-976861d5-70b9-4c35-8165-aad469bff297 tempest-ServersNegativeTestJSON-51733469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19d8d362-5328-4905-8b0d-49ef5df770b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:26:33 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-976861d5-70b9-4c35-8165-aad469bff297 tempest-ServersNegativeTestJSON-51733469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19d8d362-5328-4905-8b0d-49ef5df770b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:26:33 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-976861d5-70b9-4c35-8165-aad469bff297 tempest-ServersNegativeTestJSON-51733469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (583bdf19-3432-4f6c-9726-e85ea9fb1e0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:26:33 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-976861d5-70b9-4c35-8165-aad469bff297 tempest-ServersNegativeTestJSON-51733469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (583bdf19-3432-4f6c-9726-e85ea9fb1e0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d0c56ba-b877-471e-b496-327842586a02', 'volume_name': 'volume-1d0c56ba-b877-471e-b496-327842586a02', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:26:33 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-976861d5-70b9-4c35-8165-aad469bff297 tempest-ServersNegativeTestJSON-51733469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fc89fd5-5235-40f7-9d6f-abacedc37c95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:26:33 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-976861d5-70b9-4c35-8165-aad469bff297 tempest-ServersNegativeTestJSON-51733469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fc89fd5-5235-40f7-9d6f-abacedc37c95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:26:33 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-976861d5-70b9-4c35-8165-aad469bff297 tempest-ServersNegativeTestJSON-51733469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66f5c7c4-832b-4142-8427-d15c6b64f96f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:26:33 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-976861d5-70b9-4c35-8165-aad469bff297 tempest-ServersNegativeTestJSON-51733469 None] Volume 1d0c56ba-b877-471e-b496-327842586a02: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d0c56ba-b877-471e-b496-327842586a02', 'volume_size': 1} Nov 06 15:26:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-976861d5-70b9-4c35-8165-aad469bff297 tempest-ServersNegativeTestJSON-51733469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:26:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-976861d5-70b9-4c35-8165-aad469bff297 tempest-ServersNegativeTestJSON-51733469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:26:33 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-976861d5-70b9-4c35-8165-aad469bff297 tempest-ServersNegativeTestJSON-51733469 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:26:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-15835414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d0c56ba-b877-471e-b496-327842586a02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a363c6c682dc4f129b0c1db3eaf16212',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:26:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:26:34Z,use_quota=True,user_id='ba4c2d0258934938bc8f173f8e7b4cd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:26:33 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-976861d5-70b9-4c35-8165-aad469bff297 tempest-ServersNegativeTestJSON-51733469 None] Creating volume 1d0c56ba-b877-471e-b496-327842586a02 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:26:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-976861d5-70b9-4c35-8165-aad469bff297 tempest-ServersNegativeTestJSON-51733469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:26:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-976861d5-70b9-4c35-8165-aad469bff297 tempest-ServersNegativeTestJSON-51733469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:26:33 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-976861d5-70b9-4c35-8165-aad469bff297 tempest-ServersNegativeTestJSON-51733469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:26:33 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-976861d5-70b9-4c35-8165-aad469bff297 tempest-ServersNegativeTestJSON-51733469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:26:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-976861d5-70b9-4c35-8165-aad469bff297 tempest-ServersNegativeTestJSON-51733469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:26:33 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-976861d5-70b9-4c35-8165-aad469bff297 tempest-ServersNegativeTestJSON-51733469 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:26:33 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-976861d5-70b9-4c35-8165-aad469bff297 tempest-ServersNegativeTestJSON-51733469 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:26:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-976861d5-70b9-4c35-8165-aad469bff297 tempest-ServersNegativeTestJSON-51733469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-1d0c56ba-b877-471e-b496-327842586a02 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:26:33 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-ede49c5d-b3f3-429c-b83d-bdb64116f67c tempest-VolumesActionsTest-2061083264 None] Acquiring lock "cinder-2d854549-4656-4669-a769-6a479c2168a5-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:26:33 devstack sudo[96188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-1d0c56ba-b877-471e-b496-327842586a02 1073741824 Nov 06 15:26:33 devstack sudo[96188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:26:33 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-ede49c5d-b3f3-429c-b83d-bdb64116f67c tempest-VolumesActionsTest-2061083264 None] Lock "cinder-2d854549-4656-4669-a769-6a479c2168a5-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:26:33 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-ede49c5d-b3f3-429c-b83d-bdb64116f67c tempest-VolumesActionsTest-2061083264 None] Acquiring lock "cinder-quobyte-2d854549-4656-4669-a769-6a479c2168a5" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:26:33 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-ede49c5d-b3f3-429c-b83d-bdb64116f67c tempest-VolumesActionsTest-2061083264 None] Lock "cinder-quobyte-2d854549-4656-4669-a769-6a479c2168a5" acquired by "delete_volume" :: waited 0.022s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:26:33 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[4faf872f-2b97-474a-8804-1ea61399bc24]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:26:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ede49c5d-b3f3-429c-b83d-bdb64116f67c tempest-VolumesActionsTest-2061083264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-2d854549-4656-4669-a769-6a479c2168a5 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:26:34 devstack sudo[96190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-2d854549-4656-4669-a769-6a479c2168a5 Nov 06 15:26:34 devstack sudo[96190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:26:34 devstack sudo[96188]: pam_unix(sudo:session): session closed for user root Nov 06 15:26:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-976861d5-70b9-4c35-8165-aad469bff297 tempest-ServersNegativeTestJSON-51733469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-1d0c56ba-b877-471e-b496-327842586a02 1073741824" returned: 0 in 0.641s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:26:34 devstack sudo[96190]: pam_unix(sudo:session): session closed for user root Nov 06 15:26:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ede49c5d-b3f3-429c-b83d-bdb64116f67c tempest-VolumesActionsTest-2061083264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-2d854549-4656-4669-a769-6a479c2168a5" returned: 0 in 0.476s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:26:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ede49c5d-b3f3-429c-b83d-bdb64116f67c tempest-VolumesActionsTest-2061083264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-2d854549-4656-4669-a769-6a479c2168a5 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:26:34 devstack sudo[96200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-2d854549-4656-4669-a769-6a479c2168a5 Nov 06 15:26:34 devstack sudo[96200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:26:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-976861d5-70b9-4c35-8165-aad469bff297 tempest-ServersNegativeTestJSON-51733469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-1d0c56ba-b877-471e-b496-327842586a02 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:26:34 devstack sudo[96202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-1d0c56ba-b877-471e-b496-327842586a02 Nov 06 15:26:34 devstack sudo[96202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:26:34 devstack sudo[96202]: pam_unix(sudo:session): session closed for user root Nov 06 15:26:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-976861d5-70b9-4c35-8165-aad469bff297 tempest-ServersNegativeTestJSON-51733469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-1d0c56ba-b877-471e-b496-327842586a02" returned: 0 in 0.303s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:26:34 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-976861d5-70b9-4c35-8165-aad469bff297 tempest-ServersNegativeTestJSON-51733469 None] <== create_volume: return (1056ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:26:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-976861d5-70b9-4c35-8165-aad469bff297 tempest-ServersNegativeTestJSON-51733469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.060s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:26:34 devstack sudo[96200]: pam_unix(sudo:session): session closed for user root Nov 06 15:26:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ede49c5d-b3f3-429c-b83d-bdb64116f67c tempest-VolumesActionsTest-2061083264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-2d854549-4656-4669-a769-6a479c2168a5" returned: 0 in 0.388s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:26:34 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-976861d5-70b9-4c35-8165-aad469bff297 tempest-ServersNegativeTestJSON-51733469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66f5c7c4-832b-4142-8427-d15c6b64f96f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d0c56ba-b877-471e-b496-327842586a02', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:26:34 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-976861d5-70b9-4c35-8165-aad469bff297 tempest-ServersNegativeTestJSON-51733469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8844a17-e34c-4693-a698-df2eff768e3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:26:34 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-ede49c5d-b3f3-429c-b83d-bdb64116f67c tempest-VolumesActionsTest-2061083264 None] Lock "cinder-quobyte-2d854549-4656-4669-a769-6a479c2168a5" released by "delete_volume" :: held 0.938s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:26:34 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-976861d5-70b9-4c35-8165-aad469bff297 tempest-ServersNegativeTestJSON-51733469 None] Volume volume-1d0c56ba-b877-471e-b496-327842586a02 (1d0c56ba-b877-471e-b496-327842586a02): created successfully Nov 06 15:26:34 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-976861d5-70b9-4c35-8165-aad469bff297 tempest-ServersNegativeTestJSON-51733469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8844a17-e34c-4693-a698-df2eff768e3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:26:34 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-976861d5-70b9-4c35-8165-aad469bff297 tempest-ServersNegativeTestJSON-51733469 None] Flow 'volume_create_manager' (1f8bdbf9-1c45-4ffe-9f47-526c68dcc546) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:26:34 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-976861d5-70b9-4c35-8165-aad469bff297 tempest-ServersNegativeTestJSON-51733469 None] Created volume successfully. Nov 06 15:26:34 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-ede49c5d-b3f3-429c-b83d-bdb64116f67c tempest-VolumesActionsTest-2061083264 None] Created reservations ['ece38ee1-887e-4d7d-a0ea-dbfc790aca3c', 'cced78c1-8198-47c1-8afe-4cec579169f1', '2572f96a-b8c4-4b4b-a600-281825c479a5', '192c15fc-8673-4a7c-9333-f0c8367b6e7f'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:26:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ede49c5d-b3f3-429c-b83d-bdb64116f67c tempest-VolumesActionsTest-2061083264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:26:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ede49c5d-b3f3-429c-b83d-bdb64116f67c tempest-VolumesActionsTest-2061083264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:26:35 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-ede49c5d-b3f3-429c-b83d-bdb64116f67c tempest-VolumesActionsTest-2061083264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:26:35 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-ede49c5d-b3f3-429c-b83d-bdb64116f67c tempest-VolumesActionsTest-2061083264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:26:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ede49c5d-b3f3-429c-b83d-bdb64116f67c tempest-VolumesActionsTest-2061083264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:26:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ede49c5d-b3f3-429c-b83d-bdb64116f67c tempest-VolumesActionsTest-2061083264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:26:35 devstack sudo[96207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:26:35 devstack sudo[96207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:26:35 devstack sudo[96207]: pam_unix(sudo:session): session closed for user root Nov 06 15:26:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ede49c5d-b3f3-429c-b83d-bdb64116f67c tempest-VolumesActionsTest-2061083264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.251s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:26:35 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-ede49c5d-b3f3-429c-b83d-bdb64116f67c tempest-VolumesActionsTest-2061083264 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:26:35 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-ede49c5d-b3f3-429c-b83d-bdb64116f67c tempest-VolumesActionsTest-2061083264 None] Deleted volume successfully. Nov 06 15:26:35 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-ede49c5d-b3f3-429c-b83d-bdb64116f67c tempest-VolumesActionsTest-2061083264 None] Lock "cinder-2d854549-4656-4669-a769-6a479c2168a5-delete_volume" released by "delete_volume" :: held 1.488s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:26:36 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-8bda11a4-008a-40d1-b5fa-cd10ca2e595b tempest-ServersNegativeTestJSON-51733469 None] Acquiring lock "cinder-1d0c56ba-b877-471e-b496-327842586a02-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:26:36 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-8bda11a4-008a-40d1-b5fa-cd10ca2e595b tempest-ServersNegativeTestJSON-51733469 None] Lock "cinder-1d0c56ba-b877-471e-b496-327842586a02-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:26:36 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-8bda11a4-008a-40d1-b5fa-cd10ca2e595b tempest-ServersNegativeTestJSON-51733469 None] Acquiring lock "cinder-quobyte-1d0c56ba-b877-471e-b496-327842586a02" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:26:36 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-8bda11a4-008a-40d1-b5fa-cd10ca2e595b tempest-ServersNegativeTestJSON-51733469 None] Lock "cinder-quobyte-1d0c56ba-b877-471e-b496-327842586a02" acquired by "delete_volume" :: waited 0.025s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:26:36 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[6419aacb-1b53-422b-bf15-ecdf952abb7b]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:26:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8bda11a4-008a-40d1-b5fa-cd10ca2e595b tempest-ServersNegativeTestJSON-51733469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-1d0c56ba-b877-471e-b496-327842586a02 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:26:36 devstack sudo[96235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-1d0c56ba-b877-471e-b496-327842586a02 Nov 06 15:26:36 devstack sudo[96235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:26:36 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d185879-339f-43f5-b4a4-ea7671a7e917 tempest-VolumesActionsTest-2124293081 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:26:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5d185879-339f-43f5-b4a4-ea7671a7e917 tempest-VolumesActionsTest-2124293081 None] Flow 'volume_create_manager' (c25db48b-eef8-426b-b04b-2e53f3dc7758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:26:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5d185879-339f-43f5-b4a4-ea7671a7e917 tempest-VolumesActionsTest-2124293081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca89b754-a8d0-4910-b357-0b1ac847b751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:26:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5d185879-339f-43f5-b4a4-ea7671a7e917 tempest-VolumesActionsTest-2124293081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca89b754-a8d0-4910-b357-0b1ac847b751) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:26:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1511476389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f166a3d0-bf95-48c1-87f1-c8d96f09d41f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d0b6abc042242be823fc382d007712a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:26:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:26:37Z,use_quota=True,user_id='abff5ddd914544e7a269405c2ec272b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:26:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5d185879-339f-43f5-b4a4-ea7671a7e917 tempest-VolumesActionsTest-2124293081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed83f364-fa9a-4a11-abce-b6b5ec8406bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:26:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5d185879-339f-43f5-b4a4-ea7671a7e917 tempest-VolumesActionsTest-2124293081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed83f364-fa9a-4a11-abce-b6b5ec8406bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:26:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5d185879-339f-43f5-b4a4-ea7671a7e917 tempest-VolumesActionsTest-2124293081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec0ae982-004d-4252-b51b-04372c529a04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:26:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5d185879-339f-43f5-b4a4-ea7671a7e917 tempest-VolumesActionsTest-2124293081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec0ae982-004d-4252-b51b-04372c529a04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f166a3d0-bf95-48c1-87f1-c8d96f09d41f', 'volume_name': 'volume-f166a3d0-bf95-48c1-87f1-c8d96f09d41f', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:26:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5d185879-339f-43f5-b4a4-ea7671a7e917 tempest-VolumesActionsTest-2124293081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef96d43e-48f9-4b2b-9b63-dbd9e85ba36e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:26:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5d185879-339f-43f5-b4a4-ea7671a7e917 tempest-VolumesActionsTest-2124293081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef96d43e-48f9-4b2b-9b63-dbd9e85ba36e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:26:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5d185879-339f-43f5-b4a4-ea7671a7e917 tempest-VolumesActionsTest-2124293081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c19a9692-42fc-4c97-998c-fc4200b171e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:26:36 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-5d185879-339f-43f5-b4a4-ea7671a7e917 tempest-VolumesActionsTest-2124293081 None] Volume f166a3d0-bf95-48c1-87f1-c8d96f09d41f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f166a3d0-bf95-48c1-87f1-c8d96f09d41f', 'volume_size': 1} Nov 06 15:26:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5d185879-339f-43f5-b4a4-ea7671a7e917 tempest-VolumesActionsTest-2124293081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:26:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5d185879-339f-43f5-b4a4-ea7671a7e917 tempest-VolumesActionsTest-2124293081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:26:36 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-5d185879-339f-43f5-b4a4-ea7671a7e917 tempest-VolumesActionsTest-2124293081 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:26:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1511476389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f166a3d0-bf95-48c1-87f1-c8d96f09d41f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d0b6abc042242be823fc382d007712a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:26:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:26:37Z,use_quota=True,user_id='abff5ddd914544e7a269405c2ec272b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:26:36 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-5d185879-339f-43f5-b4a4-ea7671a7e917 tempest-VolumesActionsTest-2124293081 None] Creating volume f166a3d0-bf95-48c1-87f1-c8d96f09d41f {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:26:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5d185879-339f-43f5-b4a4-ea7671a7e917 tempest-VolumesActionsTest-2124293081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:26:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5d185879-339f-43f5-b4a4-ea7671a7e917 tempest-VolumesActionsTest-2124293081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:26:36 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-5d185879-339f-43f5-b4a4-ea7671a7e917 tempest-VolumesActionsTest-2124293081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:26:36 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-5d185879-339f-43f5-b4a4-ea7671a7e917 tempest-VolumesActionsTest-2124293081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:26:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5d185879-339f-43f5-b4a4-ea7671a7e917 tempest-VolumesActionsTest-2124293081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:26:36 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-5d185879-339f-43f5-b4a4-ea7671a7e917 tempest-VolumesActionsTest-2124293081 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:26:36 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-5d185879-339f-43f5-b4a4-ea7671a7e917 tempest-VolumesActionsTest-2124293081 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:26:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5d185879-339f-43f5-b4a4-ea7671a7e917 tempest-VolumesActionsTest-2124293081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f166a3d0-bf95-48c1-87f1-c8d96f09d41f 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:26:37 devstack sudo[96241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f166a3d0-bf95-48c1-87f1-c8d96f09d41f 1073741824 Nov 06 15:26:37 devstack sudo[96241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:26:37 devstack sudo[96235]: pam_unix(sudo:session): session closed for user root Nov 06 15:26:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8bda11a4-008a-40d1-b5fa-cd10ca2e595b tempest-ServersNegativeTestJSON-51733469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-1d0c56ba-b877-471e-b496-327842586a02" returned: 0 in 0.461s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:26:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8bda11a4-008a-40d1-b5fa-cd10ca2e595b tempest-ServersNegativeTestJSON-51733469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-1d0c56ba-b877-471e-b496-327842586a02 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:26:37 devstack sudo[96243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-1d0c56ba-b877-471e-b496-327842586a02 Nov 06 15:26:37 devstack sudo[96243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:26:37 devstack sudo[96243]: pam_unix(sudo:session): session closed for user root Nov 06 15:26:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8bda11a4-008a-40d1-b5fa-cd10ca2e595b tempest-ServersNegativeTestJSON-51733469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-1d0c56ba-b877-471e-b496-327842586a02" returned: 0 in 0.296s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:26:37 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-8bda11a4-008a-40d1-b5fa-cd10ca2e595b tempest-ServersNegativeTestJSON-51733469 None] Lock "cinder-quobyte-1d0c56ba-b877-471e-b496-327842586a02" released by "delete_volume" :: held 0.860s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:26:37 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-8bda11a4-008a-40d1-b5fa-cd10ca2e595b tempest-ServersNegativeTestJSON-51733469 None] Created reservations ['0dd1b72a-a06f-4e6f-ab4d-8f4d59d4bd2e', 'f075b811-c826-419c-aaf9-4540cc6a655c', 'e9fe9ced-fc87-4f74-9eda-b558c83db332', '2603bedd-8006-486e-bd39-f60debe2e6d7'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:26:37 devstack sudo[96241]: pam_unix(sudo:session): session closed for user root Nov 06 15:26:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5d185879-339f-43f5-b4a4-ea7671a7e917 tempest-VolumesActionsTest-2124293081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f166a3d0-bf95-48c1-87f1-c8d96f09d41f 1073741824" returned: 0 in 0.490s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:26:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8bda11a4-008a-40d1-b5fa-cd10ca2e595b tempest-ServersNegativeTestJSON-51733469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:26:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8bda11a4-008a-40d1-b5fa-cd10ca2e595b tempest-ServersNegativeTestJSON-51733469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:26:37 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-8bda11a4-008a-40d1-b5fa-cd10ca2e595b tempest-ServersNegativeTestJSON-51733469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:26:37 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-8bda11a4-008a-40d1-b5fa-cd10ca2e595b tempest-ServersNegativeTestJSON-51733469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:26:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8bda11a4-008a-40d1-b5fa-cd10ca2e595b tempest-ServersNegativeTestJSON-51733469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:26:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8bda11a4-008a-40d1-b5fa-cd10ca2e595b tempest-ServersNegativeTestJSON-51733469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:26:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5d185879-339f-43f5-b4a4-ea7671a7e917 tempest-VolumesActionsTest-2124293081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f166a3d0-bf95-48c1-87f1-c8d96f09d41f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:26:37 devstack sudo[96250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:26:37 devstack sudo[96250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:26:37 devstack sudo[96251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f166a3d0-bf95-48c1-87f1-c8d96f09d41f Nov 06 15:26:37 devstack sudo[96251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:26:37 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a38f03a1-b176-42de-8ec2-6e111363512c tempest-ServersNegativeTestJSON-51733469 None] Acquiring lock "cinder-a740d3ac-050a-4f05-885a-5c11dc501e2d-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:26:37 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a38f03a1-b176-42de-8ec2-6e111363512c tempest-ServersNegativeTestJSON-51733469 None] Lock "cinder-a740d3ac-050a-4f05-885a-5c11dc501e2d-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:26:37 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a38f03a1-b176-42de-8ec2-6e111363512c tempest-ServersNegativeTestJSON-51733469 None] Acquiring lock "cinder-quobyte-a740d3ac-050a-4f05-885a-5c11dc501e2d" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:26:37 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a38f03a1-b176-42de-8ec2-6e111363512c tempest-ServersNegativeTestJSON-51733469 None] Lock "cinder-quobyte-a740d3ac-050a-4f05-885a-5c11dc501e2d" acquired by "delete_volume" :: waited 0.022s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:26:37 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2fcb439-299a-46c6-9c7f-85b0563f49d3]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:26:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a38f03a1-b176-42de-8ec2-6e111363512c tempest-ServersNegativeTestJSON-51733469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a740d3ac-050a-4f05-885a-5c11dc501e2d {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:26:37 devstack sudo[96250]: pam_unix(sudo:session): session closed for user root Nov 06 15:26:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8bda11a4-008a-40d1-b5fa-cd10ca2e595b tempest-ServersNegativeTestJSON-51733469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.333s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:26:37 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-8bda11a4-008a-40d1-b5fa-cd10ca2e595b tempest-ServersNegativeTestJSON-51733469 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:26:37 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-8bda11a4-008a-40d1-b5fa-cd10ca2e595b tempest-ServersNegativeTestJSON-51733469 None] Deleted volume successfully. Nov 06 15:26:37 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-8bda11a4-008a-40d1-b5fa-cd10ca2e595b tempest-ServersNegativeTestJSON-51733469 None] Lock "cinder-1d0c56ba-b877-471e-b496-327842586a02-delete_volume" released by "delete_volume" :: held 1.455s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:26:37 devstack sudo[96251]: pam_unix(sudo:session): session closed for user root Nov 06 15:26:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5d185879-339f-43f5-b4a4-ea7671a7e917 tempest-VolumesActionsTest-2124293081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f166a3d0-bf95-48c1-87f1-c8d96f09d41f" returned: 0 in 0.395s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:26:37 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-5d185879-339f-43f5-b4a4-ea7671a7e917 tempest-VolumesActionsTest-2124293081 None] <== create_volume: return (955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:26:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5d185879-339f-43f5-b4a4-ea7671a7e917 tempest-VolumesActionsTest-2124293081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.959s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:26:37 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5d185879-339f-43f5-b4a4-ea7671a7e917 tempest-VolumesActionsTest-2124293081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c19a9692-42fc-4c97-998c-fc4200b171e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f166a3d0-bf95-48c1-87f1-c8d96f09d41f', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:26:37 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5d185879-339f-43f5-b4a4-ea7671a7e917 tempest-VolumesActionsTest-2124293081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0de40c2-878b-489a-b21d-b8b70e4caf22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:26:37 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-5d185879-339f-43f5-b4a4-ea7671a7e917 tempest-VolumesActionsTest-2124293081 None] Volume volume-f166a3d0-bf95-48c1-87f1-c8d96f09d41f (f166a3d0-bf95-48c1-87f1-c8d96f09d41f): created successfully Nov 06 15:26:37 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5d185879-339f-43f5-b4a4-ea7671a7e917 tempest-VolumesActionsTest-2124293081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0de40c2-878b-489a-b21d-b8b70e4caf22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:26:37 devstack sudo[96255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a740d3ac-050a-4f05-885a-5c11dc501e2d Nov 06 15:26:37 devstack sudo[96255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:26:37 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5d185879-339f-43f5-b4a4-ea7671a7e917 tempest-VolumesActionsTest-2124293081 None] Flow 'volume_create_manager' (c25db48b-eef8-426b-b04b-2e53f3dc7758) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:26:38 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-5d185879-339f-43f5-b4a4-ea7671a7e917 tempest-VolumesActionsTest-2124293081 None] Created volume successfully. Nov 06 15:26:38 devstack sudo[96255]: pam_unix(sudo:session): session closed for user root Nov 06 15:26:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a38f03a1-b176-42de-8ec2-6e111363512c tempest-ServersNegativeTestJSON-51733469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a740d3ac-050a-4f05-885a-5c11dc501e2d" returned: 0 in 0.436s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:26:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a38f03a1-b176-42de-8ec2-6e111363512c tempest-ServersNegativeTestJSON-51733469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a740d3ac-050a-4f05-885a-5c11dc501e2d {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:26:38 devstack sudo[96261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a740d3ac-050a-4f05-885a-5c11dc501e2d Nov 06 15:26:38 devstack sudo[96261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:26:38 devstack sudo[96261]: pam_unix(sudo:session): session closed for user root Nov 06 15:26:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a38f03a1-b176-42de-8ec2-6e111363512c tempest-ServersNegativeTestJSON-51733469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a740d3ac-050a-4f05-885a-5c11dc501e2d" returned: 0 in 0.242s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:26:38 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a38f03a1-b176-42de-8ec2-6e111363512c tempest-ServersNegativeTestJSON-51733469 None] Lock "cinder-quobyte-a740d3ac-050a-4f05-885a-5c11dc501e2d" released by "delete_volume" :: held 0.757s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:26:38 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-a38f03a1-b176-42de-8ec2-6e111363512c tempest-ServersNegativeTestJSON-51733469 None] Created reservations ['b2667a4c-4a7a-4b6c-b03d-5ac43543b0ab', '4a9266cc-71ed-4f23-8692-2e572c23546e', '9de98539-cafc-4b1e-a27b-fd6b9f074b57', 'e5992be0-e131-4293-9bd4-d4b40d6ff0e7'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:26:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a38f03a1-b176-42de-8ec2-6e111363512c tempest-ServersNegativeTestJSON-51733469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:26:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a38f03a1-b176-42de-8ec2-6e111363512c tempest-ServersNegativeTestJSON-51733469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:26:38 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-a38f03a1-b176-42de-8ec2-6e111363512c tempest-ServersNegativeTestJSON-51733469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:26:38 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-a38f03a1-b176-42de-8ec2-6e111363512c tempest-ServersNegativeTestJSON-51733469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:26:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a38f03a1-b176-42de-8ec2-6e111363512c tempest-ServersNegativeTestJSON-51733469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:26:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a38f03a1-b176-42de-8ec2-6e111363512c tempest-ServersNegativeTestJSON-51733469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:26:38 devstack sudo[96264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:26:38 devstack sudo[96264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:26:38 devstack sudo[96264]: pam_unix(sudo:session): session closed for user root Nov 06 15:26:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a38f03a1-b176-42de-8ec2-6e111363512c tempest-ServersNegativeTestJSON-51733469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.267s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:26:38 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-a38f03a1-b176-42de-8ec2-6e111363512c tempest-ServersNegativeTestJSON-51733469 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:26:38 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-a38f03a1-b176-42de-8ec2-6e111363512c tempest-ServersNegativeTestJSON-51733469 None] Deleted volume successfully. Nov 06 15:26:38 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a38f03a1-b176-42de-8ec2-6e111363512c tempest-ServersNegativeTestJSON-51733469 None] Lock "cinder-a740d3ac-050a-4f05-885a-5c11dc501e2d-delete_volume" released by "delete_volume" :: held 1.279s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:26:39 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-08230486-f77b-4514-9a2c-106506500b57 tempest-VolumesActionsTest-2061083264 None] Acquiring lock "cinder-f166a3d0-bf95-48c1-87f1-c8d96f09d41f-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:26:39 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-08230486-f77b-4514-9a2c-106506500b57 tempest-VolumesActionsTest-2061083264 None] Lock "cinder-f166a3d0-bf95-48c1-87f1-c8d96f09d41f-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:26:39 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-08230486-f77b-4514-9a2c-106506500b57 tempest-VolumesActionsTest-2061083264 None] Acquiring lock "cinder-quobyte-f166a3d0-bf95-48c1-87f1-c8d96f09d41f" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:26:39 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-08230486-f77b-4514-9a2c-106506500b57 tempest-VolumesActionsTest-2061083264 None] Lock "cinder-quobyte-f166a3d0-bf95-48c1-87f1-c8d96f09d41f" acquired by "delete_volume" :: waited 0.023s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:26:39 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5fe5568-d5d5-4158-a7de-f29b6160898f]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:26:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-08230486-f77b-4514-9a2c-106506500b57 tempest-VolumesActionsTest-2061083264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f166a3d0-bf95-48c1-87f1-c8d96f09d41f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:26:39 devstack sudo[96273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f166a3d0-bf95-48c1-87f1-c8d96f09d41f Nov 06 15:26:39 devstack sudo[96273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:26:39 devstack sudo[96273]: pam_unix(sudo:session): session closed for user root Nov 06 15:26:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-08230486-f77b-4514-9a2c-106506500b57 tempest-VolumesActionsTest-2061083264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f166a3d0-bf95-48c1-87f1-c8d96f09d41f" returned: 0 in 0.579s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:26:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-08230486-f77b-4514-9a2c-106506500b57 tempest-VolumesActionsTest-2061083264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f166a3d0-bf95-48c1-87f1-c8d96f09d41f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:26:40 devstack sudo[96294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f166a3d0-bf95-48c1-87f1-c8d96f09d41f Nov 06 15:26:40 devstack sudo[96294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:26:40 devstack sudo[96294]: pam_unix(sudo:session): session closed for user root Nov 06 15:26:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-08230486-f77b-4514-9a2c-106506500b57 tempest-VolumesActionsTest-2061083264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f166a3d0-bf95-48c1-87f1-c8d96f09d41f" returned: 0 in 0.396s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:26:40 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-08230486-f77b-4514-9a2c-106506500b57 tempest-VolumesActionsTest-2061083264 None] Lock "cinder-quobyte-f166a3d0-bf95-48c1-87f1-c8d96f09d41f" released by "delete_volume" :: held 1.039s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:26:40 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-08230486-f77b-4514-9a2c-106506500b57 tempest-VolumesActionsTest-2061083264 None] Created reservations ['7059339e-09dd-4c5c-8e64-ab1794fb53c4', 'b5096eca-0806-4099-a30e-b8932a9879f3', 'c96a1601-d049-482a-be84-49ed4aa14cd6', 'b7108f4b-dd5e-47d8-b6f8-f4ec0b2b7b94'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:26:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-08230486-f77b-4514-9a2c-106506500b57 tempest-VolumesActionsTest-2061083264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:26:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-08230486-f77b-4514-9a2c-106506500b57 tempest-VolumesActionsTest-2061083264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:26:40 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-08230486-f77b-4514-9a2c-106506500b57 tempest-VolumesActionsTest-2061083264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:26:40 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-08230486-f77b-4514-9a2c-106506500b57 tempest-VolumesActionsTest-2061083264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:26:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-08230486-f77b-4514-9a2c-106506500b57 tempest-VolumesActionsTest-2061083264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:26:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-08230486-f77b-4514-9a2c-106506500b57 tempest-VolumesActionsTest-2061083264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:26:40 devstack sudo[96299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:26:40 devstack sudo[96299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:26:40 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:SELECT=105,cinder:UPDATE=143,cinder:INSERT=31,cinder:DELETE=13 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 15:26:40 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-c74345fc-535f-4506-ab51-0f9a8940728d tempest-VolumesSnapshotListTestJSON-618257825 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:26:40 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c74345fc-535f-4506-ab51-0f9a8940728d tempest-VolumesSnapshotListTestJSON-618257825 None] Flow 'volume_create_manager' (d2b91c18-92ce-4912-a2e1-c7115effcdae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:26:40 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c74345fc-535f-4506-ab51-0f9a8940728d tempest-VolumesSnapshotListTestJSON-618257825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cb30d57-86f7-4e4e-a90c-a3d36bd9a3b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:26:40 devstack sudo[96299]: pam_unix(sudo:session): session closed for user root Nov 06 15:26:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-08230486-f77b-4514-9a2c-106506500b57 tempest-VolumesActionsTest-2061083264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.271s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:26:40 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-08230486-f77b-4514-9a2c-106506500b57 tempest-VolumesActionsTest-2061083264 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:26:40 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-08230486-f77b-4514-9a2c-106506500b57 tempest-VolumesActionsTest-2061083264 None] Deleted volume successfully. Nov 06 15:26:40 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c74345fc-535f-4506-ab51-0f9a8940728d tempest-VolumesSnapshotListTestJSON-618257825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cb30d57-86f7-4e4e-a90c-a3d36bd9a3b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:26:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-316035694',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1b5f306-9a27-4a2d-94c0-e25e1f9637a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de0596d180e94c55978a73d2bd7e82dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:26:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:26:41Z,use_quota=True,user_id='befedb8e9eb1498ea9606b5ec40542c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:26:40 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c74345fc-535f-4506-ab51-0f9a8940728d tempest-VolumesSnapshotListTestJSON-618257825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1a7fd70-32a0-4cbe-9ffa-a12496973f6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:26:40 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c74345fc-535f-4506-ab51-0f9a8940728d tempest-VolumesSnapshotListTestJSON-618257825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1a7fd70-32a0-4cbe-9ffa-a12496973f6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:26:41 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c74345fc-535f-4506-ab51-0f9a8940728d tempest-VolumesSnapshotListTestJSON-618257825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84f6509c-99e5-4c0b-96a8-41f98619f220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:26:41 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c74345fc-535f-4506-ab51-0f9a8940728d tempest-VolumesSnapshotListTestJSON-618257825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84f6509c-99e5-4c0b-96a8-41f98619f220) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1b5f306-9a27-4a2d-94c0-e25e1f9637a6', 'volume_name': 'volume-b1b5f306-9a27-4a2d-94c0-e25e1f9637a6', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:26:41 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c74345fc-535f-4506-ab51-0f9a8940728d tempest-VolumesSnapshotListTestJSON-618257825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e262361-30cf-45a3-b099-99503ff19dc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:26:41 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c74345fc-535f-4506-ab51-0f9a8940728d tempest-VolumesSnapshotListTestJSON-618257825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e262361-30cf-45a3-b099-99503ff19dc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:26:41 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c74345fc-535f-4506-ab51-0f9a8940728d tempest-VolumesSnapshotListTestJSON-618257825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee555a18-3a04-455e-afea-a0b8f41378c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:26:41 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-c74345fc-535f-4506-ab51-0f9a8940728d tempest-VolumesSnapshotListTestJSON-618257825 None] Volume b1b5f306-9a27-4a2d-94c0-e25e1f9637a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1b5f306-9a27-4a2d-94c0-e25e1f9637a6', 'volume_size': 1} Nov 06 15:26:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c74345fc-535f-4506-ab51-0f9a8940728d tempest-VolumesSnapshotListTestJSON-618257825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:26:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c74345fc-535f-4506-ab51-0f9a8940728d tempest-VolumesSnapshotListTestJSON-618257825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:26:41 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c74345fc-535f-4506-ab51-0f9a8940728d tempest-VolumesSnapshotListTestJSON-618257825 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:26:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-316035694',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1b5f306-9a27-4a2d-94c0-e25e1f9637a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de0596d180e94c55978a73d2bd7e82dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:26:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:26:41Z,use_quota=True,user_id='befedb8e9eb1498ea9606b5ec40542c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:26:41 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-c74345fc-535f-4506-ab51-0f9a8940728d tempest-VolumesSnapshotListTestJSON-618257825 None] Creating volume b1b5f306-9a27-4a2d-94c0-e25e1f9637a6 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:26:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c74345fc-535f-4506-ab51-0f9a8940728d tempest-VolumesSnapshotListTestJSON-618257825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:26:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c74345fc-535f-4506-ab51-0f9a8940728d tempest-VolumesSnapshotListTestJSON-618257825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:26:41 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c74345fc-535f-4506-ab51-0f9a8940728d tempest-VolumesSnapshotListTestJSON-618257825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:26:41 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c74345fc-535f-4506-ab51-0f9a8940728d tempest-VolumesSnapshotListTestJSON-618257825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:26:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c74345fc-535f-4506-ab51-0f9a8940728d tempest-VolumesSnapshotListTestJSON-618257825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:26:41 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c74345fc-535f-4506-ab51-0f9a8940728d tempest-VolumesSnapshotListTestJSON-618257825 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:26:41 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-c74345fc-535f-4506-ab51-0f9a8940728d tempest-VolumesSnapshotListTestJSON-618257825 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:26:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c74345fc-535f-4506-ab51-0f9a8940728d tempest-VolumesSnapshotListTestJSON-618257825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b1b5f306-9a27-4a2d-94c0-e25e1f9637a6 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:26:41 devstack sudo[96302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b1b5f306-9a27-4a2d-94c0-e25e1f9637a6 1073741824 Nov 06 15:26:41 devstack sudo[96302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:26:41 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-08230486-f77b-4514-9a2c-106506500b57 tempest-VolumesActionsTest-2061083264 None] Lock "cinder-f166a3d0-bf95-48c1-87f1-c8d96f09d41f-delete_volume" released by "delete_volume" :: held 1.779s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:26:41 devstack sudo[96302]: pam_unix(sudo:session): session closed for user root Nov 06 15:26:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c74345fc-535f-4506-ab51-0f9a8940728d tempest-VolumesSnapshotListTestJSON-618257825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b1b5f306-9a27-4a2d-94c0-e25e1f9637a6 1073741824" returned: 0 in 0.427s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:26:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c74345fc-535f-4506-ab51-0f9a8940728d tempest-VolumesSnapshotListTestJSON-618257825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b1b5f306-9a27-4a2d-94c0-e25e1f9637a6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:26:41 devstack sudo[96308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b1b5f306-9a27-4a2d-94c0-e25e1f9637a6 Nov 06 15:26:41 devstack sudo[96308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:26:41 devstack sudo[96308]: pam_unix(sudo:session): session closed for user root Nov 06 15:26:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c74345fc-535f-4506-ab51-0f9a8940728d tempest-VolumesSnapshotListTestJSON-618257825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b1b5f306-9a27-4a2d-94c0-e25e1f9637a6" returned: 0 in 0.279s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:26:41 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c74345fc-535f-4506-ab51-0f9a8940728d tempest-VolumesSnapshotListTestJSON-618257825 None] <== create_volume: return (748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:26:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c74345fc-535f-4506-ab51-0f9a8940728d tempest-VolumesSnapshotListTestJSON-618257825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.751s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:26:41 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c74345fc-535f-4506-ab51-0f9a8940728d tempest-VolumesSnapshotListTestJSON-618257825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee555a18-3a04-455e-afea-a0b8f41378c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1b5f306-9a27-4a2d-94c0-e25e1f9637a6', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:26:41 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c74345fc-535f-4506-ab51-0f9a8940728d tempest-VolumesSnapshotListTestJSON-618257825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4f251db-c42f-448b-bcaa-4e5aec2f5487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:26:41 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-c74345fc-535f-4506-ab51-0f9a8940728d tempest-VolumesSnapshotListTestJSON-618257825 None] Volume volume-b1b5f306-9a27-4a2d-94c0-e25e1f9637a6 (b1b5f306-9a27-4a2d-94c0-e25e1f9637a6): created successfully Nov 06 15:26:41 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c74345fc-535f-4506-ab51-0f9a8940728d tempest-VolumesSnapshotListTestJSON-618257825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4f251db-c42f-448b-bcaa-4e5aec2f5487) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:26:41 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c74345fc-535f-4506-ab51-0f9a8940728d tempest-VolumesSnapshotListTestJSON-618257825 None] Flow 'volume_create_manager' (d2b91c18-92ce-4912-a2e1-c7115effcdae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:26:41 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-c74345fc-535f-4506-ab51-0f9a8940728d tempest-VolumesSnapshotListTestJSON-618257825 None] Created volume successfully. Nov 06 15:26:42 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-67afe6ac-b1d2-4cff-962c-82acb7099643 tempest-VolumesActionsTest-2124293081 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:26:42 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-67afe6ac-b1d2-4cff-962c-82acb7099643 tempest-VolumesActionsTest-2124293081 None] Flow 'volume_create_manager' (ec3eba6c-a988-45ad-b56f-b2f84bb673d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:26:42 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-67afe6ac-b1d2-4cff-962c-82acb7099643 tempest-VolumesActionsTest-2124293081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25c2d22f-1617-41af-ad7d-8cc020121d6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:26:42 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-67afe6ac-b1d2-4cff-962c-82acb7099643 tempest-VolumesActionsTest-2124293081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25c2d22f-1617-41af-ad7d-8cc020121d6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:26:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1824183203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a6fe30e-3ecc-413c-9cef-84d9784845dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d0b6abc042242be823fc382d007712a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:26:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:26:42Z,use_quota=True,user_id='abff5ddd914544e7a269405c2ec272b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:26:42 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-67afe6ac-b1d2-4cff-962c-82acb7099643 tempest-VolumesActionsTest-2124293081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77e8829a-c302-44f6-9af0-ba17dd018a3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:26:42 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-67afe6ac-b1d2-4cff-962c-82acb7099643 tempest-VolumesActionsTest-2124293081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77e8829a-c302-44f6-9af0-ba17dd018a3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:26:42 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-67afe6ac-b1d2-4cff-962c-82acb7099643 tempest-VolumesActionsTest-2124293081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47c84060-534f-45e3-803c-b9774acd57ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:26:42 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-67afe6ac-b1d2-4cff-962c-82acb7099643 tempest-VolumesActionsTest-2124293081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47c84060-534f-45e3-803c-b9774acd57ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a6fe30e-3ecc-413c-9cef-84d9784845dc', 'volume_name': 'volume-8a6fe30e-3ecc-413c-9cef-84d9784845dc', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:26:42 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-67afe6ac-b1d2-4cff-962c-82acb7099643 tempest-VolumesActionsTest-2124293081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7efade44-5506-4911-ad47-84efc63d907a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:26:42 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-67afe6ac-b1d2-4cff-962c-82acb7099643 tempest-VolumesActionsTest-2124293081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7efade44-5506-4911-ad47-84efc63d907a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:26:42 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-67afe6ac-b1d2-4cff-962c-82acb7099643 tempest-VolumesActionsTest-2124293081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bbb4336-4dd2-4448-8820-940a0c451caa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:26:42 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-67afe6ac-b1d2-4cff-962c-82acb7099643 tempest-VolumesActionsTest-2124293081 None] Volume 8a6fe30e-3ecc-413c-9cef-84d9784845dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a6fe30e-3ecc-413c-9cef-84d9784845dc', 'volume_size': 1} Nov 06 15:26:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-67afe6ac-b1d2-4cff-962c-82acb7099643 tempest-VolumesActionsTest-2124293081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:26:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-67afe6ac-b1d2-4cff-962c-82acb7099643 tempest-VolumesActionsTest-2124293081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:26:42 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-67afe6ac-b1d2-4cff-962c-82acb7099643 tempest-VolumesActionsTest-2124293081 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:26:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1824183203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a6fe30e-3ecc-413c-9cef-84d9784845dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d0b6abc042242be823fc382d007712a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:26:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:26:42Z,use_quota=True,user_id='abff5ddd914544e7a269405c2ec272b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:26:42 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-67afe6ac-b1d2-4cff-962c-82acb7099643 tempest-VolumesActionsTest-2124293081 None] Creating volume 8a6fe30e-3ecc-413c-9cef-84d9784845dc {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:26:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-67afe6ac-b1d2-4cff-962c-82acb7099643 tempest-VolumesActionsTest-2124293081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:26:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-67afe6ac-b1d2-4cff-962c-82acb7099643 tempest-VolumesActionsTest-2124293081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:26:42 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-67afe6ac-b1d2-4cff-962c-82acb7099643 tempest-VolumesActionsTest-2124293081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:26:42 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-67afe6ac-b1d2-4cff-962c-82acb7099643 tempest-VolumesActionsTest-2124293081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:26:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-67afe6ac-b1d2-4cff-962c-82acb7099643 tempest-VolumesActionsTest-2124293081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:26:42 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-67afe6ac-b1d2-4cff-962c-82acb7099643 tempest-VolumesActionsTest-2124293081 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:26:42 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-67afe6ac-b1d2-4cff-962c-82acb7099643 tempest-VolumesActionsTest-2124293081 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:26:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-67afe6ac-b1d2-4cff-962c-82acb7099643 tempest-VolumesActionsTest-2124293081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-8a6fe30e-3ecc-413c-9cef-84d9784845dc 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:26:42 devstack sudo[96311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-8a6fe30e-3ecc-413c-9cef-84d9784845dc 1073741824 Nov 06 15:26:42 devstack sudo[96311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:26:42 devstack sudo[96311]: pam_unix(sudo:session): session closed for user root Nov 06 15:26:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-67afe6ac-b1d2-4cff-962c-82acb7099643 tempest-VolumesActionsTest-2124293081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-8a6fe30e-3ecc-413c-9cef-84d9784845dc 1073741824" returned: 0 in 0.456s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:26:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-67afe6ac-b1d2-4cff-962c-82acb7099643 tempest-VolumesActionsTest-2124293081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-8a6fe30e-3ecc-413c-9cef-84d9784845dc {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:26:42 devstack sudo[96317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-8a6fe30e-3ecc-413c-9cef-84d9784845dc Nov 06 15:26:42 devstack sudo[96317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:26:42 devstack sudo[96317]: pam_unix(sudo:session): session closed for user root Nov 06 15:26:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-67afe6ac-b1d2-4cff-962c-82acb7099643 tempest-VolumesActionsTest-2124293081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-8a6fe30e-3ecc-413c-9cef-84d9784845dc" returned: 0 in 0.263s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:26:42 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-67afe6ac-b1d2-4cff-962c-82acb7099643 tempest-VolumesActionsTest-2124293081 None] <== create_volume: return (767ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:26:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-67afe6ac-b1d2-4cff-962c-82acb7099643 tempest-VolumesActionsTest-2124293081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.770s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:26:42 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-67afe6ac-b1d2-4cff-962c-82acb7099643 tempest-VolumesActionsTest-2124293081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bbb4336-4dd2-4448-8820-940a0c451caa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a6fe30e-3ecc-413c-9cef-84d9784845dc', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:26:42 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-67afe6ac-b1d2-4cff-962c-82acb7099643 tempest-VolumesActionsTest-2124293081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14ae099a-97b0-4155-a768-cd3a0ca3f76f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:26:42 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-67afe6ac-b1d2-4cff-962c-82acb7099643 tempest-VolumesActionsTest-2124293081 None] Volume volume-8a6fe30e-3ecc-413c-9cef-84d9784845dc (8a6fe30e-3ecc-413c-9cef-84d9784845dc): created successfully Nov 06 15:26:42 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-67afe6ac-b1d2-4cff-962c-82acb7099643 tempest-VolumesActionsTest-2124293081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14ae099a-97b0-4155-a768-cd3a0ca3f76f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:26:42 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-67afe6ac-b1d2-4cff-962c-82acb7099643 tempest-VolumesActionsTest-2124293081 None] Flow 'volume_create_manager' (ec3eba6c-a988-45ad-b56f-b2f84bb673d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:26:42 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-67afe6ac-b1d2-4cff-962c-82acb7099643 tempest-VolumesActionsTest-2124293081 None] Created volume successfully. Nov 06 15:26:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-09ab5a21-014c-4b42-8c23-8c74d6fdf68c tempest-VolumesSnapshotListTestJSON-618257825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:26:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-09ab5a21-014c-4b42-8c23-8c74d6fdf68c tempest-VolumesSnapshotListTestJSON-618257825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:26:43 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-09ab5a21-014c-4b42-8c23-8c74d6fdf68c tempest-VolumesSnapshotListTestJSON-618257825 None] Creating offline snapshot 2d4f0e9f-ea0b-4870-b0b7-1a44dfa8ca81 of volume b1b5f306-9a27-4a2d-94c0-e25e1f9637a6 {{(pid=87132) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 15:26:43 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e36fa6a-430a-460f-8eb6-98b06e70f975]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:26:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-09ab5a21-014c-4b42-8c23-8c74d6fdf68c tempest-VolumesSnapshotListTestJSON-618257825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b1b5f306-9a27-4a2d-94c0-e25e1f9637a6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:26:43 devstack sudo[96321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b1b5f306-9a27-4a2d-94c0-e25e1f9637a6 Nov 06 15:26:43 devstack sudo[96321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:26:43 devstack sudo[96321]: pam_unix(sudo:session): session closed for user root Nov 06 15:26:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-09ab5a21-014c-4b42-8c23-8c74d6fdf68c tempest-VolumesSnapshotListTestJSON-618257825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b1b5f306-9a27-4a2d-94c0-e25e1f9637a6" returned: 0 in 0.423s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:26:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-09ab5a21-014c-4b42-8c23-8c74d6fdf68c tempest-VolumesSnapshotListTestJSON-618257825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b1b5f306-9a27-4a2d-94c0-e25e1f9637a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b1b5f306-9a27-4a2d-94c0-e25e1f9637a6.2d4f0e9f-ea0b-4870-b0b7-1a44dfa8ca81 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:26:43 devstack sudo[96326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b1b5f306-9a27-4a2d-94c0-e25e1f9637a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b1b5f306-9a27-4a2d-94c0-e25e1f9637a6.2d4f0e9f-ea0b-4870-b0b7-1a44dfa8ca81 1G Nov 06 15:26:43 devstack sudo[96326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:26:44 devstack sudo[96326]: pam_unix(sudo:session): session closed for user root Nov 06 15:26:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-09ab5a21-014c-4b42-8c23-8c74d6fdf68c tempest-VolumesSnapshotListTestJSON-618257825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b1b5f306-9a27-4a2d-94c0-e25e1f9637a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b1b5f306-9a27-4a2d-94c0-e25e1f9637a6.2d4f0e9f-ea0b-4870-b0b7-1a44dfa8ca81 1G" returned: 0 in 0.612s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:26:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-09ab5a21-014c-4b42-8c23-8c74d6fdf68c tempest-VolumesSnapshotListTestJSON-618257825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1b5f306-9a27-4a2d-94c0-e25e1f9637a6 -F qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b1b5f306-9a27-4a2d-94c0-e25e1f9637a6.2d4f0e9f-ea0b-4870-b0b7-1a44dfa8ca81 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:26:44 devstack sudo[96331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1b5f306-9a27-4a2d-94c0-e25e1f9637a6 -F qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b1b5f306-9a27-4a2d-94c0-e25e1f9637a6.2d4f0e9f-ea0b-4870-b0b7-1a44dfa8ca81 Nov 06 15:26:44 devstack sudo[96331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:26:44 devstack sudo[96331]: pam_unix(sudo:session): session closed for user root Nov 06 15:26:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-09ab5a21-014c-4b42-8c23-8c74d6fdf68c tempest-VolumesSnapshotListTestJSON-618257825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1b5f306-9a27-4a2d-94c0-e25e1f9637a6 -F qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b1b5f306-9a27-4a2d-94c0-e25e1f9637a6.2d4f0e9f-ea0b-4870-b0b7-1a44dfa8ca81" returned: 0 in 0.340s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:26:44 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-09ab5a21-014c-4b42-8c23-8c74d6fdf68c tempest-VolumesSnapshotListTestJSON-618257825 None] /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b1b5f306-9a27-4a2d-94c0-e25e1f9637a6.2d4f0e9f-ea0b-4870-b0b7-1a44dfa8ca81 is being set with open permissions: ugo+rw Nov 06 15:26:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-09ab5a21-014c-4b42-8c23-8c74d6fdf68c tempest-VolumesSnapshotListTestJSON-618257825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b1b5f306-9a27-4a2d-94c0-e25e1f9637a6.2d4f0e9f-ea0b-4870-b0b7-1a44dfa8ca81 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:26:44 devstack sudo[96336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b1b5f306-9a27-4a2d-94c0-e25e1f9637a6.2d4f0e9f-ea0b-4870-b0b7-1a44dfa8ca81 Nov 06 15:26:44 devstack sudo[96336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:26:44 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-2ac80025-fe28-4db4-9733-0517d52c4181 tempest-VolumesActionsTest-2124293081 None] Acquiring lock "cinder-8a6fe30e-3ecc-413c-9cef-84d9784845dc-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:26:44 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-2ac80025-fe28-4db4-9733-0517d52c4181 tempest-VolumesActionsTest-2124293081 None] Lock "cinder-8a6fe30e-3ecc-413c-9cef-84d9784845dc-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:26:44 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-2ac80025-fe28-4db4-9733-0517d52c4181 tempest-VolumesActionsTest-2124293081 None] Acquiring lock "cinder-quobyte-8a6fe30e-3ecc-413c-9cef-84d9784845dc" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:26:44 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-2ac80025-fe28-4db4-9733-0517d52c4181 tempest-VolumesActionsTest-2124293081 None] Lock "cinder-quobyte-8a6fe30e-3ecc-413c-9cef-84d9784845dc" acquired by "delete_volume" :: waited 0.036s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:26:45 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe5101e8-221b-4c35-828d-55f6a1f51041]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:26:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2ac80025-fe28-4db4-9733-0517d52c4181 tempest-VolumesActionsTest-2124293081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-8a6fe30e-3ecc-413c-9cef-84d9784845dc {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:26:45 devstack sudo[96336]: pam_unix(sudo:session): session closed for user root Nov 06 15:26:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-09ab5a21-014c-4b42-8c23-8c74d6fdf68c tempest-VolumesSnapshotListTestJSON-618257825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b1b5f306-9a27-4a2d-94c0-e25e1f9637a6.2d4f0e9f-ea0b-4870-b0b7-1a44dfa8ca81" returned: 0 in 0.335s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:26:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-09ab5a21-014c-4b42-8c23-8c74d6fdf68c tempest-VolumesSnapshotListTestJSON-618257825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b1b5f306-9a27-4a2d-94c0-e25e1f9637a6.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:26:45 devstack sudo[96341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b1b5f306-9a27-4a2d-94c0-e25e1f9637a6.info Nov 06 15:26:45 devstack sudo[96341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:26:45 devstack sudo[96340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-8a6fe30e-3ecc-413c-9cef-84d9784845dc Nov 06 15:26:45 devstack sudo[96340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:26:45 devstack sudo[96341]: pam_unix(sudo:session): session closed for user root Nov 06 15:26:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-09ab5a21-014c-4b42-8c23-8c74d6fdf68c tempest-VolumesSnapshotListTestJSON-618257825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b1b5f306-9a27-4a2d-94c0-e25e1f9637a6.info" returned: 0 in 0.368s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:26:45 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-09ab5a21-014c-4b42-8c23-8c74d6fdf68c tempest-VolumesSnapshotListTestJSON-618257825 None] /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b1b5f306-9a27-4a2d-94c0-e25e1f9637a6.info is being set with open permissions: ugo+rw Nov 06 15:26:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-09ab5a21-014c-4b42-8c23-8c74d6fdf68c tempest-VolumesSnapshotListTestJSON-618257825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b1b5f306-9a27-4a2d-94c0-e25e1f9637a6.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:26:45 devstack sudo[96347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b1b5f306-9a27-4a2d-94c0-e25e1f9637a6.info Nov 06 15:26:45 devstack sudo[96347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:26:45 devstack sudo[96340]: pam_unix(sudo:session): session closed for user root Nov 06 15:26:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2ac80025-fe28-4db4-9733-0517d52c4181 tempest-VolumesActionsTest-2124293081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-8a6fe30e-3ecc-413c-9cef-84d9784845dc" returned: 0 in 0.525s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:26:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2ac80025-fe28-4db4-9733-0517d52c4181 tempest-VolumesActionsTest-2124293081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-8a6fe30e-3ecc-413c-9cef-84d9784845dc {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:26:45 devstack sudo[96351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-8a6fe30e-3ecc-413c-9cef-84d9784845dc Nov 06 15:26:45 devstack sudo[96351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:26:45 devstack sudo[96347]: pam_unix(sudo:session): session closed for user root Nov 06 15:26:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-09ab5a21-014c-4b42-8c23-8c74d6fdf68c tempest-VolumesSnapshotListTestJSON-618257825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b1b5f306-9a27-4a2d-94c0-e25e1f9637a6.info" returned: 0 in 0.284s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:26:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-09ab5a21-014c-4b42-8c23-8c74d6fdf68c tempest-VolumesSnapshotListTestJSON-618257825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.477s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:26:45 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-09ab5a21-014c-4b42-8c23-8c74d6fdf68c tempest-VolumesSnapshotListTestJSON-618257825 None] Create snapshot completed successfully Nov 06 15:26:45 devstack sudo[96351]: pam_unix(sudo:session): session closed for user root Nov 06 15:26:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2ac80025-fe28-4db4-9733-0517d52c4181 tempest-VolumesActionsTest-2124293081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-8a6fe30e-3ecc-413c-9cef-84d9784845dc" returned: 0 in 0.287s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:26:45 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-2ac80025-fe28-4db4-9733-0517d52c4181 tempest-VolumesActionsTest-2124293081 None] Lock "cinder-quobyte-8a6fe30e-3ecc-413c-9cef-84d9784845dc" released by "delete_volume" :: held 0.866s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:26:45 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-2ac80025-fe28-4db4-9733-0517d52c4181 tempest-VolumesActionsTest-2124293081 None] Created reservations ['c153d266-569a-4138-b35b-062b5ec489cc', '4a858221-3e26-4ea1-9680-541a7f5de274', '33b981b5-d195-459f-81b5-039c35352b1b', '6fa06115-5e84-47f8-b4c3-27460c0b5c28'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:26:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-2ac80025-fe28-4db4-9733-0517d52c4181 tempest-VolumesActionsTest-2124293081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:26:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-2ac80025-fe28-4db4-9733-0517d52c4181 tempest-VolumesActionsTest-2124293081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:26:45 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-2ac80025-fe28-4db4-9733-0517d52c4181 tempest-VolumesActionsTest-2124293081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:26:45 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-2ac80025-fe28-4db4-9733-0517d52c4181 tempest-VolumesActionsTest-2124293081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:26:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-2ac80025-fe28-4db4-9733-0517d52c4181 tempest-VolumesActionsTest-2124293081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:26:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2ac80025-fe28-4db4-9733-0517d52c4181 tempest-VolumesActionsTest-2124293081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:26:45 devstack sudo[96355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:26:45 devstack sudo[96355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:26:46 devstack sudo[96355]: pam_unix(sudo:session): session closed for user root Nov 06 15:26:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2ac80025-fe28-4db4-9733-0517d52c4181 tempest-VolumesActionsTest-2124293081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.304s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:26:46 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-2ac80025-fe28-4db4-9733-0517d52c4181 tempest-VolumesActionsTest-2124293081 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:26:46 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-2ac80025-fe28-4db4-9733-0517d52c4181 tempest-VolumesActionsTest-2124293081 None] Deleted volume successfully. Nov 06 15:26:46 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-2ac80025-fe28-4db4-9733-0517d52c4181 tempest-VolumesActionsTest-2124293081 None] Lock "cinder-8a6fe30e-3ecc-413c-9cef-84d9784845dc-delete_volume" released by "delete_volume" :: held 1.401s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:26:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-93d7f6b7-6ba2-4235-b588-f03b424770ca tempest-VolumesSnapshotListTestJSON-618257825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:26:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-93d7f6b7-6ba2-4235-b588-f03b424770ca tempest-VolumesSnapshotListTestJSON-618257825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:26:46 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-93d7f6b7-6ba2-4235-b588-f03b424770ca tempest-VolumesSnapshotListTestJSON-618257825 None] Creating offline snapshot 2736f8a3-cf97-439a-b439-a0122f5cd075 of volume b1b5f306-9a27-4a2d-94c0-e25e1f9637a6 {{(pid=87132) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 15:26:46 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[100c8c5c-787f-4c44-89bd-a54be6e4ee54]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:26:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-93d7f6b7-6ba2-4235-b588-f03b424770ca tempest-VolumesSnapshotListTestJSON-618257825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b1b5f306-9a27-4a2d-94c0-e25e1f9637a6.2d4f0e9f-ea0b-4870-b0b7-1a44dfa8ca81 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:26:46 devstack sudo[96359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b1b5f306-9a27-4a2d-94c0-e25e1f9637a6.2d4f0e9f-ea0b-4870-b0b7-1a44dfa8ca81 Nov 06 15:26:46 devstack sudo[96359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:26:47 devstack sudo[96359]: pam_unix(sudo:session): session closed for user root Nov 06 15:26:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-93d7f6b7-6ba2-4235-b588-f03b424770ca tempest-VolumesSnapshotListTestJSON-618257825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b1b5f306-9a27-4a2d-94c0-e25e1f9637a6.2d4f0e9f-ea0b-4870-b0b7-1a44dfa8ca81" returned: 0 in 0.454s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:26:47 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-93d7f6b7-6ba2-4235-b588-f03b424770ca tempest-VolumesSnapshotListTestJSON-618257825 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b1b5f306-9a27-4a2d-94c0-e25e1f9637a6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 15:26:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-93d7f6b7-6ba2-4235-b588-f03b424770ca tempest-VolumesSnapshotListTestJSON-618257825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b1b5f306-9a27-4a2d-94c0-e25e1f9637a6.2d4f0e9f-ea0b-4870-b0b7-1a44dfa8ca81,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b1b5f306-9a27-4a2d-94c0-e25e1f9637a6.2736f8a3-cf97-439a-b439-a0122f5cd075 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:26:47 devstack sudo[96364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b1b5f306-9a27-4a2d-94c0-e25e1f9637a6.2d4f0e9f-ea0b-4870-b0b7-1a44dfa8ca81,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b1b5f306-9a27-4a2d-94c0-e25e1f9637a6.2736f8a3-cf97-439a-b439-a0122f5cd075 1G Nov 06 15:26:47 devstack sudo[96364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:26:47 devstack sudo[96364]: pam_unix(sudo:session): session closed for user root Nov 06 15:26:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-93d7f6b7-6ba2-4235-b588-f03b424770ca tempest-VolumesSnapshotListTestJSON-618257825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b1b5f306-9a27-4a2d-94c0-e25e1f9637a6.2d4f0e9f-ea0b-4870-b0b7-1a44dfa8ca81,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b1b5f306-9a27-4a2d-94c0-e25e1f9637a6.2736f8a3-cf97-439a-b439-a0122f5cd075 1G" returned: 0 in 0.547s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:26:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-93d7f6b7-6ba2-4235-b588-f03b424770ca tempest-VolumesSnapshotListTestJSON-618257825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1b5f306-9a27-4a2d-94c0-e25e1f9637a6.2d4f0e9f-ea0b-4870-b0b7-1a44dfa8ca81 -F qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b1b5f306-9a27-4a2d-94c0-e25e1f9637a6.2736f8a3-cf97-439a-b439-a0122f5cd075 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:26:47 devstack sudo[96371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1b5f306-9a27-4a2d-94c0-e25e1f9637a6.2d4f0e9f-ea0b-4870-b0b7-1a44dfa8ca81 -F qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b1b5f306-9a27-4a2d-94c0-e25e1f9637a6.2736f8a3-cf97-439a-b439-a0122f5cd075 Nov 06 15:26:47 devstack sudo[96371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:26:48 devstack sudo[96371]: pam_unix(sudo:session): session closed for user root Nov 06 15:26:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-93d7f6b7-6ba2-4235-b588-f03b424770ca tempest-VolumesSnapshotListTestJSON-618257825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1b5f306-9a27-4a2d-94c0-e25e1f9637a6.2d4f0e9f-ea0b-4870-b0b7-1a44dfa8ca81 -F qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b1b5f306-9a27-4a2d-94c0-e25e1f9637a6.2736f8a3-cf97-439a-b439-a0122f5cd075" returned: 0 in 0.335s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:26:48 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-93d7f6b7-6ba2-4235-b588-f03b424770ca tempest-VolumesSnapshotListTestJSON-618257825 None] /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b1b5f306-9a27-4a2d-94c0-e25e1f9637a6.2736f8a3-cf97-439a-b439-a0122f5cd075 is being set with open permissions: ugo+rw Nov 06 15:26:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-93d7f6b7-6ba2-4235-b588-f03b424770ca tempest-VolumesSnapshotListTestJSON-618257825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b1b5f306-9a27-4a2d-94c0-e25e1f9637a6.2736f8a3-cf97-439a-b439-a0122f5cd075 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:26:48 devstack sudo[96376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b1b5f306-9a27-4a2d-94c0-e25e1f9637a6.2736f8a3-cf97-439a-b439-a0122f5cd075 Nov 06 15:26:48 devstack sudo[96376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:26:48 devstack sudo[96376]: pam_unix(sudo:session): session closed for user root Nov 06 15:26:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-93d7f6b7-6ba2-4235-b588-f03b424770ca tempest-VolumesSnapshotListTestJSON-618257825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b1b5f306-9a27-4a2d-94c0-e25e1f9637a6.2736f8a3-cf97-439a-b439-a0122f5cd075" returned: 0 in 0.291s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:26:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-93d7f6b7-6ba2-4235-b588-f03b424770ca tempest-VolumesSnapshotListTestJSON-618257825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.751s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:26:48 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-93d7f6b7-6ba2-4235-b588-f03b424770ca tempest-VolumesSnapshotListTestJSON-618257825 None] Create snapshot completed successfully Nov 06 15:26:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b8b21ced-c3eb-421e-922f-280a5ed36bda tempest-VolumesSnapshotListTestJSON-618257825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:26:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b8b21ced-c3eb-421e-922f-280a5ed36bda tempest-VolumesSnapshotListTestJSON-618257825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:26:49 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-b8b21ced-c3eb-421e-922f-280a5ed36bda tempest-VolumesSnapshotListTestJSON-618257825 None] Creating offline snapshot fc5aa4dc-0dac-4d23-917e-9f879722ab72 of volume b1b5f306-9a27-4a2d-94c0-e25e1f9637a6 {{(pid=87132) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 15:26:49 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[05bad37c-3777-4139-b473-bf4ef344fbcc]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:26:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b8b21ced-c3eb-421e-922f-280a5ed36bda tempest-VolumesSnapshotListTestJSON-618257825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b1b5f306-9a27-4a2d-94c0-e25e1f9637a6.2736f8a3-cf97-439a-b439-a0122f5cd075 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:26:49 devstack sudo[96388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b1b5f306-9a27-4a2d-94c0-e25e1f9637a6.2736f8a3-cf97-439a-b439-a0122f5cd075 Nov 06 15:26:49 devstack sudo[96388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:26:49 devstack sudo[96388]: pam_unix(sudo:session): session closed for user root Nov 06 15:26:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b8b21ced-c3eb-421e-922f-280a5ed36bda tempest-VolumesSnapshotListTestJSON-618257825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b1b5f306-9a27-4a2d-94c0-e25e1f9637a6.2736f8a3-cf97-439a-b439-a0122f5cd075" returned: 0 in 0.505s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:26:49 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-b8b21ced-c3eb-421e-922f-280a5ed36bda tempest-VolumesSnapshotListTestJSON-618257825 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b1b5f306-9a27-4a2d-94c0-e25e1f9637a6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 15:26:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b8b21ced-c3eb-421e-922f-280a5ed36bda tempest-VolumesSnapshotListTestJSON-618257825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b1b5f306-9a27-4a2d-94c0-e25e1f9637a6.2736f8a3-cf97-439a-b439-a0122f5cd075,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b1b5f306-9a27-4a2d-94c0-e25e1f9637a6.fc5aa4dc-0dac-4d23-917e-9f879722ab72 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:26:49 devstack sudo[96396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b1b5f306-9a27-4a2d-94c0-e25e1f9637a6.2736f8a3-cf97-439a-b439-a0122f5cd075,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b1b5f306-9a27-4a2d-94c0-e25e1f9637a6.fc5aa4dc-0dac-4d23-917e-9f879722ab72 1G Nov 06 15:26:49 devstack sudo[96396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:26:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-f602a72e-a7ad-4e8a-bc2f-f7accd83706f req-1fce9455-6eab-4d9a-a8d8-cc62a0975587 tempest-TestStampPattern-2123587362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:26:50 devstack sudo[96396]: pam_unix(sudo:session): session closed for user root Nov 06 15:26:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b8b21ced-c3eb-421e-922f-280a5ed36bda tempest-VolumesSnapshotListTestJSON-618257825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b1b5f306-9a27-4a2d-94c0-e25e1f9637a6.2736f8a3-cf97-439a-b439-a0122f5cd075,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b1b5f306-9a27-4a2d-94c0-e25e1f9637a6.fc5aa4dc-0dac-4d23-917e-9f879722ab72 1G" returned: 0 in 0.635s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:26:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b8b21ced-c3eb-421e-922f-280a5ed36bda tempest-VolumesSnapshotListTestJSON-618257825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1b5f306-9a27-4a2d-94c0-e25e1f9637a6.2736f8a3-cf97-439a-b439-a0122f5cd075 -F qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b1b5f306-9a27-4a2d-94c0-e25e1f9637a6.fc5aa4dc-0dac-4d23-917e-9f879722ab72 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:26:50 devstack sudo[96408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1b5f306-9a27-4a2d-94c0-e25e1f9637a6.2736f8a3-cf97-439a-b439-a0122f5cd075 -F qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b1b5f306-9a27-4a2d-94c0-e25e1f9637a6.fc5aa4dc-0dac-4d23-917e-9f879722ab72 Nov 06 15:26:50 devstack sudo[96408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:26:50 devstack sudo[96408]: pam_unix(sudo:session): session closed for user root Nov 06 15:26:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b8b21ced-c3eb-421e-922f-280a5ed36bda tempest-VolumesSnapshotListTestJSON-618257825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1b5f306-9a27-4a2d-94c0-e25e1f9637a6.2736f8a3-cf97-439a-b439-a0122f5cd075 -F qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b1b5f306-9a27-4a2d-94c0-e25e1f9637a6.fc5aa4dc-0dac-4d23-917e-9f879722ab72" returned: 0 in 0.379s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:26:50 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-b8b21ced-c3eb-421e-922f-280a5ed36bda tempest-VolumesSnapshotListTestJSON-618257825 None] /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b1b5f306-9a27-4a2d-94c0-e25e1f9637a6.fc5aa4dc-0dac-4d23-917e-9f879722ab72 is being set with open permissions: ugo+rw Nov 06 15:26:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b8b21ced-c3eb-421e-922f-280a5ed36bda tempest-VolumesSnapshotListTestJSON-618257825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b1b5f306-9a27-4a2d-94c0-e25e1f9637a6.fc5aa4dc-0dac-4d23-917e-9f879722ab72 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:26:50 devstack sudo[96413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b1b5f306-9a27-4a2d-94c0-e25e1f9637a6.fc5aa4dc-0dac-4d23-917e-9f879722ab72 Nov 06 15:26:50 devstack sudo[96413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:26:50 devstack sudo[96413]: pam_unix(sudo:session): session closed for user root Nov 06 15:26:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b8b21ced-c3eb-421e-922f-280a5ed36bda tempest-VolumesSnapshotListTestJSON-618257825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b1b5f306-9a27-4a2d-94c0-e25e1f9637a6.fc5aa4dc-0dac-4d23-917e-9f879722ab72" returned: 0 in 0.267s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:26:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b8b21ced-c3eb-421e-922f-280a5ed36bda tempest-VolumesSnapshotListTestJSON-618257825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.931s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:26:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-f602a72e-a7ad-4e8a-bc2f-f7accd83706f req-1fce9455-6eab-4d9a-a8d8-cc62a0975587 tempest-TestStampPattern-2123587362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.987s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:26:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-f602a72e-a7ad-4e8a-bc2f-f7accd83706f req-1fce9455-6eab-4d9a-a8d8-cc62a0975587 tempest-TestStampPattern-2123587362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.028s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:26:51 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-b8b21ced-c3eb-421e-922f-280a5ed36bda tempest-VolumesSnapshotListTestJSON-618257825 None] Create snapshot completed successfully Nov 06 15:26:51 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-f602a72e-a7ad-4e8a-bc2f-f7accd83706f req-1fce9455-6eab-4d9a-a8d8-cc62a0975587 tempest-TestStampPattern-2123587362 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b', 'name': 'volume-70555739-c658-4506-9144-58189ae89625', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2a1f6df1-bb43-4d8c-9515-0ae94fa698b7', 'enforce_multipath': True} {{(pid=87132) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 15:26:51 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-f602a72e-a7ad-4e8a-bc2f-f7accd83706f req-1fce9455-6eab-4d9a-a8d8-cc62a0975587 tempest-TestStampPattern-2123587362 None] attachment_update completed successfully. Nov 06 15:26:52 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-43f01a69-d4d5-4880-901c-3d583d8e7292 tempest-VolumesSnapshotListTestJSON-618257825 None] Acquiring lock "cinder-fc5aa4dc-0dac-4d23-917e-9f879722ab72-delete_snapshot" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:26:52 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-43f01a69-d4d5-4880-901c-3d583d8e7292 tempest-VolumesSnapshotListTestJSON-618257825 None] Lock "cinder-fc5aa4dc-0dac-4d23-917e-9f879722ab72-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:26:52 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-43f01a69-d4d5-4880-901c-3d583d8e7292 tempest-VolumesSnapshotListTestJSON-618257825 None] Acquiring lock "cinder-quobyte-b1b5f306-9a27-4a2d-94c0-e25e1f9637a6" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:26:52 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-43f01a69-d4d5-4880-901c-3d583d8e7292 tempest-VolumesSnapshotListTestJSON-618257825 None] Lock "cinder-quobyte-b1b5f306-9a27-4a2d-94c0-e25e1f9637a6" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:26:52 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-43f01a69-d4d5-4880-901c-3d583d8e7292 tempest-VolumesSnapshotListTestJSON-618257825 None] Acquiring lock "cinder-quobyte-fc5aa4dc-0dac-4d23-917e-9f879722ab72" by "_delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:26:52 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-43f01a69-d4d5-4880-901c-3d583d8e7292 tempest-VolumesSnapshotListTestJSON-618257825 None] Lock "cinder-quobyte-fc5aa4dc-0dac-4d23-917e-9f879722ab72" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:26:52 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-43f01a69-d4d5-4880-901c-3d583d8e7292 tempest-VolumesSnapshotListTestJSON-618257825 None] Deleting offline snapshot fc5aa4dc-0dac-4d23-917e-9f879722ab72 of volume b1b5f306-9a27-4a2d-94c0-e25e1f9637a6 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 15:26:52 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-43f01a69-d4d5-4880-901c-3d583d8e7292 tempest-VolumesSnapshotListTestJSON-618257825 None] snapshot_file for this snap is: volume-b1b5f306-9a27-4a2d-94c0-e25e1f9637a6.fc5aa4dc-0dac-4d23-917e-9f879722ab72 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 15:26:52 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[37ae7419-89bf-4c43-9271-ff064304964c]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:26:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-43f01a69-d4d5-4880-901c-3d583d8e7292 tempest-VolumesSnapshotListTestJSON-618257825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b1b5f306-9a27-4a2d-94c0-e25e1f9637a6.fc5aa4dc-0dac-4d23-917e-9f879722ab72 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:26:52 devstack sudo[96834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b1b5f306-9a27-4a2d-94c0-e25e1f9637a6.fc5aa4dc-0dac-4d23-917e-9f879722ab72 Nov 06 15:26:52 devstack sudo[96834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:26:53 devstack sudo[96834]: pam_unix(sudo:session): session closed for user root Nov 06 15:26:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-43f01a69-d4d5-4880-901c-3d583d8e7292 tempest-VolumesSnapshotListTestJSON-618257825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b1b5f306-9a27-4a2d-94c0-e25e1f9637a6.fc5aa4dc-0dac-4d23-917e-9f879722ab72" returned: 0 in 0.413s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:26:53 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-43f01a69-d4d5-4880-901c-3d583d8e7292 tempest-VolumesSnapshotListTestJSON-618257825 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b1b5f306-9a27-4a2d-94c0-e25e1f9637a6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 15:26:53 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[95f82c11-f54a-4b24-a5ac-4c445aa22ce8]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:26:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-43f01a69-d4d5-4880-901c-3d583d8e7292 tempest-VolumesSnapshotListTestJSON-618257825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b1b5f306-9a27-4a2d-94c0-e25e1f9637a6.2736f8a3-cf97-439a-b439-a0122f5cd075 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:26:53 devstack sudo[96848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b1b5f306-9a27-4a2d-94c0-e25e1f9637a6.2736f8a3-cf97-439a-b439-a0122f5cd075 Nov 06 15:26:53 devstack sudo[96848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:26:53 devstack sudo[96848]: pam_unix(sudo:session): session closed for user root Nov 06 15:26:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-43f01a69-d4d5-4880-901c-3d583d8e7292 tempest-VolumesSnapshotListTestJSON-618257825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b1b5f306-9a27-4a2d-94c0-e25e1f9637a6.2736f8a3-cf97-439a-b439-a0122f5cd075" returned: 0 in 0.557s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:26:53 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-43f01a69-d4d5-4880-901c-3d583d8e7292 tempest-VolumesSnapshotListTestJSON-618257825 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b1b5f306-9a27-4a2d-94c0-e25e1f9637a6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 15:26:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-43f01a69-d4d5-4880-901c-3d583d8e7292 tempest-VolumesSnapshotListTestJSON-618257825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b1b5f306-9a27-4a2d-94c0-e25e1f9637a6.fc5aa4dc-0dac-4d23-917e-9f879722ab72 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:26:53 devstack sudo[96889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b1b5f306-9a27-4a2d-94c0-e25e1f9637a6.fc5aa4dc-0dac-4d23-917e-9f879722ab72 Nov 06 15:26:53 devstack sudo[96889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:26:54 devstack sudo[96889]: pam_unix(sudo:session): session closed for user root Nov 06 15:26:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-43f01a69-d4d5-4880-901c-3d583d8e7292 tempest-VolumesSnapshotListTestJSON-618257825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b1b5f306-9a27-4a2d-94c0-e25e1f9637a6.fc5aa4dc-0dac-4d23-917e-9f879722ab72" returned: 0 in 0.582s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:26:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-43f01a69-d4d5-4880-901c-3d583d8e7292 tempest-VolumesSnapshotListTestJSON-618257825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b1b5f306-9a27-4a2d-94c0-e25e1f9637a6.fc5aa4dc-0dac-4d23-917e-9f879722ab72 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:26:54 devstack sudo[96897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b1b5f306-9a27-4a2d-94c0-e25e1f9637a6.fc5aa4dc-0dac-4d23-917e-9f879722ab72 Nov 06 15:26:54 devstack sudo[96897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:26:54 devstack sudo[96897]: pam_unix(sudo:session): session closed for user root Nov 06 15:26:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-43f01a69-d4d5-4880-901c-3d583d8e7292 tempest-VolumesSnapshotListTestJSON-618257825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b1b5f306-9a27-4a2d-94c0-e25e1f9637a6.fc5aa4dc-0dac-4d23-917e-9f879722ab72" returned: 0 in 0.447s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:26:54 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-43f01a69-d4d5-4880-901c-3d583d8e7292 tempest-VolumesSnapshotListTestJSON-618257825 None] Lock "cinder-quobyte-fc5aa4dc-0dac-4d23-917e-9f879722ab72" released by "_delete_snapshot" :: held 2.158s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:26:54 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-43f01a69-d4d5-4880-901c-3d583d8e7292 tempest-VolumesSnapshotListTestJSON-618257825 None] Lock "cinder-quobyte-b1b5f306-9a27-4a2d-94c0-e25e1f9637a6" released by "delete_snapshot" :: held 2.186s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:26:55 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-43f01a69-d4d5-4880-901c-3d583d8e7292 tempest-VolumesSnapshotListTestJSON-618257825 None] Created reservations ['d0555fb8-5161-49d2-b390-7efe91741380', 'fd3abd88-760e-40d8-95d5-54a458f1c6e3', '27ef7826-ac16-4087-b6a2-868c4c36b03a', '0098692d-d576-4607-87a4-21800069c1cd'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:26:55 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-43f01a69-d4d5-4880-901c-3d583d8e7292 tempest-VolumesSnapshotListTestJSON-618257825 None] Delete snapshot completed successfully. Nov 06 15:26:55 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-43f01a69-d4d5-4880-901c-3d583d8e7292 tempest-VolumesSnapshotListTestJSON-618257825 None] Lock "cinder-fc5aa4dc-0dac-4d23-917e-9f879722ab72-delete_snapshot" released by "delete_snapshot" :: held 2.429s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:26:56 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e636d9f1-ed7f-4103-9daf-2643c3b6c129 tempest-VolumesSnapshotListTestJSON-618257825 None] Acquiring lock "cinder-2736f8a3-cf97-439a-b439-a0122f5cd075-delete_snapshot" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:26:56 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e636d9f1-ed7f-4103-9daf-2643c3b6c129 tempest-VolumesSnapshotListTestJSON-618257825 None] Lock "cinder-2736f8a3-cf97-439a-b439-a0122f5cd075-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:26:56 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e636d9f1-ed7f-4103-9daf-2643c3b6c129 tempest-VolumesSnapshotListTestJSON-618257825 None] Acquiring lock "cinder-quobyte-b1b5f306-9a27-4a2d-94c0-e25e1f9637a6" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:26:56 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e636d9f1-ed7f-4103-9daf-2643c3b6c129 tempest-VolumesSnapshotListTestJSON-618257825 None] Lock "cinder-quobyte-b1b5f306-9a27-4a2d-94c0-e25e1f9637a6" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:26:56 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e636d9f1-ed7f-4103-9daf-2643c3b6c129 tempest-VolumesSnapshotListTestJSON-618257825 None] Acquiring lock "cinder-quobyte-2736f8a3-cf97-439a-b439-a0122f5cd075" by "_delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:26:56 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e636d9f1-ed7f-4103-9daf-2643c3b6c129 tempest-VolumesSnapshotListTestJSON-618257825 None] Lock "cinder-quobyte-2736f8a3-cf97-439a-b439-a0122f5cd075" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:26:56 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-e636d9f1-ed7f-4103-9daf-2643c3b6c129 tempest-VolumesSnapshotListTestJSON-618257825 None] Deleting offline snapshot 2736f8a3-cf97-439a-b439-a0122f5cd075 of volume b1b5f306-9a27-4a2d-94c0-e25e1f9637a6 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 15:26:56 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-e636d9f1-ed7f-4103-9daf-2643c3b6c129 tempest-VolumesSnapshotListTestJSON-618257825 None] snapshot_file for this snap is: volume-b1b5f306-9a27-4a2d-94c0-e25e1f9637a6.2736f8a3-cf97-439a-b439-a0122f5cd075 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 15:26:56 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6b2ab3f-01bf-40f7-9772-e3509de2a400]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:26:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e636d9f1-ed7f-4103-9daf-2643c3b6c129 tempest-VolumesSnapshotListTestJSON-618257825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b1b5f306-9a27-4a2d-94c0-e25e1f9637a6.2736f8a3-cf97-439a-b439-a0122f5cd075 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:26:56 devstack sudo[96914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b1b5f306-9a27-4a2d-94c0-e25e1f9637a6.2736f8a3-cf97-439a-b439-a0122f5cd075 Nov 06 15:26:56 devstack sudo[96914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:26:56 devstack sudo[96914]: pam_unix(sudo:session): session closed for user root Nov 06 15:26:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e636d9f1-ed7f-4103-9daf-2643c3b6c129 tempest-VolumesSnapshotListTestJSON-618257825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b1b5f306-9a27-4a2d-94c0-e25e1f9637a6.2736f8a3-cf97-439a-b439-a0122f5cd075" returned: 0 in 0.515s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:26:56 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-e636d9f1-ed7f-4103-9daf-2643c3b6c129 tempest-VolumesSnapshotListTestJSON-618257825 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b1b5f306-9a27-4a2d-94c0-e25e1f9637a6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 15:26:56 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e4c5b01-ecd9-4643-bf4e-fb6d9b3a3236]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:26:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e636d9f1-ed7f-4103-9daf-2643c3b6c129 tempest-VolumesSnapshotListTestJSON-618257825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b1b5f306-9a27-4a2d-94c0-e25e1f9637a6.2d4f0e9f-ea0b-4870-b0b7-1a44dfa8ca81 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:26:56 devstack sudo[96920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b1b5f306-9a27-4a2d-94c0-e25e1f9637a6.2d4f0e9f-ea0b-4870-b0b7-1a44dfa8ca81 Nov 06 15:26:56 devstack sudo[96920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:26:57 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-c464d579-adb0-4e98-9f13-d86f2919688e req-674a9034-fa35-4b23-819b-e968d02d9333 tempest-TestStampPattern-2123587362 None] Terminate volume connection completed successfully. Nov 06 15:26:57 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-c464d579-adb0-4e98-9f13-d86f2919688e req-674a9034-fa35-4b23-819b-e968d02d9333 tempest-TestStampPattern-2123587362 None] Deleting attachment 2a1f6df1-bb43-4d8c-9515-0ae94fa698b7. {{(pid=87132) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 06 15:26:57 devstack sudo[96920]: pam_unix(sudo:session): session closed for user root Nov 06 15:26:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e636d9f1-ed7f-4103-9daf-2643c3b6c129 tempest-VolumesSnapshotListTestJSON-618257825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b1b5f306-9a27-4a2d-94c0-e25e1f9637a6.2d4f0e9f-ea0b-4870-b0b7-1a44dfa8ca81" returned: 0 in 0.509s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:26:57 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-e636d9f1-ed7f-4103-9daf-2643c3b6c129 tempest-VolumesSnapshotListTestJSON-618257825 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b1b5f306-9a27-4a2d-94c0-e25e1f9637a6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 15:26:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e636d9f1-ed7f-4103-9daf-2643c3b6c129 tempest-VolumesSnapshotListTestJSON-618257825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b1b5f306-9a27-4a2d-94c0-e25e1f9637a6.2736f8a3-cf97-439a-b439-a0122f5cd075 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:26:57 devstack sudo[96955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b1b5f306-9a27-4a2d-94c0-e25e1f9637a6.2736f8a3-cf97-439a-b439-a0122f5cd075 Nov 06 15:26:57 devstack sudo[96955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:26:57 devstack sudo[96955]: pam_unix(sudo:session): session closed for user root Nov 06 15:26:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e636d9f1-ed7f-4103-9daf-2643c3b6c129 tempest-VolumesSnapshotListTestJSON-618257825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b1b5f306-9a27-4a2d-94c0-e25e1f9637a6.2736f8a3-cf97-439a-b439-a0122f5cd075" returned: 0 in 0.576s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:26:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e636d9f1-ed7f-4103-9daf-2643c3b6c129 tempest-VolumesSnapshotListTestJSON-618257825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b1b5f306-9a27-4a2d-94c0-e25e1f9637a6.2736f8a3-cf97-439a-b439-a0122f5cd075 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:26:57 devstack sudo[96963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b1b5f306-9a27-4a2d-94c0-e25e1f9637a6.2736f8a3-cf97-439a-b439-a0122f5cd075 Nov 06 15:26:57 devstack sudo[96963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:26:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a8434f37-dd94-4f59-b9ac-5139c82c6e5a tempest-TestStampPattern-2123587362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:26:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a8434f37-dd94-4f59-b9ac-5139c82c6e5a tempest-TestStampPattern-2123587362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:26:58 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-a8434f37-dd94-4f59-b9ac-5139c82c6e5a tempest-TestStampPattern-2123587362 None] Creating offline snapshot 7470e204-ea7f-415a-a8a0-931912e52b0e of volume 70555739-c658-4506-9144-58189ae89625 {{(pid=87132) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 15:26:58 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[c948be1b-5e66-43c6-b539-64d0c670c8c2]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:26:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a8434f37-dd94-4f59-b9ac-5139c82c6e5a tempest-TestStampPattern-2123587362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-70555739-c658-4506-9144-58189ae89625 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:26:58 devstack sudo[96963]: pam_unix(sudo:session): session closed for user root Nov 06 15:26:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e636d9f1-ed7f-4103-9daf-2643c3b6c129 tempest-VolumesSnapshotListTestJSON-618257825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b1b5f306-9a27-4a2d-94c0-e25e1f9637a6.2736f8a3-cf97-439a-b439-a0122f5cd075" returned: 0 in 0.441s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:26:58 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e636d9f1-ed7f-4103-9daf-2643c3b6c129 tempest-VolumesSnapshotListTestJSON-618257825 None] Lock "cinder-quobyte-2736f8a3-cf97-439a-b439-a0122f5cd075" released by "_delete_snapshot" :: held 2.184s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:26:58 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e636d9f1-ed7f-4103-9daf-2643c3b6c129 tempest-VolumesSnapshotListTestJSON-618257825 None] Lock "cinder-quobyte-b1b5f306-9a27-4a2d-94c0-e25e1f9637a6" released by "delete_snapshot" :: held 2.216s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:26:58 devstack sudo[96966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-70555739-c658-4506-9144-58189ae89625 Nov 06 15:26:58 devstack sudo[96966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:26:58 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-e636d9f1-ed7f-4103-9daf-2643c3b6c129 tempest-VolumesSnapshotListTestJSON-618257825 None] Created reservations ['660c7eb9-736b-41a7-a78f-e6f7bb304960', '1307fea2-d2a1-402d-9538-3a391c58be7f', '99e62c96-a069-47a2-a8a1-74e04f984a58', 'f063d3fc-705e-433a-9ad7-c85104d5edfb'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:26:58 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-e636d9f1-ed7f-4103-9daf-2643c3b6c129 tempest-VolumesSnapshotListTestJSON-618257825 None] Delete snapshot completed successfully. Nov 06 15:26:58 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e636d9f1-ed7f-4103-9daf-2643c3b6c129 tempest-VolumesSnapshotListTestJSON-618257825 None] Lock "cinder-2736f8a3-cf97-439a-b439-a0122f5cd075-delete_snapshot" released by "delete_snapshot" :: held 2.411s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:26:58 devstack sudo[96966]: pam_unix(sudo:session): session closed for user root Nov 06 15:26:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a8434f37-dd94-4f59-b9ac-5139c82c6e5a tempest-TestStampPattern-2123587362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-70555739-c658-4506-9144-58189ae89625" returned: 0 in 0.456s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:26:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a8434f37-dd94-4f59-b9ac-5139c82c6e5a tempest-TestStampPattern-2123587362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-70555739-c658-4506-9144-58189ae89625,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-70555739-c658-4506-9144-58189ae89625.7470e204-ea7f-415a-a8a0-931912e52b0e 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:26:58 devstack sudo[96971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-70555739-c658-4506-9144-58189ae89625,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-70555739-c658-4506-9144-58189ae89625.7470e204-ea7f-415a-a8a0-931912e52b0e 1G Nov 06 15:26:58 devstack sudo[96971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:26:59 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-302470d6-a680-4f5b-93de-b2ea0194cd82 tempest-VolumesSnapshotListTestJSON-618257825 None] Acquiring lock "cinder-2d4f0e9f-ea0b-4870-b0b7-1a44dfa8ca81-delete_snapshot" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:26:59 devstack sudo[96971]: pam_unix(sudo:session): session closed for user root Nov 06 15:26:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a8434f37-dd94-4f59-b9ac-5139c82c6e5a tempest-TestStampPattern-2123587362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-70555739-c658-4506-9144-58189ae89625,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-70555739-c658-4506-9144-58189ae89625.7470e204-ea7f-415a-a8a0-931912e52b0e 1G" returned: 0 in 0.655s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:26:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a8434f37-dd94-4f59-b9ac-5139c82c6e5a tempest-TestStampPattern-2123587362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70555739-c658-4506-9144-58189ae89625 -F qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-70555739-c658-4506-9144-58189ae89625.7470e204-ea7f-415a-a8a0-931912e52b0e {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:26:59 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-302470d6-a680-4f5b-93de-b2ea0194cd82 tempest-VolumesSnapshotListTestJSON-618257825 None] Lock "cinder-2d4f0e9f-ea0b-4870-b0b7-1a44dfa8ca81-delete_snapshot" acquired by "delete_snapshot" :: waited 0.051s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:26:59 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-302470d6-a680-4f5b-93de-b2ea0194cd82 tempest-VolumesSnapshotListTestJSON-618257825 None] Acquiring lock "cinder-quobyte-b1b5f306-9a27-4a2d-94c0-e25e1f9637a6" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:26:59 devstack sudo[96977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70555739-c658-4506-9144-58189ae89625 -F qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-70555739-c658-4506-9144-58189ae89625.7470e204-ea7f-415a-a8a0-931912e52b0e Nov 06 15:26:59 devstack sudo[96977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:26:59 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-302470d6-a680-4f5b-93de-b2ea0194cd82 tempest-VolumesSnapshotListTestJSON-618257825 None] Lock "cinder-quobyte-b1b5f306-9a27-4a2d-94c0-e25e1f9637a6" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:26:59 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-302470d6-a680-4f5b-93de-b2ea0194cd82 tempest-VolumesSnapshotListTestJSON-618257825 None] Acquiring lock "cinder-quobyte-2d4f0e9f-ea0b-4870-b0b7-1a44dfa8ca81" by "_delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:26:59 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-302470d6-a680-4f5b-93de-b2ea0194cd82 tempest-VolumesSnapshotListTestJSON-618257825 None] Lock "cinder-quobyte-2d4f0e9f-ea0b-4870-b0b7-1a44dfa8ca81" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:26:59 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-302470d6-a680-4f5b-93de-b2ea0194cd82 tempest-VolumesSnapshotListTestJSON-618257825 None] Deleting offline snapshot 2d4f0e9f-ea0b-4870-b0b7-1a44dfa8ca81 of volume b1b5f306-9a27-4a2d-94c0-e25e1f9637a6 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 15:26:59 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-302470d6-a680-4f5b-93de-b2ea0194cd82 tempest-VolumesSnapshotListTestJSON-618257825 None] snapshot_file for this snap is: volume-b1b5f306-9a27-4a2d-94c0-e25e1f9637a6.2d4f0e9f-ea0b-4870-b0b7-1a44dfa8ca81 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 15:26:59 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[b180141d-22dd-4f78-ac40-e6381d39f8ad]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:26:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-302470d6-a680-4f5b-93de-b2ea0194cd82 tempest-VolumesSnapshotListTestJSON-618257825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b1b5f306-9a27-4a2d-94c0-e25e1f9637a6.2d4f0e9f-ea0b-4870-b0b7-1a44dfa8ca81 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:26:59 devstack sudo[96979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b1b5f306-9a27-4a2d-94c0-e25e1f9637a6.2d4f0e9f-ea0b-4870-b0b7-1a44dfa8ca81 Nov 06 15:26:59 devstack sudo[96979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:26:59 devstack sudo[96977]: pam_unix(sudo:session): session closed for user root Nov 06 15:26:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a8434f37-dd94-4f59-b9ac-5139c82c6e5a tempest-TestStampPattern-2123587362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70555739-c658-4506-9144-58189ae89625 -F qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-70555739-c658-4506-9144-58189ae89625.7470e204-ea7f-415a-a8a0-931912e52b0e" returned: 0 in 0.556s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:26:59 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-a8434f37-dd94-4f59-b9ac-5139c82c6e5a tempest-TestStampPattern-2123587362 None] /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-70555739-c658-4506-9144-58189ae89625.7470e204-ea7f-415a-a8a0-931912e52b0e is being set with open permissions: ugo+rw Nov 06 15:26:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a8434f37-dd94-4f59-b9ac-5139c82c6e5a tempest-TestStampPattern-2123587362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-70555739-c658-4506-9144-58189ae89625.7470e204-ea7f-415a-a8a0-931912e52b0e {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:26:59 devstack sudo[96988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-70555739-c658-4506-9144-58189ae89625.7470e204-ea7f-415a-a8a0-931912e52b0e Nov 06 15:26:59 devstack sudo[96988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:27:00 devstack sudo[96979]: pam_unix(sudo:session): session closed for user root Nov 06 15:27:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-302470d6-a680-4f5b-93de-b2ea0194cd82 tempest-VolumesSnapshotListTestJSON-618257825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b1b5f306-9a27-4a2d-94c0-e25e1f9637a6.2d4f0e9f-ea0b-4870-b0b7-1a44dfa8ca81" returned: 0 in 0.573s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:27:00 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-302470d6-a680-4f5b-93de-b2ea0194cd82 tempest-VolumesSnapshotListTestJSON-618257825 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b1b5f306-9a27-4a2d-94c0-e25e1f9637a6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 15:27:00 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[3da3e44b-e225-46ca-aea8-51205e9b9847]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:27:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-302470d6-a680-4f5b-93de-b2ea0194cd82 tempest-VolumesSnapshotListTestJSON-618257825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b1b5f306-9a27-4a2d-94c0-e25e1f9637a6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:27:00 devstack sudo[96988]: pam_unix(sudo:session): session closed for user root Nov 06 15:27:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a8434f37-dd94-4f59-b9ac-5139c82c6e5a tempest-TestStampPattern-2123587362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-70555739-c658-4506-9144-58189ae89625.7470e204-ea7f-415a-a8a0-931912e52b0e" returned: 0 in 0.384s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:27:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a8434f37-dd94-4f59-b9ac-5139c82c6e5a tempest-TestStampPattern-2123587362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-70555739-c658-4506-9144-58189ae89625.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:27:00 devstack sudo[96996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b1b5f306-9a27-4a2d-94c0-e25e1f9637a6 Nov 06 15:27:00 devstack sudo[96996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:27:00 devstack sudo[97001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-70555739-c658-4506-9144-58189ae89625.info Nov 06 15:27:00 devstack sudo[97001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:27:00 devstack sudo[97001]: pam_unix(sudo:session): session closed for user root Nov 06 15:27:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a8434f37-dd94-4f59-b9ac-5139c82c6e5a tempest-TestStampPattern-2123587362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-70555739-c658-4506-9144-58189ae89625.info" returned: 0 in 0.435s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:27:00 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-a8434f37-dd94-4f59-b9ac-5139c82c6e5a tempest-TestStampPattern-2123587362 None] /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-70555739-c658-4506-9144-58189ae89625.info is being set with open permissions: ugo+rw Nov 06 15:27:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a8434f37-dd94-4f59-b9ac-5139c82c6e5a tempest-TestStampPattern-2123587362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-70555739-c658-4506-9144-58189ae89625.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:27:00 devstack sudo[96996]: pam_unix(sudo:session): session closed for user root Nov 06 15:27:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-302470d6-a680-4f5b-93de-b2ea0194cd82 tempest-VolumesSnapshotListTestJSON-618257825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b1b5f306-9a27-4a2d-94c0-e25e1f9637a6" returned: 0 in 0.677s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:27:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-302470d6-a680-4f5b-93de-b2ea0194cd82 tempest-VolumesSnapshotListTestJSON-618257825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b1b5f306-9a27-4a2d-94c0-e25e1f9637a6.2d4f0e9f-ea0b-4870-b0b7-1a44dfa8ca81 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:27:00 devstack sudo[97007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-70555739-c658-4506-9144-58189ae89625.info Nov 06 15:27:00 devstack sudo[97007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:27:00 devstack sudo[97009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b1b5f306-9a27-4a2d-94c0-e25e1f9637a6.2d4f0e9f-ea0b-4870-b0b7-1a44dfa8ca81 Nov 06 15:27:00 devstack sudo[97009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:27:01 devstack sudo[97007]: pam_unix(sudo:session): session closed for user root Nov 06 15:27:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a8434f37-dd94-4f59-b9ac-5139c82c6e5a tempest-TestStampPattern-2123587362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-70555739-c658-4506-9144-58189ae89625.info" returned: 0 in 0.533s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:27:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a8434f37-dd94-4f59-b9ac-5139c82c6e5a tempest-TestStampPattern-2123587362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.185s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:27:01 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-a8434f37-dd94-4f59-b9ac-5139c82c6e5a tempest-TestStampPattern-2123587362 None] Create snapshot completed successfully Nov 06 15:27:01 devstack sudo[97009]: pam_unix(sudo:session): session closed for user root Nov 06 15:27:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-302470d6-a680-4f5b-93de-b2ea0194cd82 tempest-VolumesSnapshotListTestJSON-618257825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b1b5f306-9a27-4a2d-94c0-e25e1f9637a6.2d4f0e9f-ea0b-4870-b0b7-1a44dfa8ca81" returned: 0 in 0.665s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:27:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-302470d6-a680-4f5b-93de-b2ea0194cd82 tempest-VolumesSnapshotListTestJSON-618257825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b1b5f306-9a27-4a2d-94c0-e25e1f9637a6.2d4f0e9f-ea0b-4870-b0b7-1a44dfa8ca81 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:27:01 devstack sudo[97016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b1b5f306-9a27-4a2d-94c0-e25e1f9637a6.2d4f0e9f-ea0b-4870-b0b7-1a44dfa8ca81 Nov 06 15:27:01 devstack sudo[97016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:27:01 devstack sudo[97016]: pam_unix(sudo:session): session closed for user root Nov 06 15:27:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-302470d6-a680-4f5b-93de-b2ea0194cd82 tempest-VolumesSnapshotListTestJSON-618257825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b1b5f306-9a27-4a2d-94c0-e25e1f9637a6.2d4f0e9f-ea0b-4870-b0b7-1a44dfa8ca81" returned: 0 in 0.271s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:27:01 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-302470d6-a680-4f5b-93de-b2ea0194cd82 tempest-VolumesSnapshotListTestJSON-618257825 None] Lock "cinder-quobyte-2d4f0e9f-ea0b-4870-b0b7-1a44dfa8ca81" released by "_delete_snapshot" :: held 2.392s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:27:01 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-302470d6-a680-4f5b-93de-b2ea0194cd82 tempest-VolumesSnapshotListTestJSON-618257825 None] Lock "cinder-quobyte-b1b5f306-9a27-4a2d-94c0-e25e1f9637a6" released by "delete_snapshot" :: held 2.425s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:27:01 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-302470d6-a680-4f5b-93de-b2ea0194cd82 tempest-VolumesSnapshotListTestJSON-618257825 None] Created reservations ['4c5a1771-59a8-416b-9528-a78cc93f1df6', '3251c392-5921-4767-b811-6a1846cbc96c', '17456aa2-3933-4cbb-92fb-ecf8e2fb1e01', '489e6bd5-34b7-43fb-a7d2-3ed61e0e95aa'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:27:01 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-302470d6-a680-4f5b-93de-b2ea0194cd82 tempest-VolumesSnapshotListTestJSON-618257825 None] Delete snapshot completed successfully. Nov 06 15:27:01 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-302470d6-a680-4f5b-93de-b2ea0194cd82 tempest-VolumesSnapshotListTestJSON-618257825 None] Lock "cinder-2d4f0e9f-ea0b-4870-b0b7-1a44dfa8ca81-delete_snapshot" released by "delete_snapshot" :: held 2.614s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:27:02 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-66412509-cbb7-4966-b44a-aa8fefb4be18 tempest-VolumesSnapshotListTestJSON-618257825 None] Acquiring lock "cinder-b1b5f306-9a27-4a2d-94c0-e25e1f9637a6-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:27:02 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-66412509-cbb7-4966-b44a-aa8fefb4be18 tempest-VolumesSnapshotListTestJSON-618257825 None] Lock "cinder-b1b5f306-9a27-4a2d-94c0-e25e1f9637a6-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:27:02 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-66412509-cbb7-4966-b44a-aa8fefb4be18 tempest-VolumesSnapshotListTestJSON-618257825 None] Acquiring lock "cinder-quobyte-b1b5f306-9a27-4a2d-94c0-e25e1f9637a6" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:27:02 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-66412509-cbb7-4966-b44a-aa8fefb4be18 tempest-VolumesSnapshotListTestJSON-618257825 None] Lock "cinder-quobyte-b1b5f306-9a27-4a2d-94c0-e25e1f9637a6" acquired by "delete_volume" :: waited 0.018s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:27:02 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4087655-a04f-458b-886a-9c71f9d75816]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:27:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-66412509-cbb7-4966-b44a-aa8fefb4be18 tempest-VolumesSnapshotListTestJSON-618257825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b1b5f306-9a27-4a2d-94c0-e25e1f9637a6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:27:02 devstack sudo[97019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b1b5f306-9a27-4a2d-94c0-e25e1f9637a6 Nov 06 15:27:02 devstack sudo[97019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:27:03 devstack sudo[97019]: pam_unix(sudo:session): session closed for user root Nov 06 15:27:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-66412509-cbb7-4966-b44a-aa8fefb4be18 tempest-VolumesSnapshotListTestJSON-618257825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b1b5f306-9a27-4a2d-94c0-e25e1f9637a6" returned: 0 in 0.512s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:27:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-66412509-cbb7-4966-b44a-aa8fefb4be18 tempest-VolumesSnapshotListTestJSON-618257825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b1b5f306-9a27-4a2d-94c0-e25e1f9637a6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:27:03 devstack sudo[97024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b1b5f306-9a27-4a2d-94c0-e25e1f9637a6 Nov 06 15:27:03 devstack sudo[97024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:27:03 devstack sudo[97024]: pam_unix(sudo:session): session closed for user root Nov 06 15:27:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-66412509-cbb7-4966-b44a-aa8fefb4be18 tempest-VolumesSnapshotListTestJSON-618257825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b1b5f306-9a27-4a2d-94c0-e25e1f9637a6" returned: 0 in 0.364s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:27:03 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-66412509-cbb7-4966-b44a-aa8fefb4be18 tempest-VolumesSnapshotListTestJSON-618257825 None] Lock "cinder-quobyte-b1b5f306-9a27-4a2d-94c0-e25e1f9637a6" released by "delete_volume" :: held 0.964s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:27:03 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-66412509-cbb7-4966-b44a-aa8fefb4be18 tempest-VolumesSnapshotListTestJSON-618257825 None] Created reservations ['959087c6-d049-484e-8b23-c07bce34ac2b', '99ebb9a2-4cb4-4f21-b465-9e2d943027b6', '3aabe098-6c83-4f2d-a032-51255bf5f17a', '656c5ff8-5d71-41c1-81c6-504d20d1306e'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:27:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-66412509-cbb7-4966-b44a-aa8fefb4be18 tempest-VolumesSnapshotListTestJSON-618257825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:27:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-66412509-cbb7-4966-b44a-aa8fefb4be18 tempest-VolumesSnapshotListTestJSON-618257825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:27:03 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-66412509-cbb7-4966-b44a-aa8fefb4be18 tempest-VolumesSnapshotListTestJSON-618257825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:27:03 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-66412509-cbb7-4966-b44a-aa8fefb4be18 tempest-VolumesSnapshotListTestJSON-618257825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:27:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-66412509-cbb7-4966-b44a-aa8fefb4be18 tempest-VolumesSnapshotListTestJSON-618257825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:27:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-66412509-cbb7-4966-b44a-aa8fefb4be18 tempest-VolumesSnapshotListTestJSON-618257825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:27:03 devstack sudo[97028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:27:03 devstack sudo[97028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:27:04 devstack sudo[97028]: pam_unix(sudo:session): session closed for user root Nov 06 15:27:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-66412509-cbb7-4966-b44a-aa8fefb4be18 tempest-VolumesSnapshotListTestJSON-618257825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.369s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:27:04 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-66412509-cbb7-4966-b44a-aa8fefb4be18 tempest-VolumesSnapshotListTestJSON-618257825 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:27:04 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-66412509-cbb7-4966-b44a-aa8fefb4be18 tempest-VolumesSnapshotListTestJSON-618257825 None] Deleted volume successfully. Nov 06 15:27:04 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-66412509-cbb7-4966-b44a-aa8fefb4be18 tempest-VolumesSnapshotListTestJSON-618257825 None] Lock "cinder-b1b5f306-9a27-4a2d-94c0-e25e1f9637a6-delete_volume" released by "delete_volume" :: held 1.652s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:27:07 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a033e05-a1f3-4837-a63d-f22838bc1aa7 tempest-VolumesListAdminTestJSON-589565954 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:27:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9a033e05-a1f3-4837-a63d-f22838bc1aa7 tempest-VolumesListAdminTestJSON-589565954 None] Flow 'volume_create_manager' (d46ce230-7d3b-4236-ba08-84afbbca9239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:27:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9a033e05-a1f3-4837-a63d-f22838bc1aa7 tempest-VolumesListAdminTestJSON-589565954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6def7dee-8421-42f3-a669-fd8cbc75c747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:27:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9a033e05-a1f3-4837-a63d-f22838bc1aa7 tempest-VolumesListAdminTestJSON-589565954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6def7dee-8421-42f3-a669-fd8cbc75c747) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:27:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-157664605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8012df8c-6935-459e-a325-5f9962c2a8d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1f81304889f4097be095ebf6bddbd34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:27:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:27:08Z,use_quota=True,user_id='bfdec49fc2e2461eb7829e910d88333a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:27:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9a033e05-a1f3-4837-a63d-f22838bc1aa7 tempest-VolumesListAdminTestJSON-589565954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93a54db4-5595-459c-973a-738996ff3ce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:27:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9a033e05-a1f3-4837-a63d-f22838bc1aa7 tempest-VolumesListAdminTestJSON-589565954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93a54db4-5595-459c-973a-738996ff3ce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:27:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9a033e05-a1f3-4837-a63d-f22838bc1aa7 tempest-VolumesListAdminTestJSON-589565954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca0e0187-cfd1-466e-9965-52e422cb76ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:27:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9a033e05-a1f3-4837-a63d-f22838bc1aa7 tempest-VolumesListAdminTestJSON-589565954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca0e0187-cfd1-466e-9965-52e422cb76ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8012df8c-6935-459e-a325-5f9962c2a8d4', 'volume_name': 'volume-8012df8c-6935-459e-a325-5f9962c2a8d4', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:27:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9a033e05-a1f3-4837-a63d-f22838bc1aa7 tempest-VolumesListAdminTestJSON-589565954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (044aeeb0-e55a-4c7c-ab25-9f4b90e4ba71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:27:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9a033e05-a1f3-4837-a63d-f22838bc1aa7 tempest-VolumesListAdminTestJSON-589565954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (044aeeb0-e55a-4c7c-ab25-9f4b90e4ba71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:27:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9a033e05-a1f3-4837-a63d-f22838bc1aa7 tempest-VolumesListAdminTestJSON-589565954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1740d07e-4227-459d-9759-6b980d2a1576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:27:07 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-9a033e05-a1f3-4837-a63d-f22838bc1aa7 tempest-VolumesListAdminTestJSON-589565954 None] Volume 8012df8c-6935-459e-a325-5f9962c2a8d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8012df8c-6935-459e-a325-5f9962c2a8d4', 'volume_size': 1} Nov 06 15:27:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9a033e05-a1f3-4837-a63d-f22838bc1aa7 tempest-VolumesListAdminTestJSON-589565954 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:27:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9a033e05-a1f3-4837-a63d-f22838bc1aa7 tempest-VolumesListAdminTestJSON-589565954 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:27:07 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-9a033e05-a1f3-4837-a63d-f22838bc1aa7 tempest-VolumesListAdminTestJSON-589565954 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:27:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-157664605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8012df8c-6935-459e-a325-5f9962c2a8d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1f81304889f4097be095ebf6bddbd34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:27:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:27:08Z,use_quota=True,user_id='bfdec49fc2e2461eb7829e910d88333a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:27:07 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-9a033e05-a1f3-4837-a63d-f22838bc1aa7 tempest-VolumesListAdminTestJSON-589565954 None] Creating volume 8012df8c-6935-459e-a325-5f9962c2a8d4 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:27:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9a033e05-a1f3-4837-a63d-f22838bc1aa7 tempest-VolumesListAdminTestJSON-589565954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:27:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9a033e05-a1f3-4837-a63d-f22838bc1aa7 tempest-VolumesListAdminTestJSON-589565954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:27:07 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-9a033e05-a1f3-4837-a63d-f22838bc1aa7 tempest-VolumesListAdminTestJSON-589565954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:27:07 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-9a033e05-a1f3-4837-a63d-f22838bc1aa7 tempest-VolumesListAdminTestJSON-589565954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:27:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9a033e05-a1f3-4837-a63d-f22838bc1aa7 tempest-VolumesListAdminTestJSON-589565954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:27:07 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-9a033e05-a1f3-4837-a63d-f22838bc1aa7 tempest-VolumesListAdminTestJSON-589565954 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:27:07 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-9a033e05-a1f3-4837-a63d-f22838bc1aa7 tempest-VolumesListAdminTestJSON-589565954 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:27:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9a033e05-a1f3-4837-a63d-f22838bc1aa7 tempest-VolumesListAdminTestJSON-589565954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-8012df8c-6935-459e-a325-5f9962c2a8d4 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:27:07 devstack sudo[97069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-8012df8c-6935-459e-a325-5f9962c2a8d4 1073741824 Nov 06 15:27:07 devstack sudo[97069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:27:08 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 15:27:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:27:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:27:08 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:27:08 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:27:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:27:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:27:08 devstack sudo[97075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:27:08 devstack sudo[97075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:27:08 devstack sudo[97069]: pam_unix(sudo:session): session closed for user root Nov 06 15:27:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9a033e05-a1f3-4837-a63d-f22838bc1aa7 tempest-VolumesListAdminTestJSON-589565954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-8012df8c-6935-459e-a325-5f9962c2a8d4 1073741824" returned: 0 in 0.703s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:27:08 devstack sudo[97075]: pam_unix(sudo:session): session closed for user root Nov 06 15:27:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.537s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:27:08 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:27:08 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Running periodic task VolumeManager._thread_info {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 15:27:08 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] thread count: 28 {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 15:27:08 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] thread info: [<_MainThread(MainThread, started 140011251929216)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 06 15:27:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9a033e05-a1f3-4837-a63d-f22838bc1aa7 tempest-VolumesListAdminTestJSON-589565954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-8012df8c-6935-459e-a325-5f9962c2a8d4 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:27:08 devstack sudo[97087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-8012df8c-6935-459e-a325-5f9962c2a8d4 Nov 06 15:27:08 devstack sudo[97087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:27:09 devstack sudo[97087]: pam_unix(sudo:session): session closed for user root Nov 06 15:27:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9a033e05-a1f3-4837-a63d-f22838bc1aa7 tempest-VolumesListAdminTestJSON-589565954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-8012df8c-6935-459e-a325-5f9962c2a8d4" returned: 0 in 0.367s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:27:09 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-9a033e05-a1f3-4837-a63d-f22838bc1aa7 tempest-VolumesListAdminTestJSON-589565954 None] <== create_volume: return (1147ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:27:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9a033e05-a1f3-4837-a63d-f22838bc1aa7 tempest-VolumesListAdminTestJSON-589565954 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.153s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:27:09 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9a033e05-a1f3-4837-a63d-f22838bc1aa7 tempest-VolumesListAdminTestJSON-589565954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1740d07e-4227-459d-9759-6b980d2a1576) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8012df8c-6935-459e-a325-5f9962c2a8d4', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:27:09 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9a033e05-a1f3-4837-a63d-f22838bc1aa7 tempest-VolumesListAdminTestJSON-589565954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4333bc2c-8754-431b-8e79-fd9559cd1964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:27:09 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-9a033e05-a1f3-4837-a63d-f22838bc1aa7 tempest-VolumesListAdminTestJSON-589565954 None] Volume volume-8012df8c-6935-459e-a325-5f9962c2a8d4 (8012df8c-6935-459e-a325-5f9962c2a8d4): created successfully Nov 06 15:27:09 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9a033e05-a1f3-4837-a63d-f22838bc1aa7 tempest-VolumesListAdminTestJSON-589565954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4333bc2c-8754-431b-8e79-fd9559cd1964) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:27:09 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9a033e05-a1f3-4837-a63d-f22838bc1aa7 tempest-VolumesListAdminTestJSON-589565954 None] Flow 'volume_create_manager' (d46ce230-7d3b-4236-ba08-84afbbca9239) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:27:09 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-9a033e05-a1f3-4837-a63d-f22838bc1aa7 tempest-VolumesListAdminTestJSON-589565954 None] Created volume successfully. Nov 06 15:27:10 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-6beb40d1-28c2-40e3-97c0-9b2d7d80f952 tempest-VolumesListAdminTestJSON-589565954 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:27:10 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6beb40d1-28c2-40e3-97c0-9b2d7d80f952 tempest-VolumesListAdminTestJSON-589565954 None] Flow 'volume_create_manager' (a607b941-48f0-45a5-82f6-dbff40fcdd20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:27:10 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6beb40d1-28c2-40e3-97c0-9b2d7d80f952 tempest-VolumesListAdminTestJSON-589565954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e2e2467-8e24-4f63-901f-aee2b94c9a45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:27:10 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6beb40d1-28c2-40e3-97c0-9b2d7d80f952 tempest-VolumesListAdminTestJSON-589565954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e2e2467-8e24-4f63-901f-aee2b94c9a45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:27:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1520942863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a074c96f-c28b-477b-a63d-c28775ea748f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1f81304889f4097be095ebf6bddbd34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:27:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:27:11Z,use_quota=True,user_id='bfdec49fc2e2461eb7829e910d88333a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:27:10 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6beb40d1-28c2-40e3-97c0-9b2d7d80f952 tempest-VolumesListAdminTestJSON-589565954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddf1c63c-8dc9-4e6c-83bd-3dab8c934b20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:27:10 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6beb40d1-28c2-40e3-97c0-9b2d7d80f952 tempest-VolumesListAdminTestJSON-589565954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddf1c63c-8dc9-4e6c-83bd-3dab8c934b20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:27:10 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6beb40d1-28c2-40e3-97c0-9b2d7d80f952 tempest-VolumesListAdminTestJSON-589565954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56e495e2-92ea-4089-bb06-7b580f601043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:27:10 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6beb40d1-28c2-40e3-97c0-9b2d7d80f952 tempest-VolumesListAdminTestJSON-589565954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56e495e2-92ea-4089-bb06-7b580f601043) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a074c96f-c28b-477b-a63d-c28775ea748f', 'volume_name': 'volume-a074c96f-c28b-477b-a63d-c28775ea748f', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:27:10 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6beb40d1-28c2-40e3-97c0-9b2d7d80f952 tempest-VolumesListAdminTestJSON-589565954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28962c4e-cfbb-407e-948b-04e019143247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:27:10 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6beb40d1-28c2-40e3-97c0-9b2d7d80f952 tempest-VolumesListAdminTestJSON-589565954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28962c4e-cfbb-407e-948b-04e019143247) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:27:10 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6beb40d1-28c2-40e3-97c0-9b2d7d80f952 tempest-VolumesListAdminTestJSON-589565954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89dd2308-4b46-4430-8c9e-c8c8d9880b17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:27:11 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-6beb40d1-28c2-40e3-97c0-9b2d7d80f952 tempest-VolumesListAdminTestJSON-589565954 None] Volume a074c96f-c28b-477b-a63d-c28775ea748f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a074c96f-c28b-477b-a63d-c28775ea748f', 'volume_size': 1} Nov 06 15:27:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6beb40d1-28c2-40e3-97c0-9b2d7d80f952 tempest-VolumesListAdminTestJSON-589565954 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:27:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6beb40d1-28c2-40e3-97c0-9b2d7d80f952 tempest-VolumesListAdminTestJSON-589565954 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:27:11 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-6beb40d1-28c2-40e3-97c0-9b2d7d80f952 tempest-VolumesListAdminTestJSON-589565954 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:27:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1520942863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a074c96f-c28b-477b-a63d-c28775ea748f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1f81304889f4097be095ebf6bddbd34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:27:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:27:11Z,use_quota=True,user_id='bfdec49fc2e2461eb7829e910d88333a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:27:11 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-6beb40d1-28c2-40e3-97c0-9b2d7d80f952 tempest-VolumesListAdminTestJSON-589565954 None] Creating volume a074c96f-c28b-477b-a63d-c28775ea748f {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:27:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6beb40d1-28c2-40e3-97c0-9b2d7d80f952 tempest-VolumesListAdminTestJSON-589565954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:27:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6beb40d1-28c2-40e3-97c0-9b2d7d80f952 tempest-VolumesListAdminTestJSON-589565954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:27:11 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-6beb40d1-28c2-40e3-97c0-9b2d7d80f952 tempest-VolumesListAdminTestJSON-589565954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:27:11 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-6beb40d1-28c2-40e3-97c0-9b2d7d80f952 tempest-VolumesListAdminTestJSON-589565954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:27:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6beb40d1-28c2-40e3-97c0-9b2d7d80f952 tempest-VolumesListAdminTestJSON-589565954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:27:11 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-6beb40d1-28c2-40e3-97c0-9b2d7d80f952 tempest-VolumesListAdminTestJSON-589565954 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:27:11 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-6beb40d1-28c2-40e3-97c0-9b2d7d80f952 tempest-VolumesListAdminTestJSON-589565954 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:27:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6beb40d1-28c2-40e3-97c0-9b2d7d80f952 tempest-VolumesListAdminTestJSON-589565954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a074c96f-c28b-477b-a63d-c28775ea748f 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:27:11 devstack sudo[97127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a074c96f-c28b-477b-a63d-c28775ea748f 1073741824 Nov 06 15:27:11 devstack sudo[97127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:27:11 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-5cbc32bb-b31b-4a98-9d6c-dd56239e448c tempest-VolumesSnapshotNegativeTestJSON-1555683139 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:27:11 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5cbc32bb-b31b-4a98-9d6c-dd56239e448c tempest-VolumesSnapshotNegativeTestJSON-1555683139 None] Flow 'volume_create_manager' (69205442-04c0-45dd-9077-48ddee4003d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:27:11 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5cbc32bb-b31b-4a98-9d6c-dd56239e448c tempest-VolumesSnapshotNegativeTestJSON-1555683139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e91ea3fe-1376-4e51-b283-cad4cbeeef24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:27:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5cbc32bb-b31b-4a98-9d6c-dd56239e448c tempest-VolumesSnapshotNegativeTestJSON-1555683139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e91ea3fe-1376-4e51-b283-cad4cbeeef24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:27:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1145870371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b689b312-42f7-49b9-873a-9902f9e7a919,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b28d8da7c614d4aac8b383a366fa7b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:27:12Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:27:12Z,use_quota=True,user_id='429043e53d134c1e83c4ff190c2cce7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:27:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5cbc32bb-b31b-4a98-9d6c-dd56239e448c tempest-VolumesSnapshotNegativeTestJSON-1555683139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ead983f3-ea76-4d2a-9495-1da8cff8ed82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:27:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5cbc32bb-b31b-4a98-9d6c-dd56239e448c tempest-VolumesSnapshotNegativeTestJSON-1555683139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ead983f3-ea76-4d2a-9495-1da8cff8ed82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:27:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5cbc32bb-b31b-4a98-9d6c-dd56239e448c tempest-VolumesSnapshotNegativeTestJSON-1555683139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c78e1f6-570c-4c6f-982a-9fb0e5b6356e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:27:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5cbc32bb-b31b-4a98-9d6c-dd56239e448c tempest-VolumesSnapshotNegativeTestJSON-1555683139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c78e1f6-570c-4c6f-982a-9fb0e5b6356e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b689b312-42f7-49b9-873a-9902f9e7a919', 'volume_name': 'volume-b689b312-42f7-49b9-873a-9902f9e7a919', 'volume_size': 2}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:27:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5cbc32bb-b31b-4a98-9d6c-dd56239e448c tempest-VolumesSnapshotNegativeTestJSON-1555683139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f829e568-06f7-4e9f-a2bc-df724da85705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:27:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5cbc32bb-b31b-4a98-9d6c-dd56239e448c tempest-VolumesSnapshotNegativeTestJSON-1555683139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f829e568-06f7-4e9f-a2bc-df724da85705) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:27:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5cbc32bb-b31b-4a98-9d6c-dd56239e448c tempest-VolumesSnapshotNegativeTestJSON-1555683139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (936fc57e-d0ad-409d-baa0-2c9477cdff88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:27:12 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-5cbc32bb-b31b-4a98-9d6c-dd56239e448c tempest-VolumesSnapshotNegativeTestJSON-1555683139 None] Volume b689b312-42f7-49b9-873a-9902f9e7a919: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b689b312-42f7-49b9-873a-9902f9e7a919', 'volume_size': 2} Nov 06 15:27:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5cbc32bb-b31b-4a98-9d6c-dd56239e448c tempest-VolumesSnapshotNegativeTestJSON-1555683139 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:27:12 devstack sudo[97127]: pam_unix(sudo:session): session closed for user root Nov 06 15:27:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6beb40d1-28c2-40e3-97c0-9b2d7d80f952 tempest-VolumesListAdminTestJSON-589565954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a074c96f-c28b-477b-a63d-c28775ea748f 1073741824" returned: 0 in 1.170s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:27:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6beb40d1-28c2-40e3-97c0-9b2d7d80f952 tempest-VolumesListAdminTestJSON-589565954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a074c96f-c28b-477b-a63d-c28775ea748f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:27:12 devstack sudo[97163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a074c96f-c28b-477b-a63d-c28775ea748f Nov 06 15:27:12 devstack sudo[97163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:27:12 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f358d7c-ea55-484e-a6a2-ea352b71c34a tempest-TestStampPattern-2123587362 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:27:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6f358d7c-ea55-484e-a6a2-ea352b71c34a tempest-TestStampPattern-2123587362 None] Flow 'volume_create_manager' (11337b87-ce7a-4b9a-bd86-11ced0316d1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:27:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6f358d7c-ea55-484e-a6a2-ea352b71c34a tempest-TestStampPattern-2123587362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6a9a3fe-30ff-45ea-9de9-0400ade31794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:27:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6f358d7c-ea55-484e-a6a2-ea352b71c34a tempest-TestStampPattern-2123587362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6a9a3fe-30ff-45ea-9de9-0400ade31794) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:27:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-298029831',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a8ebbbf-037d-41a7-b9ed-a4f47c62589f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b9e9e9c5e2743ef89ba1b2dcb92ad26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:27:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=7470e204-ea7f-415a-a8a0-931912e52b0e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:27:12Z,use_quota=True,user_id='1ae967d13b81479296624dbd445e877c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:27:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6f358d7c-ea55-484e-a6a2-ea352b71c34a tempest-TestStampPattern-2123587362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a9ba345-34ce-4594-8e1b-b438761741b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:27:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6f358d7c-ea55-484e-a6a2-ea352b71c34a tempest-TestStampPattern-2123587362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a9ba345-34ce-4594-8e1b-b438761741b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:27:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6f358d7c-ea55-484e-a6a2-ea352b71c34a tempest-TestStampPattern-2123587362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1199e32-dd99-445d-99bb-d722fa6ffcc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:27:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6f358d7c-ea55-484e-a6a2-ea352b71c34a tempest-TestStampPattern-2123587362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1199e32-dd99-445d-99bb-d722fa6ffcc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9a8ebbbf-037d-41a7-b9ed-a4f47c62589f', 'volume_name': 'volume-9a8ebbbf-037d-41a7-b9ed-a4f47c62589f', 'volume_size': 1, 'snapshot_id': '7470e204-ea7f-415a-a8a0-931912e52b0e'}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:27:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6f358d7c-ea55-484e-a6a2-ea352b71c34a tempest-TestStampPattern-2123587362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14c53dbf-4316-4cc4-b1ab-68d09f10c39d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:27:12 devstack sudo[97163]: pam_unix(sudo:session): session closed for user root Nov 06 15:27:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6f358d7c-ea55-484e-a6a2-ea352b71c34a tempest-TestStampPattern-2123587362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14c53dbf-4316-4cc4-b1ab-68d09f10c39d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:27:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6f358d7c-ea55-484e-a6a2-ea352b71c34a tempest-TestStampPattern-2123587362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5db3008b-371a-45b2-857b-573e3ec6011f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:27:12 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-6f358d7c-ea55-484e-a6a2-ea352b71c34a tempest-TestStampPattern-2123587362 None] Volume 9a8ebbbf-037d-41a7-b9ed-a4f47c62589f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9a8ebbbf-037d-41a7-b9ed-a4f47c62589f', 'volume_size': 1, 'snapshot_id': '7470e204-ea7f-415a-a8a0-931912e52b0e'} Nov 06 15:27:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6beb40d1-28c2-40e3-97c0-9b2d7d80f952 tempest-VolumesListAdminTestJSON-589565954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a074c96f-c28b-477b-a63d-c28775ea748f" returned: 0 in 0.689s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:27:12 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-6beb40d1-28c2-40e3-97c0-9b2d7d80f952 tempest-VolumesListAdminTestJSON-589565954 None] <== create_volume: return (1922ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:27:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6beb40d1-28c2-40e3-97c0-9b2d7d80f952 tempest-VolumesListAdminTestJSON-589565954 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.926s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:27:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5cbc32bb-b31b-4a98-9d6c-dd56239e448c tempest-VolumesSnapshotNegativeTestJSON-1555683139 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.830s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:27:12 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-5cbc32bb-b31b-4a98-9d6c-dd56239e448c tempest-VolumesSnapshotNegativeTestJSON-1555683139 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:27:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1145870371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b689b312-42f7-49b9-873a-9902f9e7a919,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b28d8da7c614d4aac8b383a366fa7b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:27:12Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:27:12Z,use_quota=True,user_id='429043e53d134c1e83c4ff190c2cce7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:27:12 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-5cbc32bb-b31b-4a98-9d6c-dd56239e448c tempest-VolumesSnapshotNegativeTestJSON-1555683139 None] Creating volume b689b312-42f7-49b9-873a-9902f9e7a919 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:27:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5cbc32bb-b31b-4a98-9d6c-dd56239e448c tempest-VolumesSnapshotNegativeTestJSON-1555683139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:27:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5cbc32bb-b31b-4a98-9d6c-dd56239e448c tempest-VolumesSnapshotNegativeTestJSON-1555683139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:27:12 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-5cbc32bb-b31b-4a98-9d6c-dd56239e448c tempest-VolumesSnapshotNegativeTestJSON-1555683139 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:27:12 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-5cbc32bb-b31b-4a98-9d6c-dd56239e448c tempest-VolumesSnapshotNegativeTestJSON-1555683139 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:27:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5cbc32bb-b31b-4a98-9d6c-dd56239e448c tempest-VolumesSnapshotNegativeTestJSON-1555683139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:27:12 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-5cbc32bb-b31b-4a98-9d6c-dd56239e448c tempest-VolumesSnapshotNegativeTestJSON-1555683139 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:27:12 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-5cbc32bb-b31b-4a98-9d6c-dd56239e448c tempest-VolumesSnapshotNegativeTestJSON-1555683139 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:27:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5cbc32bb-b31b-4a98-9d6c-dd56239e448c tempest-VolumesSnapshotNegativeTestJSON-1555683139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b689b312-42f7-49b9-873a-9902f9e7a919 2147483648 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:27:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6f358d7c-ea55-484e-a6a2-ea352b71c34a tempest-TestStampPattern-2123587362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:27:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6beb40d1-28c2-40e3-97c0-9b2d7d80f952 tempest-VolumesListAdminTestJSON-589565954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89dd2308-4b46-4430-8c9e-c8c8d9880b17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a074c96f-c28b-477b-a63d-c28775ea748f', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:27:13 devstack sudo[97169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b689b312-42f7-49b9-873a-9902f9e7a919 2147483648 Nov 06 15:27:13 devstack sudo[97169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:27:13 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6beb40d1-28c2-40e3-97c0-9b2d7d80f952 tempest-VolumesListAdminTestJSON-589565954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a58ebe8d-175d-4e3c-adab-2897478356a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:27:13 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-6beb40d1-28c2-40e3-97c0-9b2d7d80f952 tempest-VolumesListAdminTestJSON-589565954 None] Volume volume-a074c96f-c28b-477b-a63d-c28775ea748f (a074c96f-c28b-477b-a63d-c28775ea748f): created successfully Nov 06 15:27:13 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6beb40d1-28c2-40e3-97c0-9b2d7d80f952 tempest-VolumesListAdminTestJSON-589565954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a58ebe8d-175d-4e3c-adab-2897478356a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:27:13 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6beb40d1-28c2-40e3-97c0-9b2d7d80f952 tempest-VolumesListAdminTestJSON-589565954 None] Flow 'volume_create_manager' (a607b941-48f0-45a5-82f6-dbff40fcdd20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:27:13 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-6beb40d1-28c2-40e3-97c0-9b2d7d80f952 tempest-VolumesListAdminTestJSON-589565954 None] Created volume successfully. Nov 06 15:27:13 devstack sudo[97169]: pam_unix(sudo:session): session closed for user root Nov 06 15:27:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5cbc32bb-b31b-4a98-9d6c-dd56239e448c tempest-VolumesSnapshotNegativeTestJSON-1555683139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b689b312-42f7-49b9-873a-9902f9e7a919 2147483648" returned: 0 in 0.626s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:27:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5cbc32bb-b31b-4a98-9d6c-dd56239e448c tempest-VolumesSnapshotNegativeTestJSON-1555683139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b689b312-42f7-49b9-873a-9902f9e7a919 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:27:13 devstack sudo[97176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b689b312-42f7-49b9-873a-9902f9e7a919 Nov 06 15:27:13 devstack sudo[97176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:27:14 devstack sudo[97176]: pam_unix(sudo:session): session closed for user root Nov 06 15:27:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5cbc32bb-b31b-4a98-9d6c-dd56239e448c tempest-VolumesSnapshotNegativeTestJSON-1555683139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b689b312-42f7-49b9-873a-9902f9e7a919" returned: 0 in 0.388s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:27:14 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-5cbc32bb-b31b-4a98-9d6c-dd56239e448c tempest-VolumesSnapshotNegativeTestJSON-1555683139 None] <== create_volume: return (1074ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:27:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5cbc32bb-b31b-4a98-9d6c-dd56239e448c tempest-VolumesSnapshotNegativeTestJSON-1555683139 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.081s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:27:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6f358d7c-ea55-484e-a6a2-ea352b71c34a tempest-TestStampPattern-2123587362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.049s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:27:14 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6f358d7c-ea55-484e-a6a2-ea352b71c34a tempest-TestStampPattern-2123587362 None] Acquiring lock "cinder-quobyte-7470e204-ea7f-415a-a8a0-931912e52b0e-9a8ebbbf-037d-41a7-b9ed-a4f47c62589f" by "_create_volume_from_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:27:14 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5cbc32bb-b31b-4a98-9d6c-dd56239e448c tempest-VolumesSnapshotNegativeTestJSON-1555683139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (936fc57e-d0ad-409d-baa0-2c9477cdff88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b689b312-42f7-49b9-873a-9902f9e7a919', 'volume_size': 2}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:27:14 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5cbc32bb-b31b-4a98-9d6c-dd56239e448c tempest-VolumesSnapshotNegativeTestJSON-1555683139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a7a27b7-07c0-48fb-8cde-ade88dffd582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:27:14 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6f358d7c-ea55-484e-a6a2-ea352b71c34a tempest-TestStampPattern-2123587362 None] Lock "cinder-quobyte-7470e204-ea7f-415a-a8a0-931912e52b0e-9a8ebbbf-037d-41a7-b9ed-a4f47c62589f" acquired by "_create_volume_from_snapshot" :: waited 0.042s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:27:14 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-6f358d7c-ea55-484e-a6a2-ea352b71c34a tempest-TestStampPattern-2123587362 None] Creating volume 9a8ebbbf-037d-41a7-b9ed-a4f47c62589f from snapshot 7470e204-ea7f-415a-a8a0-931912e52b0e {{(pid=87132) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 06 15:27:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6f358d7c-ea55-484e-a6a2-ea352b71c34a tempest-TestStampPattern-2123587362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:27:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6f358d7c-ea55-484e-a6a2-ea352b71c34a tempest-TestStampPattern-2123587362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:27:14 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-6f358d7c-ea55-484e-a6a2-ea352b71c34a tempest-TestStampPattern-2123587362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:27:14 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-6f358d7c-ea55-484e-a6a2-ea352b71c34a tempest-TestStampPattern-2123587362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:27:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6f358d7c-ea55-484e-a6a2-ea352b71c34a tempest-TestStampPattern-2123587362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:27:14 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-6f358d7c-ea55-484e-a6a2-ea352b71c34a tempest-TestStampPattern-2123587362 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:27:14 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6f358d7c-ea55-484e-a6a2-ea352b71c34a tempest-TestStampPattern-2123587362 None] Acquiring lock "cinder-quobyte-9a8ebbbf-037d-41a7-b9ed-a4f47c62589f" by "_copy_volume_from_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:27:14 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6f358d7c-ea55-484e-a6a2-ea352b71c34a tempest-TestStampPattern-2123587362 None] Lock "cinder-quobyte-9a8ebbbf-037d-41a7-b9ed-a4f47c62589f" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:27:14 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-6f358d7c-ea55-484e-a6a2-ea352b71c34a tempest-TestStampPattern-2123587362 None] snapshot: 7470e204-ea7f-415a-a8a0-931912e52b0e, volume: 9a8ebbbf-037d-41a7-b9ed-a4f47c62589f, {{(pid=87132) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 06 15:27:14 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-5cbc32bb-b31b-4a98-9d6c-dd56239e448c tempest-VolumesSnapshotNegativeTestJSON-1555683139 None] Volume volume-b689b312-42f7-49b9-873a-9902f9e7a919 (b689b312-42f7-49b9-873a-9902f9e7a919): created successfully Nov 06 15:27:14 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5cbc32bb-b31b-4a98-9d6c-dd56239e448c tempest-VolumesSnapshotNegativeTestJSON-1555683139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a7a27b7-07c0-48fb-8cde-ade88dffd582) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:27:14 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5cbc32bb-b31b-4a98-9d6c-dd56239e448c tempest-VolumesSnapshotNegativeTestJSON-1555683139 None] Flow 'volume_create_manager' (69205442-04c0-45dd-9077-48ddee4003d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:27:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6f358d7c-ea55-484e-a6a2-ea352b71c34a tempest-TestStampPattern-2123587362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:27:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6f358d7c-ea55-484e-a6a2-ea352b71c34a tempest-TestStampPattern-2123587362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:27:14 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-6f358d7c-ea55-484e-a6a2-ea352b71c34a tempest-TestStampPattern-2123587362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:27:14 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-6f358d7c-ea55-484e-a6a2-ea352b71c34a tempest-TestStampPattern-2123587362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:27:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6f358d7c-ea55-484e-a6a2-ea352b71c34a tempest-TestStampPattern-2123587362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:27:14 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-5cbc32bb-b31b-4a98-9d6c-dd56239e448c tempest-VolumesSnapshotNegativeTestJSON-1555683139 None] Created volume successfully. Nov 06 15:27:14 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bc51c80-c174-42e5-b6d3-802b8ba9f7a3]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:27:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6f358d7c-ea55-484e-a6a2-ea352b71c34a tempest-TestStampPattern-2123587362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-70555739-c658-4506-9144-58189ae89625.7470e204-ea7f-415a-a8a0-931912e52b0e {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:27:14 devstack sudo[97182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-70555739-c658-4506-9144-58189ae89625.7470e204-ea7f-415a-a8a0-931912e52b0e Nov 06 15:27:14 devstack sudo[97182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:27:15 devstack sudo[97182]: pam_unix(sudo:session): session closed for user root Nov 06 15:27:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6f358d7c-ea55-484e-a6a2-ea352b71c34a tempest-TestStampPattern-2123587362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-70555739-c658-4506-9144-58189ae89625.7470e204-ea7f-415a-a8a0-931912e52b0e" returned: 0 in 0.772s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:27:15 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-6f358d7c-ea55-484e-a6a2-ea352b71c34a tempest-TestStampPattern-2123587362 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-70555739-c658-4506-9144-58189ae89625(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 15:27:15 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[440a9ae9-f6ff-423e-97b1-b601664f18de]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:27:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6f358d7c-ea55-484e-a6a2-ea352b71c34a tempest-TestStampPattern-2123587362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-70555739-c658-4506-9144-58189ae89625 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:27:15 devstack sudo[97194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-70555739-c658-4506-9144-58189ae89625 Nov 06 15:27:15 devstack sudo[97194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:27:15 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-00448cf0-a9c6-41e0-b5a8-21df9f32206d tempest-VolumesListAdminTestJSON-589565954 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:27:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-00448cf0-a9c6-41e0-b5a8-21df9f32206d tempest-VolumesListAdminTestJSON-589565954 None] Flow 'volume_create_manager' (5401001b-25a6-4137-a547-2240da89325f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:27:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-00448cf0-a9c6-41e0-b5a8-21df9f32206d tempest-VolumesListAdminTestJSON-589565954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (061f994a-d8e8-48da-b2b7-8238fa457ce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:27:15 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:SELECT=123,cinder:UPDATE=151,cinder:DELETE=14,cinder:INSERT=43 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 15:27:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-00448cf0-a9c6-41e0-b5a8-21df9f32206d tempest-VolumesListAdminTestJSON-589565954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (061f994a-d8e8-48da-b2b7-8238fa457ce3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:27:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-942820839',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01d43cc0-28e4-4e19-ab5c-95b86d60d8ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1f81304889f4097be095ebf6bddbd34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:27:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:27:16Z,use_quota=True,user_id='bfdec49fc2e2461eb7829e910d88333a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:27:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-00448cf0-a9c6-41e0-b5a8-21df9f32206d tempest-VolumesListAdminTestJSON-589565954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c225b36-ea9c-45cc-b3e1-2d8753364644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:27:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-00448cf0-a9c6-41e0-b5a8-21df9f32206d tempest-VolumesListAdminTestJSON-589565954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c225b36-ea9c-45cc-b3e1-2d8753364644) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:27:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-00448cf0-a9c6-41e0-b5a8-21df9f32206d tempest-VolumesListAdminTestJSON-589565954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39b3b6ef-90b3-4542-ab3b-48bc71ba5585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:27:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-00448cf0-a9c6-41e0-b5a8-21df9f32206d tempest-VolumesListAdminTestJSON-589565954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39b3b6ef-90b3-4542-ab3b-48bc71ba5585) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01d43cc0-28e4-4e19-ab5c-95b86d60d8ac', 'volume_name': 'volume-01d43cc0-28e4-4e19-ab5c-95b86d60d8ac', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:27:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-00448cf0-a9c6-41e0-b5a8-21df9f32206d tempest-VolumesListAdminTestJSON-589565954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (920c9360-ae44-4f15-af3a-bbd78720fefc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:27:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-00448cf0-a9c6-41e0-b5a8-21df9f32206d tempest-VolumesListAdminTestJSON-589565954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (920c9360-ae44-4f15-af3a-bbd78720fefc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:27:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-00448cf0-a9c6-41e0-b5a8-21df9f32206d tempest-VolumesListAdminTestJSON-589565954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (095f327c-c991-4dc4-8615-a8c6edf077d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:27:15 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-00448cf0-a9c6-41e0-b5a8-21df9f32206d tempest-VolumesListAdminTestJSON-589565954 None] Volume 01d43cc0-28e4-4e19-ab5c-95b86d60d8ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01d43cc0-28e4-4e19-ab5c-95b86d60d8ac', 'volume_size': 1} Nov 06 15:27:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-00448cf0-a9c6-41e0-b5a8-21df9f32206d tempest-VolumesListAdminTestJSON-589565954 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:27:15 devstack sudo[97194]: pam_unix(sudo:session): session closed for user root Nov 06 15:27:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6f358d7c-ea55-484e-a6a2-ea352b71c34a tempest-TestStampPattern-2123587362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-70555739-c658-4506-9144-58189ae89625" returned: 0 in 0.801s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:27:15 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-6f358d7c-ea55-484e-a6a2-ea352b71c34a tempest-TestStampPattern-2123587362 None] will copy from snapshot at /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-70555739-c658-4506-9144-58189ae89625 {{(pid=87132) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 06 15:27:15 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-6f358d7c-ea55-484e-a6a2-ea352b71c34a tempest-TestStampPattern-2123587362 None] Creating direct copy from snapshot {{(pid=87132) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 06 15:27:15 devstack cinder-volume[87132]: DEBUG cinder.utils [None req-6f358d7c-ea55-484e-a6a2-ea352b71c34a tempest-TestStampPattern-2123587362 None] Path /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-9a8ebbbf-037d-41a7-b9ed-a4f47c62589f not found in is_blk_device check {{(pid=87132) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 06 15:27:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6f358d7c-ea55-484e-a6a2-ea352b71c34a tempest-TestStampPattern-2123587362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-70555739-c658-4506-9144-58189ae89625 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-9a8ebbbf-037d-41a7-b9ed-a4f47c62589f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:27:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-be94af78-c416-4bb7-b24f-178a85a28512 tempest-VolumesSnapshotNegativeTestJSON-1555683139 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:27:15 devstack sudo[97202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-70555739-c658-4506-9144-58189ae89625 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-9a8ebbbf-037d-41a7-b9ed-a4f47c62589f Nov 06 15:27:15 devstack sudo[97202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:27:25 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:SELECT=60,cinder:UPDATE=57,cinder:INSERT=9,cinder:DELETE=6 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 15:27:27 devstack sudo[97202]: pam_unix(sudo:session): session closed for user root Nov 06 15:27:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6f358d7c-ea55-484e-a6a2-ea352b71c34a tempest-TestStampPattern-2123587362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-70555739-c658-4506-9144-58189ae89625 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-9a8ebbbf-037d-41a7-b9ed-a4f47c62589f" returned: 0 in 11.594s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:27:27 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-6f358d7c-ea55-484e-a6a2-ea352b71c34a tempest-TestStampPattern-2123587362 None] Image conversion details: src /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-70555739-c658-4506-9144-58189ae89625, size 1024.00 MB, duration 11.60 sec, destination /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-9a8ebbbf-037d-41a7-b9ed-a4f47c62589f {{(pid=87132) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 06 15:27:27 devstack cinder-volume[87132]: INFO cinder.image.image_utils [None req-6f358d7c-ea55-484e-a6a2-ea352b71c34a tempest-TestStampPattern-2123587362 None] Converted 1024.00 MB image at 88.31 MB/s Nov 06 15:27:27 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-6f358d7c-ea55-484e-a6a2-ea352b71c34a tempest-TestStampPattern-2123587362 None] /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-9a8ebbbf-037d-41a7-b9ed-a4f47c62589f is being set with open permissions: ugo+rw Nov 06 15:27:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6f358d7c-ea55-484e-a6a2-ea352b71c34a tempest-TestStampPattern-2123587362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-9a8ebbbf-037d-41a7-b9ed-a4f47c62589f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:27:27 devstack sudo[97308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-9a8ebbbf-037d-41a7-b9ed-a4f47c62589f Nov 06 15:27:27 devstack sudo[97308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:27:27 devstack sudo[97308]: pam_unix(sudo:session): session closed for user root Nov 06 15:27:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6f358d7c-ea55-484e-a6a2-ea352b71c34a tempest-TestStampPattern-2123587362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-9a8ebbbf-037d-41a7-b9ed-a4f47c62589f" returned: 0 in 0.251s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:27:27 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6f358d7c-ea55-484e-a6a2-ea352b71c34a tempest-TestStampPattern-2123587362 None] Lock "cinder-quobyte-9a8ebbbf-037d-41a7-b9ed-a4f47c62589f" released by "_copy_volume_from_snapshot" :: held 13.625s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:27:27 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6f358d7c-ea55-484e-a6a2-ea352b71c34a tempest-TestStampPattern-2123587362 None] Lock "cinder-quobyte-7470e204-ea7f-415a-a8a0-931912e52b0e-9a8ebbbf-037d-41a7-b9ed-a4f47c62589f" released by "_create_volume_from_snapshot" :: held 13.715s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:27:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6f358d7c-ea55-484e-a6a2-ea352b71c34a tempest-TestStampPattern-2123587362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 13.758s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:27:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-00448cf0-a9c6-41e0-b5a8-21df9f32206d tempest-VolumesListAdminTestJSON-589565954 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.931s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:27:27 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-00448cf0-a9c6-41e0-b5a8-21df9f32206d tempest-VolumesListAdminTestJSON-589565954 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:27:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-942820839',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01d43cc0-28e4-4e19-ab5c-95b86d60d8ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1f81304889f4097be095ebf6bddbd34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:27:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:27:16Z,use_quota=True,user_id='bfdec49fc2e2461eb7829e910d88333a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:27:27 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-00448cf0-a9c6-41e0-b5a8-21df9f32206d tempest-VolumesListAdminTestJSON-589565954 None] Creating volume 01d43cc0-28e4-4e19-ab5c-95b86d60d8ac {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:27:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-00448cf0-a9c6-41e0-b5a8-21df9f32206d tempest-VolumesListAdminTestJSON-589565954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:27:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-00448cf0-a9c6-41e0-b5a8-21df9f32206d tempest-VolumesListAdminTestJSON-589565954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:27:27 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-00448cf0-a9c6-41e0-b5a8-21df9f32206d tempest-VolumesListAdminTestJSON-589565954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:27:27 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-00448cf0-a9c6-41e0-b5a8-21df9f32206d tempest-VolumesListAdminTestJSON-589565954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:27:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-00448cf0-a9c6-41e0-b5a8-21df9f32206d tempest-VolumesListAdminTestJSON-589565954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:27:27 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-00448cf0-a9c6-41e0-b5a8-21df9f32206d tempest-VolumesListAdminTestJSON-589565954 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:27:27 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-00448cf0-a9c6-41e0-b5a8-21df9f32206d tempest-VolumesListAdminTestJSON-589565954 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:27:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-00448cf0-a9c6-41e0-b5a8-21df9f32206d tempest-VolumesListAdminTestJSON-589565954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-01d43cc0-28e4-4e19-ab5c-95b86d60d8ac 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:27:27 devstack sudo[97311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-01d43cc0-28e4-4e19-ab5c-95b86d60d8ac 1073741824 Nov 06 15:27:27 devstack sudo[97311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:27:27 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6f358d7c-ea55-484e-a6a2-ea352b71c34a tempest-TestStampPattern-2123587362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5db3008b-371a-45b2-857b-573e3ec6011f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a8ebbbf-037d-41a7-b9ed-a4f47c62589f', 'volume_size': 1, 'snapshot_id': '7470e204-ea7f-415a-a8a0-931912e52b0e'}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:27:27 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6f358d7c-ea55-484e-a6a2-ea352b71c34a tempest-TestStampPattern-2123587362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a87b558-39f2-4beb-b064-b8cfce112688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:27:27 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-6f358d7c-ea55-484e-a6a2-ea352b71c34a tempest-TestStampPattern-2123587362 None] Volume volume-9a8ebbbf-037d-41a7-b9ed-a4f47c62589f (9a8ebbbf-037d-41a7-b9ed-a4f47c62589f): created successfully Nov 06 15:27:27 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6f358d7c-ea55-484e-a6a2-ea352b71c34a tempest-TestStampPattern-2123587362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a87b558-39f2-4beb-b064-b8cfce112688) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:27:27 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6f358d7c-ea55-484e-a6a2-ea352b71c34a tempest-TestStampPattern-2123587362 None] Flow 'volume_create_manager' (11337b87-ce7a-4b9a-bd86-11ced0316d1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:27:27 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-6f358d7c-ea55-484e-a6a2-ea352b71c34a tempest-TestStampPattern-2123587362 None] Created volume successfully. Nov 06 15:27:28 devstack sudo[97311]: pam_unix(sudo:session): session closed for user root Nov 06 15:27:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-00448cf0-a9c6-41e0-b5a8-21df9f32206d tempest-VolumesListAdminTestJSON-589565954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-01d43cc0-28e4-4e19-ab5c-95b86d60d8ac 1073741824" returned: 0 in 0.561s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:27:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-00448cf0-a9c6-41e0-b5a8-21df9f32206d tempest-VolumesListAdminTestJSON-589565954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-01d43cc0-28e4-4e19-ab5c-95b86d60d8ac {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:27:28 devstack sudo[97317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-01d43cc0-28e4-4e19-ab5c-95b86d60d8ac Nov 06 15:27:28 devstack sudo[97317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:27:28 devstack sudo[97317]: pam_unix(sudo:session): session closed for user root Nov 06 15:27:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-00448cf0-a9c6-41e0-b5a8-21df9f32206d tempest-VolumesListAdminTestJSON-589565954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-01d43cc0-28e4-4e19-ab5c-95b86d60d8ac" returned: 0 in 0.281s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:27:28 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-00448cf0-a9c6-41e0-b5a8-21df9f32206d tempest-VolumesListAdminTestJSON-589565954 None] <== create_volume: return (895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:27:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-00448cf0-a9c6-41e0-b5a8-21df9f32206d tempest-VolumesListAdminTestJSON-589565954 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.902s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:27:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-be94af78-c416-4bb7-b24f-178a85a28512 tempest-VolumesSnapshotNegativeTestJSON-1555683139 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 12.778s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:27:28 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-00448cf0-a9c6-41e0-b5a8-21df9f32206d tempest-VolumesListAdminTestJSON-589565954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (095f327c-c991-4dc4-8615-a8c6edf077d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01d43cc0-28e4-4e19-ab5c-95b86d60d8ac', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:27:28 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-00448cf0-a9c6-41e0-b5a8-21df9f32206d tempest-VolumesListAdminTestJSON-589565954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e01130f-2683-44a0-b12e-68b9f251482b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:27:28 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-be94af78-c416-4bb7-b24f-178a85a28512 tempest-VolumesSnapshotNegativeTestJSON-1555683139 None] Creating offline snapshot 5f90e0dc-a59e-4dcd-a1dd-9751ccceb2b0 of volume b689b312-42f7-49b9-873a-9902f9e7a919 {{(pid=87132) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 15:27:28 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-00448cf0-a9c6-41e0-b5a8-21df9f32206d tempest-VolumesListAdminTestJSON-589565954 None] Volume volume-01d43cc0-28e4-4e19-ab5c-95b86d60d8ac (01d43cc0-28e4-4e19-ab5c-95b86d60d8ac): created successfully Nov 06 15:27:28 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-00448cf0-a9c6-41e0-b5a8-21df9f32206d tempest-VolumesListAdminTestJSON-589565954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e01130f-2683-44a0-b12e-68b9f251482b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:27:28 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-00448cf0-a9c6-41e0-b5a8-21df9f32206d tempest-VolumesListAdminTestJSON-589565954 None] Flow 'volume_create_manager' (5401001b-25a6-4137-a547-2240da89325f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:27:28 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c049679-2d0d-499a-b081-239828933e17]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:27:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-be94af78-c416-4bb7-b24f-178a85a28512 tempest-VolumesSnapshotNegativeTestJSON-1555683139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b689b312-42f7-49b9-873a-9902f9e7a919 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:27:28 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-00448cf0-a9c6-41e0-b5a8-21df9f32206d tempest-VolumesListAdminTestJSON-589565954 None] Created volume successfully. Nov 06 15:27:28 devstack sudo[97320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b689b312-42f7-49b9-873a-9902f9e7a919 Nov 06 15:27:28 devstack sudo[97320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:27:29 devstack sudo[97320]: pam_unix(sudo:session): session closed for user root Nov 06 15:27:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-be94af78-c416-4bb7-b24f-178a85a28512 tempest-VolumesSnapshotNegativeTestJSON-1555683139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b689b312-42f7-49b9-873a-9902f9e7a919" returned: 0 in 0.435s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:27:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-be94af78-c416-4bb7-b24f-178a85a28512 tempest-VolumesSnapshotNegativeTestJSON-1555683139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b689b312-42f7-49b9-873a-9902f9e7a919,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b689b312-42f7-49b9-873a-9902f9e7a919.5f90e0dc-a59e-4dcd-a1dd-9751ccceb2b0 2G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:27:29 devstack sudo[97325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b689b312-42f7-49b9-873a-9902f9e7a919,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b689b312-42f7-49b9-873a-9902f9e7a919.5f90e0dc-a59e-4dcd-a1dd-9751ccceb2b0 2G Nov 06 15:27:29 devstack sudo[97325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:27:29 devstack sudo[97325]: pam_unix(sudo:session): session closed for user root Nov 06 15:27:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-be94af78-c416-4bb7-b24f-178a85a28512 tempest-VolumesSnapshotNegativeTestJSON-1555683139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b689b312-42f7-49b9-873a-9902f9e7a919,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b689b312-42f7-49b9-873a-9902f9e7a919.5f90e0dc-a59e-4dcd-a1dd-9751ccceb2b0 2G" returned: 0 in 0.589s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:27:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-be94af78-c416-4bb7-b24f-178a85a28512 tempest-VolumesSnapshotNegativeTestJSON-1555683139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b689b312-42f7-49b9-873a-9902f9e7a919 -F qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b689b312-42f7-49b9-873a-9902f9e7a919.5f90e0dc-a59e-4dcd-a1dd-9751ccceb2b0 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:27:29 devstack sudo[97331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b689b312-42f7-49b9-873a-9902f9e7a919 -F qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b689b312-42f7-49b9-873a-9902f9e7a919.5f90e0dc-a59e-4dcd-a1dd-9751ccceb2b0 Nov 06 15:27:29 devstack sudo[97331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:27:30 devstack sudo[97331]: pam_unix(sudo:session): session closed for user root Nov 06 15:27:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-be94af78-c416-4bb7-b24f-178a85a28512 tempest-VolumesSnapshotNegativeTestJSON-1555683139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b689b312-42f7-49b9-873a-9902f9e7a919 -F qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b689b312-42f7-49b9-873a-9902f9e7a919.5f90e0dc-a59e-4dcd-a1dd-9751ccceb2b0" returned: 0 in 0.630s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:27:30 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-be94af78-c416-4bb7-b24f-178a85a28512 tempest-VolumesSnapshotNegativeTestJSON-1555683139 None] /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b689b312-42f7-49b9-873a-9902f9e7a919.5f90e0dc-a59e-4dcd-a1dd-9751ccceb2b0 is being set with open permissions: ugo+rw Nov 06 15:27:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-be94af78-c416-4bb7-b24f-178a85a28512 tempest-VolumesSnapshotNegativeTestJSON-1555683139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b689b312-42f7-49b9-873a-9902f9e7a919.5f90e0dc-a59e-4dcd-a1dd-9751ccceb2b0 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:27:30 devstack sudo[97337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b689b312-42f7-49b9-873a-9902f9e7a919.5f90e0dc-a59e-4dcd-a1dd-9751ccceb2b0 Nov 06 15:27:30 devstack sudo[97337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:27:30 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfddcf21-24e0-4962-9b10-a40fc777b33f tempest-VolumesListAdminTestJSON-70774368 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:27:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-bfddcf21-24e0-4962-9b10-a40fc777b33f tempest-VolumesListAdminTestJSON-70774368 None] Flow 'volume_create_manager' (d6624d82-50f6-426b-b17c-0b425322e229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:27:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-bfddcf21-24e0-4962-9b10-a40fc777b33f tempest-VolumesListAdminTestJSON-70774368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8198118d-7a0c-443e-b465-7860ec486cfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:27:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-bfddcf21-24e0-4962-9b10-a40fc777b33f tempest-VolumesListAdminTestJSON-70774368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8198118d-7a0c-443e-b465-7860ec486cfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:27:30Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8765ecd-93ef-415f-82a8-06cad8c138c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84da1fdf8a504109b8fc5f9c65785b63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:27:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:27:31Z,use_quota=True,user_id='0a108874dab04e3bb6efdf1fef8a2e58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:27:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-bfddcf21-24e0-4962-9b10-a40fc777b33f tempest-VolumesListAdminTestJSON-70774368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42dcdd82-c0ac-46e7-ab9c-84b2d35f1286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:27:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-bfddcf21-24e0-4962-9b10-a40fc777b33f tempest-VolumesListAdminTestJSON-70774368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42dcdd82-c0ac-46e7-ab9c-84b2d35f1286) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:27:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-bfddcf21-24e0-4962-9b10-a40fc777b33f tempest-VolumesListAdminTestJSON-70774368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (784a0535-9d14-4951-8ff8-f1dcfcc7ee3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:27:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-bfddcf21-24e0-4962-9b10-a40fc777b33f tempest-VolumesListAdminTestJSON-70774368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (784a0535-9d14-4951-8ff8-f1dcfcc7ee3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8765ecd-93ef-415f-82a8-06cad8c138c4', 'volume_name': 'volume-c8765ecd-93ef-415f-82a8-06cad8c138c4', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:27:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-bfddcf21-24e0-4962-9b10-a40fc777b33f tempest-VolumesListAdminTestJSON-70774368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5f40443-5718-40c5-9cc5-d96135912fb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:27:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-bfddcf21-24e0-4962-9b10-a40fc777b33f tempest-VolumesListAdminTestJSON-70774368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5f40443-5718-40c5-9cc5-d96135912fb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:27:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-bfddcf21-24e0-4962-9b10-a40fc777b33f tempest-VolumesListAdminTestJSON-70774368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f50245c1-82b8-4994-825e-2e68ba31f9b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:27:30 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-bfddcf21-24e0-4962-9b10-a40fc777b33f tempest-VolumesListAdminTestJSON-70774368 None] Volume c8765ecd-93ef-415f-82a8-06cad8c138c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8765ecd-93ef-415f-82a8-06cad8c138c4', 'volume_size': 1} Nov 06 15:27:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-bfddcf21-24e0-4962-9b10-a40fc777b33f tempest-VolumesListAdminTestJSON-70774368 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:27:30 devstack sudo[97337]: pam_unix(sudo:session): session closed for user root Nov 06 15:27:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-be94af78-c416-4bb7-b24f-178a85a28512 tempest-VolumesSnapshotNegativeTestJSON-1555683139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b689b312-42f7-49b9-873a-9902f9e7a919.5f90e0dc-a59e-4dcd-a1dd-9751ccceb2b0" returned: 0 in 0.303s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:27:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-be94af78-c416-4bb7-b24f-178a85a28512 tempest-VolumesSnapshotNegativeTestJSON-1555683139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b689b312-42f7-49b9-873a-9902f9e7a919.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:27:30 devstack sudo[97340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b689b312-42f7-49b9-873a-9902f9e7a919.info Nov 06 15:27:30 devstack sudo[97340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:27:31 devstack sudo[97340]: pam_unix(sudo:session): session closed for user root Nov 06 15:27:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-be94af78-c416-4bb7-b24f-178a85a28512 tempest-VolumesSnapshotNegativeTestJSON-1555683139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b689b312-42f7-49b9-873a-9902f9e7a919.info" returned: 0 in 0.286s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:27:31 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-be94af78-c416-4bb7-b24f-178a85a28512 tempest-VolumesSnapshotNegativeTestJSON-1555683139 None] /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b689b312-42f7-49b9-873a-9902f9e7a919.info is being set with open permissions: ugo+rw Nov 06 15:27:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-be94af78-c416-4bb7-b24f-178a85a28512 tempest-VolumesSnapshotNegativeTestJSON-1555683139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b689b312-42f7-49b9-873a-9902f9e7a919.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:27:31 devstack sudo[97344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b689b312-42f7-49b9-873a-9902f9e7a919.info Nov 06 15:27:31 devstack sudo[97344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:27:31 devstack sudo[97344]: pam_unix(sudo:session): session closed for user root Nov 06 15:27:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-be94af78-c416-4bb7-b24f-178a85a28512 tempest-VolumesSnapshotNegativeTestJSON-1555683139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b689b312-42f7-49b9-873a-9902f9e7a919.info" returned: 0 in 0.271s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:27:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-be94af78-c416-4bb7-b24f-178a85a28512 tempest-VolumesSnapshotNegativeTestJSON-1555683139 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.656s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:27:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-bfddcf21-24e0-4962-9b10-a40fc777b33f tempest-VolumesListAdminTestJSON-70774368 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.626s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:27:31 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-bfddcf21-24e0-4962-9b10-a40fc777b33f tempest-VolumesListAdminTestJSON-70774368 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:27:30Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8765ecd-93ef-415f-82a8-06cad8c138c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84da1fdf8a504109b8fc5f9c65785b63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:27:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:27:31Z,use_quota=True,user_id='0a108874dab04e3bb6efdf1fef8a2e58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:27:31 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-bfddcf21-24e0-4962-9b10-a40fc777b33f tempest-VolumesListAdminTestJSON-70774368 None] Creating volume c8765ecd-93ef-415f-82a8-06cad8c138c4 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:27:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-bfddcf21-24e0-4962-9b10-a40fc777b33f tempest-VolumesListAdminTestJSON-70774368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:27:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-bfddcf21-24e0-4962-9b10-a40fc777b33f tempest-VolumesListAdminTestJSON-70774368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:27:31 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-bfddcf21-24e0-4962-9b10-a40fc777b33f tempest-VolumesListAdminTestJSON-70774368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:27:31 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-bfddcf21-24e0-4962-9b10-a40fc777b33f tempest-VolumesListAdminTestJSON-70774368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:27:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-bfddcf21-24e0-4962-9b10-a40fc777b33f tempest-VolumesListAdminTestJSON-70774368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:27:31 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-bfddcf21-24e0-4962-9b10-a40fc777b33f tempest-VolumesListAdminTestJSON-70774368 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:27:31 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-bfddcf21-24e0-4962-9b10-a40fc777b33f tempest-VolumesListAdminTestJSON-70774368 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:27:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bfddcf21-24e0-4962-9b10-a40fc777b33f tempest-VolumesListAdminTestJSON-70774368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-c8765ecd-93ef-415f-82a8-06cad8c138c4 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:27:31 devstack sudo[97347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-c8765ecd-93ef-415f-82a8-06cad8c138c4 1073741824 Nov 06 15:27:31 devstack sudo[97347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:27:31 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-be94af78-c416-4bb7-b24f-178a85a28512 tempest-VolumesSnapshotNegativeTestJSON-1555683139 None] Create snapshot completed successfully Nov 06 15:27:31 devstack sudo[97347]: pam_unix(sudo:session): session closed for user root Nov 06 15:27:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bfddcf21-24e0-4962-9b10-a40fc777b33f tempest-VolumesListAdminTestJSON-70774368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-c8765ecd-93ef-415f-82a8-06cad8c138c4 1073741824" returned: 0 in 0.431s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:27:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bfddcf21-24e0-4962-9b10-a40fc777b33f tempest-VolumesListAdminTestJSON-70774368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-c8765ecd-93ef-415f-82a8-06cad8c138c4 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:27:31 devstack sudo[97352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-c8765ecd-93ef-415f-82a8-06cad8c138c4 Nov 06 15:27:31 devstack sudo[97352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:27:32 devstack sudo[97352]: pam_unix(sudo:session): session closed for user root Nov 06 15:27:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bfddcf21-24e0-4962-9b10-a40fc777b33f tempest-VolumesListAdminTestJSON-70774368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-c8765ecd-93ef-415f-82a8-06cad8c138c4" returned: 0 in 0.260s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:27:32 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-bfddcf21-24e0-4962-9b10-a40fc777b33f tempest-VolumesListAdminTestJSON-70774368 None] <== create_volume: return (730ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:27:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-bfddcf21-24e0-4962-9b10-a40fc777b33f tempest-VolumesListAdminTestJSON-70774368 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.733s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:27:32 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-bfddcf21-24e0-4962-9b10-a40fc777b33f tempest-VolumesListAdminTestJSON-70774368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f50245c1-82b8-4994-825e-2e68ba31f9b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8765ecd-93ef-415f-82a8-06cad8c138c4', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:27:32 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-bfddcf21-24e0-4962-9b10-a40fc777b33f tempest-VolumesListAdminTestJSON-70774368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eeff01dd-eb84-4cff-9af0-0dc82b12137b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:27:32 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-bfddcf21-24e0-4962-9b10-a40fc777b33f tempest-VolumesListAdminTestJSON-70774368 None] Volume volume-c8765ecd-93ef-415f-82a8-06cad8c138c4 (c8765ecd-93ef-415f-82a8-06cad8c138c4): created successfully Nov 06 15:27:32 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-bfddcf21-24e0-4962-9b10-a40fc777b33f tempest-VolumesListAdminTestJSON-70774368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eeff01dd-eb84-4cff-9af0-0dc82b12137b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:27:32 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-bfddcf21-24e0-4962-9b10-a40fc777b33f tempest-VolumesListAdminTestJSON-70774368 None] Flow 'volume_create_manager' (d6624d82-50f6-426b-b17c-0b425322e229) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:27:32 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-bfddcf21-24e0-4962-9b10-a40fc777b33f tempest-VolumesListAdminTestJSON-70774368 None] Created volume successfully. Nov 06 15:27:32 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e210a011-5415-41a2-9d02-40a41c14c914 tempest-VolumesSnapshotNegativeTestJSON-1555683139 None] Acquiring lock "cinder-5f90e0dc-a59e-4dcd-a1dd-9751ccceb2b0-delete_snapshot" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:27:32 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e210a011-5415-41a2-9d02-40a41c14c914 tempest-VolumesSnapshotNegativeTestJSON-1555683139 None] Lock "cinder-5f90e0dc-a59e-4dcd-a1dd-9751ccceb2b0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:27:32 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e210a011-5415-41a2-9d02-40a41c14c914 tempest-VolumesSnapshotNegativeTestJSON-1555683139 None] Acquiring lock "cinder-quobyte-b689b312-42f7-49b9-873a-9902f9e7a919" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:27:32 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e210a011-5415-41a2-9d02-40a41c14c914 tempest-VolumesSnapshotNegativeTestJSON-1555683139 None] Lock "cinder-quobyte-b689b312-42f7-49b9-873a-9902f9e7a919" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:27:32 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e210a011-5415-41a2-9d02-40a41c14c914 tempest-VolumesSnapshotNegativeTestJSON-1555683139 None] Acquiring lock "cinder-quobyte-5f90e0dc-a59e-4dcd-a1dd-9751ccceb2b0" by "_delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:27:32 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e210a011-5415-41a2-9d02-40a41c14c914 tempest-VolumesSnapshotNegativeTestJSON-1555683139 None] Lock "cinder-quobyte-5f90e0dc-a59e-4dcd-a1dd-9751ccceb2b0" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:27:32 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-e210a011-5415-41a2-9d02-40a41c14c914 tempest-VolumesSnapshotNegativeTestJSON-1555683139 None] Deleting offline snapshot 5f90e0dc-a59e-4dcd-a1dd-9751ccceb2b0 of volume b689b312-42f7-49b9-873a-9902f9e7a919 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 15:27:32 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-e210a011-5415-41a2-9d02-40a41c14c914 tempest-VolumesSnapshotNegativeTestJSON-1555683139 None] snapshot_file for this snap is: volume-b689b312-42f7-49b9-873a-9902f9e7a919.5f90e0dc-a59e-4dcd-a1dd-9751ccceb2b0 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 15:27:32 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fe16c09-3e41-4d1e-b3fe-68aa7ce2ab82]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:27:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e210a011-5415-41a2-9d02-40a41c14c914 tempest-VolumesSnapshotNegativeTestJSON-1555683139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b689b312-42f7-49b9-873a-9902f9e7a919.5f90e0dc-a59e-4dcd-a1dd-9751ccceb2b0 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:27:32 devstack sudo[97355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b689b312-42f7-49b9-873a-9902f9e7a919.5f90e0dc-a59e-4dcd-a1dd-9751ccceb2b0 Nov 06 15:27:32 devstack sudo[97355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:27:32 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-4fc40091-ae79-4a0f-99be-89aab5d14904 tempest-VolumesListAdminTestJSON-70774368 None] Acquiring lock "cinder-c8765ecd-93ef-415f-82a8-06cad8c138c4-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:27:32 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-4fc40091-ae79-4a0f-99be-89aab5d14904 tempest-VolumesListAdminTestJSON-70774368 None] Lock "cinder-c8765ecd-93ef-415f-82a8-06cad8c138c4-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:27:32 devstack sudo[97355]: pam_unix(sudo:session): session closed for user root Nov 06 15:27:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e210a011-5415-41a2-9d02-40a41c14c914 tempest-VolumesSnapshotNegativeTestJSON-1555683139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b689b312-42f7-49b9-873a-9902f9e7a919.5f90e0dc-a59e-4dcd-a1dd-9751ccceb2b0" returned: 0 in 0.474s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:27:32 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-e210a011-5415-41a2-9d02-40a41c14c914 tempest-VolumesSnapshotNegativeTestJSON-1555683139 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b689b312-42f7-49b9-873a-9902f9e7a919(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 15:27:32 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[62b0e374-4377-44a4-a60a-0a5c7610b46a]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:27:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e210a011-5415-41a2-9d02-40a41c14c914 tempest-VolumesSnapshotNegativeTestJSON-1555683139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b689b312-42f7-49b9-873a-9902f9e7a919 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:27:32 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-4fc40091-ae79-4a0f-99be-89aab5d14904 tempest-VolumesListAdminTestJSON-70774368 None] Acquiring lock "cinder-quobyte-c8765ecd-93ef-415f-82a8-06cad8c138c4" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:27:33 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-4fc40091-ae79-4a0f-99be-89aab5d14904 tempest-VolumesListAdminTestJSON-70774368 None] Lock "cinder-quobyte-c8765ecd-93ef-415f-82a8-06cad8c138c4" acquired by "delete_volume" :: waited 0.030s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:27:33 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[54353507-37b5-47a0-b7d9-861b9f1e3a89]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:27:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4fc40091-ae79-4a0f-99be-89aab5d14904 tempest-VolumesListAdminTestJSON-70774368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-c8765ecd-93ef-415f-82a8-06cad8c138c4 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:27:33 devstack sudo[97360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b689b312-42f7-49b9-873a-9902f9e7a919 Nov 06 15:27:33 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-0053a87d-86ab-4233-bf84-01f6bee11375 tempest-VolumesListAdminTestJSON-589565954 None] Acquiring lock "cinder-01d43cc0-28e4-4e19-ab5c-95b86d60d8ac-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:27:33 devstack sudo[97360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:27:33 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-0053a87d-86ab-4233-bf84-01f6bee11375 tempest-VolumesListAdminTestJSON-589565954 None] Lock "cinder-01d43cc0-28e4-4e19-ab5c-95b86d60d8ac-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:27:33 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-0053a87d-86ab-4233-bf84-01f6bee11375 tempest-VolumesListAdminTestJSON-589565954 None] Acquiring lock "cinder-quobyte-01d43cc0-28e4-4e19-ab5c-95b86d60d8ac" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:27:33 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-0053a87d-86ab-4233-bf84-01f6bee11375 tempest-VolumesListAdminTestJSON-589565954 None] Lock "cinder-quobyte-01d43cc0-28e4-4e19-ab5c-95b86d60d8ac" acquired by "delete_volume" :: waited 0.038s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:27:33 devstack sudo[97361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-c8765ecd-93ef-415f-82a8-06cad8c138c4 Nov 06 15:27:33 devstack sudo[97361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:27:33 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[deb4e131-e969-4ab8-a0cc-318dce5935a8]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:27:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0053a87d-86ab-4233-bf84-01f6bee11375 tempest-VolumesListAdminTestJSON-589565954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-01d43cc0-28e4-4e19-ab5c-95b86d60d8ac {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:27:33 devstack sudo[97364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-01d43cc0-28e4-4e19-ab5c-95b86d60d8ac Nov 06 15:27:33 devstack sudo[97364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:27:33 devstack sudo[97360]: pam_unix(sudo:session): session closed for user root Nov 06 15:27:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e210a011-5415-41a2-9d02-40a41c14c914 tempest-VolumesSnapshotNegativeTestJSON-1555683139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b689b312-42f7-49b9-873a-9902f9e7a919" returned: 0 in 0.722s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:27:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e210a011-5415-41a2-9d02-40a41c14c914 tempest-VolumesSnapshotNegativeTestJSON-1555683139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b689b312-42f7-49b9-873a-9902f9e7a919.5f90e0dc-a59e-4dcd-a1dd-9751ccceb2b0 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:27:33 devstack sudo[97372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b689b312-42f7-49b9-873a-9902f9e7a919.5f90e0dc-a59e-4dcd-a1dd-9751ccceb2b0 Nov 06 15:27:33 devstack sudo[97372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:27:33 devstack sudo[97361]: pam_unix(sudo:session): session closed for user root Nov 06 15:27:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4fc40091-ae79-4a0f-99be-89aab5d14904 tempest-VolumesListAdminTestJSON-70774368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-c8765ecd-93ef-415f-82a8-06cad8c138c4" returned: 0 in 0.673s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:27:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4fc40091-ae79-4a0f-99be-89aab5d14904 tempest-VolumesListAdminTestJSON-70774368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-c8765ecd-93ef-415f-82a8-06cad8c138c4 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:27:33 devstack sudo[97374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-c8765ecd-93ef-415f-82a8-06cad8c138c4 Nov 06 15:27:33 devstack sudo[97374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:27:33 devstack sudo[97364]: pam_unix(sudo:session): session closed for user root Nov 06 15:27:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0053a87d-86ab-4233-bf84-01f6bee11375 tempest-VolumesListAdminTestJSON-589565954 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-01d43cc0-28e4-4e19-ab5c-95b86d60d8ac" returned: 0 in 0.618s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:27:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0053a87d-86ab-4233-bf84-01f6bee11375 tempest-VolumesListAdminTestJSON-589565954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-01d43cc0-28e4-4e19-ab5c-95b86d60d8ac {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:27:33 devstack sudo[97381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-01d43cc0-28e4-4e19-ab5c-95b86d60d8ac Nov 06 15:27:34 devstack sudo[97381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:27:34 devstack sudo[97372]: pam_unix(sudo:session): session closed for user root Nov 06 15:27:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e210a011-5415-41a2-9d02-40a41c14c914 tempest-VolumesSnapshotNegativeTestJSON-1555683139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b689b312-42f7-49b9-873a-9902f9e7a919.5f90e0dc-a59e-4dcd-a1dd-9751ccceb2b0" returned: 0 in 0.487s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:27:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e210a011-5415-41a2-9d02-40a41c14c914 tempest-VolumesSnapshotNegativeTestJSON-1555683139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b689b312-42f7-49b9-873a-9902f9e7a919.5f90e0dc-a59e-4dcd-a1dd-9751ccceb2b0 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:27:34 devstack sudo[97374]: pam_unix(sudo:session): session closed for user root Nov 06 15:27:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4fc40091-ae79-4a0f-99be-89aab5d14904 tempest-VolumesListAdminTestJSON-70774368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-c8765ecd-93ef-415f-82a8-06cad8c138c4" returned: 0 in 0.450s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:27:34 devstack sudo[97385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b689b312-42f7-49b9-873a-9902f9e7a919.5f90e0dc-a59e-4dcd-a1dd-9751ccceb2b0 Nov 06 15:27:34 devstack sudo[97385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:27:34 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-4fc40091-ae79-4a0f-99be-89aab5d14904 tempest-VolumesListAdminTestJSON-70774368 None] Lock "cinder-quobyte-c8765ecd-93ef-415f-82a8-06cad8c138c4" released by "delete_volume" :: held 1.226s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:27:34 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-4fc40091-ae79-4a0f-99be-89aab5d14904 tempest-VolumesListAdminTestJSON-70774368 None] Created reservations ['b08784e9-ab1f-4b00-a261-31b6a83b2596', 'bdb35d6f-e2cd-45fb-b191-bd27c5edb695', '79f0f6b2-c80e-42b2-90d1-7b6eeb131e02', 'a64690a9-74c5-4c56-a202-11e6dea0671c'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:27:34 devstack sudo[97381]: pam_unix(sudo:session): session closed for user root Nov 06 15:27:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0053a87d-86ab-4233-bf84-01f6bee11375 tempest-VolumesListAdminTestJSON-589565954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-01d43cc0-28e4-4e19-ab5c-95b86d60d8ac" returned: 0 in 0.394s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:27:34 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-0053a87d-86ab-4233-bf84-01f6bee11375 tempest-VolumesListAdminTestJSON-589565954 None] Lock "cinder-quobyte-01d43cc0-28e4-4e19-ab5c-95b86d60d8ac" released by "delete_volume" :: held 1.115s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:27:34 devstack sudo[97385]: pam_unix(sudo:session): session closed for user root Nov 06 15:27:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e210a011-5415-41a2-9d02-40a41c14c914 tempest-VolumesSnapshotNegativeTestJSON-1555683139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b689b312-42f7-49b9-873a-9902f9e7a919.5f90e0dc-a59e-4dcd-a1dd-9751ccceb2b0" returned: 0 in 0.335s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:27:34 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e210a011-5415-41a2-9d02-40a41c14c914 tempest-VolumesSnapshotNegativeTestJSON-1555683139 None] Lock "cinder-quobyte-5f90e0dc-a59e-4dcd-a1dd-9751ccceb2b0" released by "_delete_snapshot" :: held 2.160s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:27:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4fc40091-ae79-4a0f-99be-89aab5d14904 tempest-VolumesListAdminTestJSON-70774368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:27:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4fc40091-ae79-4a0f-99be-89aab5d14904 tempest-VolumesListAdminTestJSON-70774368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:27:34 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-4fc40091-ae79-4a0f-99be-89aab5d14904 tempest-VolumesListAdminTestJSON-70774368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:27:34 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-4fc40091-ae79-4a0f-99be-89aab5d14904 tempest-VolumesListAdminTestJSON-70774368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:27:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4fc40091-ae79-4a0f-99be-89aab5d14904 tempest-VolumesListAdminTestJSON-70774368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:27:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4fc40091-ae79-4a0f-99be-89aab5d14904 tempest-VolumesListAdminTestJSON-70774368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:27:34 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e210a011-5415-41a2-9d02-40a41c14c914 tempest-VolumesSnapshotNegativeTestJSON-1555683139 None] Lock "cinder-quobyte-b689b312-42f7-49b9-873a-9902f9e7a919" released by "delete_snapshot" :: held 2.214s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:27:34 devstack sudo[97389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:27:34 devstack sudo[97389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:27:34 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-0053a87d-86ab-4233-bf84-01f6bee11375 tempest-VolumesListAdminTestJSON-589565954 None] Created reservations ['b1991759-7332-4eb6-9d46-d2c0a77e76eb', 'e3deed8b-04a8-4303-8e31-cbe19f5e239d', 'eb926648-f550-4338-bc39-fa2d066967a2', '4cff792f-3649-447c-8fbe-8cb7dc81487d'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:27:34 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-e210a011-5415-41a2-9d02-40a41c14c914 tempest-VolumesSnapshotNegativeTestJSON-1555683139 None] Created reservations ['a1542136-43b5-45d4-99e5-11efd30c2ffd', 'ea9126d7-33dd-493f-9a74-c2de468966cd', '5392a5fa-35a7-4747-8d91-1aa2bef41ddd', '26d00768-d643-4c19-a8e1-19c00165c2a3'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:27:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0053a87d-86ab-4233-bf84-01f6bee11375 tempest-VolumesListAdminTestJSON-589565954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:27:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0053a87d-86ab-4233-bf84-01f6bee11375 tempest-VolumesListAdminTestJSON-589565954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:27:34 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0053a87d-86ab-4233-bf84-01f6bee11375 tempest-VolumesListAdminTestJSON-589565954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:27:34 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0053a87d-86ab-4233-bf84-01f6bee11375 tempest-VolumesListAdminTestJSON-589565954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:27:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0053a87d-86ab-4233-bf84-01f6bee11375 tempest-VolumesListAdminTestJSON-589565954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:27:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0053a87d-86ab-4233-bf84-01f6bee11375 tempest-VolumesListAdminTestJSON-589565954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:27:34 devstack sudo[97391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:27:34 devstack sudo[97391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:27:34 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-e210a011-5415-41a2-9d02-40a41c14c914 tempest-VolumesSnapshotNegativeTestJSON-1555683139 None] Delete snapshot completed successfully. Nov 06 15:27:34 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e210a011-5415-41a2-9d02-40a41c14c914 tempest-VolumesSnapshotNegativeTestJSON-1555683139 None] Lock "cinder-5f90e0dc-a59e-4dcd-a1dd-9751ccceb2b0-delete_snapshot" released by "delete_snapshot" :: held 2.486s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:27:34 devstack sudo[97389]: pam_unix(sudo:session): session closed for user root Nov 06 15:27:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4fc40091-ae79-4a0f-99be-89aab5d14904 tempest-VolumesListAdminTestJSON-70774368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.347s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:27:34 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-4fc40091-ae79-4a0f-99be-89aab5d14904 tempest-VolumesListAdminTestJSON-70774368 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:27:34 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-4fc40091-ae79-4a0f-99be-89aab5d14904 tempest-VolumesListAdminTestJSON-70774368 None] Deleted volume successfully. Nov 06 15:27:34 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-4fc40091-ae79-4a0f-99be-89aab5d14904 tempest-VolumesListAdminTestJSON-70774368 None] Lock "cinder-c8765ecd-93ef-415f-82a8-06cad8c138c4-delete_volume" released by "delete_volume" :: held 2.087s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:27:35 devstack sudo[97391]: pam_unix(sudo:session): session closed for user root Nov 06 15:27:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0053a87d-86ab-4233-bf84-01f6bee11375 tempest-VolumesListAdminTestJSON-589565954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.378s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:27:35 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-0053a87d-86ab-4233-bf84-01f6bee11375 tempest-VolumesListAdminTestJSON-589565954 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:27:35 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-0053a87d-86ab-4233-bf84-01f6bee11375 tempest-VolumesListAdminTestJSON-589565954 None] Deleted volume successfully. Nov 06 15:27:35 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-0053a87d-86ab-4233-bf84-01f6bee11375 tempest-VolumesListAdminTestJSON-589565954 None] Lock "cinder-01d43cc0-28e4-4e19-ab5c-95b86d60d8ac-delete_volume" released by "delete_volume" :: held 2.033s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:27:35 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-fd5fba0f-c170-4da6-8c7e-d5951ad71496 tempest-VolumesListAdminTestJSON-589565954 None] Acquiring lock "cinder-a074c96f-c28b-477b-a63d-c28775ea748f-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:27:35 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-fd5fba0f-c170-4da6-8c7e-d5951ad71496 tempest-VolumesListAdminTestJSON-589565954 None] Lock "cinder-a074c96f-c28b-477b-a63d-c28775ea748f-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:27:35 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-aa02ca0c-cb02-403f-9b8d-3b627175e7b6 tempest-VolumesSnapshotNegativeTestJSON-1555683139 None] Acquiring lock "cinder-b689b312-42f7-49b9-873a-9902f9e7a919-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:27:35 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-aa02ca0c-cb02-403f-9b8d-3b627175e7b6 tempest-VolumesSnapshotNegativeTestJSON-1555683139 None] Lock "cinder-b689b312-42f7-49b9-873a-9902f9e7a919-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:27:35 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-fd5fba0f-c170-4da6-8c7e-d5951ad71496 tempest-VolumesListAdminTestJSON-589565954 None] Acquiring lock "cinder-quobyte-a074c96f-c28b-477b-a63d-c28775ea748f" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:27:35 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-fd5fba0f-c170-4da6-8c7e-d5951ad71496 tempest-VolumesListAdminTestJSON-589565954 None] Lock "cinder-quobyte-a074c96f-c28b-477b-a63d-c28775ea748f" acquired by "delete_volume" :: waited 0.029s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:27:35 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-aa02ca0c-cb02-403f-9b8d-3b627175e7b6 tempest-VolumesSnapshotNegativeTestJSON-1555683139 None] Acquiring lock "cinder-quobyte-b689b312-42f7-49b9-873a-9902f9e7a919" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:27:35 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[049e2a1c-7e29-4f46-b8ad-c07494f7dd70]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:27:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-fd5fba0f-c170-4da6-8c7e-d5951ad71496 tempest-VolumesListAdminTestJSON-589565954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a074c96f-c28b-477b-a63d-c28775ea748f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:27:35 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-aa02ca0c-cb02-403f-9b8d-3b627175e7b6 tempest-VolumesSnapshotNegativeTestJSON-1555683139 None] Lock "cinder-quobyte-b689b312-42f7-49b9-873a-9902f9e7a919" acquired by "delete_volume" :: waited 0.023s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:27:35 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[db117bb9-068b-4508-8204-2f307901240b]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:27:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-aa02ca0c-cb02-403f-9b8d-3b627175e7b6 tempest-VolumesSnapshotNegativeTestJSON-1555683139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b689b312-42f7-49b9-873a-9902f9e7a919 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:27:35 devstack sudo[97396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a074c96f-c28b-477b-a63d-c28775ea748f Nov 06 15:27:35 devstack sudo[97396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:27:35 devstack sudo[97397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b689b312-42f7-49b9-873a-9902f9e7a919 Nov 06 15:27:35 devstack sudo[97397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:27:36 devstack sudo[97396]: pam_unix(sudo:session): session closed for user root Nov 06 15:27:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-fd5fba0f-c170-4da6-8c7e-d5951ad71496 tempest-VolumesListAdminTestJSON-589565954 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a074c96f-c28b-477b-a63d-c28775ea748f" returned: 0 in 0.422s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:27:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-fd5fba0f-c170-4da6-8c7e-d5951ad71496 tempest-VolumesListAdminTestJSON-589565954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a074c96f-c28b-477b-a63d-c28775ea748f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:27:36 devstack sudo[97407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a074c96f-c28b-477b-a63d-c28775ea748f Nov 06 15:27:36 devstack sudo[97407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:27:36 devstack sudo[97397]: pam_unix(sudo:session): session closed for user root Nov 06 15:27:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-aa02ca0c-cb02-403f-9b8d-3b627175e7b6 tempest-VolumesSnapshotNegativeTestJSON-1555683139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b689b312-42f7-49b9-873a-9902f9e7a919" returned: 0 in 0.460s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:27:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-aa02ca0c-cb02-403f-9b8d-3b627175e7b6 tempest-VolumesSnapshotNegativeTestJSON-1555683139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b689b312-42f7-49b9-873a-9902f9e7a919 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:27:36 devstack sudo[97413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b689b312-42f7-49b9-873a-9902f9e7a919 Nov 06 15:27:36 devstack sudo[97413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:27:36 devstack sudo[97407]: pam_unix(sudo:session): session closed for user root Nov 06 15:27:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-fd5fba0f-c170-4da6-8c7e-d5951ad71496 tempest-VolumesListAdminTestJSON-589565954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a074c96f-c28b-477b-a63d-c28775ea748f" returned: 0 in 0.302s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:27:36 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-fd5fba0f-c170-4da6-8c7e-d5951ad71496 tempest-VolumesListAdminTestJSON-589565954 None] Lock "cinder-quobyte-a074c96f-c28b-477b-a63d-c28775ea748f" released by "delete_volume" :: held 0.785s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:27:36 devstack sudo[97413]: pam_unix(sudo:session): session closed for user root Nov 06 15:27:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-aa02ca0c-cb02-403f-9b8d-3b627175e7b6 tempest-VolumesSnapshotNegativeTestJSON-1555683139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b689b312-42f7-49b9-873a-9902f9e7a919" returned: 0 in 0.280s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:27:36 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-aa02ca0c-cb02-403f-9b8d-3b627175e7b6 tempest-VolumesSnapshotNegativeTestJSON-1555683139 None] Lock "cinder-quobyte-b689b312-42f7-49b9-873a-9902f9e7a919" released by "delete_volume" :: held 0.806s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:27:36 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-fd5fba0f-c170-4da6-8c7e-d5951ad71496 tempest-VolumesListAdminTestJSON-589565954 None] Created reservations ['8ca017b9-856a-4633-a0ec-d48a365aa5ec', '42bc93f9-09d5-48ac-9f04-2e04e9d6b0b5', '2840f3d1-9f3f-4fc1-acc0-d38c756ee2e5', 'e0652f19-c621-467f-881d-d0fa537c04bd'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:27:36 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-aa02ca0c-cb02-403f-9b8d-3b627175e7b6 tempest-VolumesSnapshotNegativeTestJSON-1555683139 None] Created reservations ['c6d5a0aa-05a2-45ac-9eb4-50c840418e08', '716af2d8-8707-48e2-b440-a569ac5be7d7', '1b550209-d4e1-44ec-9533-3d07f103db7e', 'bfe027e3-eb24-4376-a8e4-4b89a9ace668'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:27:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-fd5fba0f-c170-4da6-8c7e-d5951ad71496 tempest-VolumesListAdminTestJSON-589565954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:27:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-fd5fba0f-c170-4da6-8c7e-d5951ad71496 tempest-VolumesListAdminTestJSON-589565954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:27:36 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-fd5fba0f-c170-4da6-8c7e-d5951ad71496 tempest-VolumesListAdminTestJSON-589565954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:27:36 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-fd5fba0f-c170-4da6-8c7e-d5951ad71496 tempest-VolumesListAdminTestJSON-589565954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:27:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-fd5fba0f-c170-4da6-8c7e-d5951ad71496 tempest-VolumesListAdminTestJSON-589565954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:27:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-fd5fba0f-c170-4da6-8c7e-d5951ad71496 tempest-VolumesListAdminTestJSON-589565954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:27:36 devstack sudo[97419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:27:36 devstack sudo[97419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:27:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-aa02ca0c-cb02-403f-9b8d-3b627175e7b6 tempest-VolumesSnapshotNegativeTestJSON-1555683139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:27:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-aa02ca0c-cb02-403f-9b8d-3b627175e7b6 tempest-VolumesSnapshotNegativeTestJSON-1555683139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:27:36 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-aa02ca0c-cb02-403f-9b8d-3b627175e7b6 tempest-VolumesSnapshotNegativeTestJSON-1555683139 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:27:36 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-aa02ca0c-cb02-403f-9b8d-3b627175e7b6 tempest-VolumesSnapshotNegativeTestJSON-1555683139 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:27:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-aa02ca0c-cb02-403f-9b8d-3b627175e7b6 tempest-VolumesSnapshotNegativeTestJSON-1555683139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:27:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-aa02ca0c-cb02-403f-9b8d-3b627175e7b6 tempest-VolumesSnapshotNegativeTestJSON-1555683139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:27:36 devstack sudo[97421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:27:37 devstack sudo[97421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:27:37 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-1a1bb075-84a3-4647-825b-3a99ed0285c9 tempest-VolumesListAdminTestJSON-589565954 None] Acquiring lock "cinder-8012df8c-6935-459e-a325-5f9962c2a8d4-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:27:37 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-1a1bb075-84a3-4647-825b-3a99ed0285c9 tempest-VolumesListAdminTestJSON-589565954 None] Lock "cinder-8012df8c-6935-459e-a325-5f9962c2a8d4-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:27:37 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-1a1bb075-84a3-4647-825b-3a99ed0285c9 tempest-VolumesListAdminTestJSON-589565954 None] Acquiring lock "cinder-quobyte-8012df8c-6935-459e-a325-5f9962c2a8d4" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:27:37 devstack sudo[97421]: pam_unix(sudo:session): session closed for user root Nov 06 15:27:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-aa02ca0c-cb02-403f-9b8d-3b627175e7b6 tempest-VolumesSnapshotNegativeTestJSON-1555683139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.464s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:27:37 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-aa02ca0c-cb02-403f-9b8d-3b627175e7b6 tempest-VolumesSnapshotNegativeTestJSON-1555683139 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:27:37 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-1a1bb075-84a3-4647-825b-3a99ed0285c9 tempest-VolumesListAdminTestJSON-589565954 None] Lock "cinder-quobyte-8012df8c-6935-459e-a325-5f9962c2a8d4" acquired by "delete_volume" :: waited 0.032s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:27:37 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-aa02ca0c-cb02-403f-9b8d-3b627175e7b6 tempest-VolumesSnapshotNegativeTestJSON-1555683139 None] Deleted volume successfully. Nov 06 15:27:37 devstack sudo[97419]: pam_unix(sudo:session): session closed for user root Nov 06 15:27:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-fd5fba0f-c170-4da6-8c7e-d5951ad71496 tempest-VolumesListAdminTestJSON-589565954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.697s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:27:37 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-fd5fba0f-c170-4da6-8c7e-d5951ad71496 tempest-VolumesListAdminTestJSON-589565954 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:27:37 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[63caa758-3730-4431-b95f-2dcd815daa1c]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:27:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1a1bb075-84a3-4647-825b-3a99ed0285c9 tempest-VolumesListAdminTestJSON-589565954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-8012df8c-6935-459e-a325-5f9962c2a8d4 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:27:37 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-fd5fba0f-c170-4da6-8c7e-d5951ad71496 tempest-VolumesListAdminTestJSON-589565954 None] Deleted volume successfully. Nov 06 15:27:37 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-aa02ca0c-cb02-403f-9b8d-3b627175e7b6 tempest-VolumesSnapshotNegativeTestJSON-1555683139 None] Lock "cinder-b689b312-42f7-49b9-873a-9902f9e7a919-delete_volume" released by "delete_volume" :: held 1.802s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:27:37 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-fd5fba0f-c170-4da6-8c7e-d5951ad71496 tempest-VolumesListAdminTestJSON-589565954 None] Lock "cinder-a074c96f-c28b-477b-a63d-c28775ea748f-delete_volume" released by "delete_volume" :: held 1.868s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:27:37 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-09f981a2-c1a7-4f5f-b1b8-3e0fb9fe6bb9 tempest-AttachVolumeTestJSON-1915243344 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:27:37 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-09f981a2-c1a7-4f5f-b1b8-3e0fb9fe6bb9 tempest-AttachVolumeTestJSON-1915243344 None] Flow 'volume_create_manager' (eea76e98-702e-4cde-bc0c-52a575075947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:27:37 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-09f981a2-c1a7-4f5f-b1b8-3e0fb9fe6bb9 tempest-AttachVolumeTestJSON-1915243344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4387e989-dc48-4fc0-9d01-3725efb71438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:27:37 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-09f981a2-c1a7-4f5f-b1b8-3e0fb9fe6bb9 tempest-AttachVolumeTestJSON-1915243344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4387e989-dc48-4fc0-9d01-3725efb71438) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:27:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2054074105',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff32d504-636c-4127-99ea-aa659321c724,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df60c116e43e4612a2d71379e4f5f302',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:27:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:27:38Z,use_quota=True,user_id='4314c5201ae84b138adcec47db5e56fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:27:37 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-09f981a2-c1a7-4f5f-b1b8-3e0fb9fe6bb9 tempest-AttachVolumeTestJSON-1915243344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ac73c37-d6d3-4d44-8590-1fcaa5dec6c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:27:37 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-09f981a2-c1a7-4f5f-b1b8-3e0fb9fe6bb9 tempest-AttachVolumeTestJSON-1915243344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ac73c37-d6d3-4d44-8590-1fcaa5dec6c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:27:37 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-09f981a2-c1a7-4f5f-b1b8-3e0fb9fe6bb9 tempest-AttachVolumeTestJSON-1915243344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78b9a6af-aa71-4c07-9a4a-f720abbecdd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:27:37 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-09f981a2-c1a7-4f5f-b1b8-3e0fb9fe6bb9 tempest-AttachVolumeTestJSON-1915243344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78b9a6af-aa71-4c07-9a4a-f720abbecdd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff32d504-636c-4127-99ea-aa659321c724', 'volume_name': 'volume-ff32d504-636c-4127-99ea-aa659321c724', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:27:37 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-09f981a2-c1a7-4f5f-b1b8-3e0fb9fe6bb9 tempest-AttachVolumeTestJSON-1915243344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5987152-08be-48c2-8f42-1dd37a3e016a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:27:37 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-09f981a2-c1a7-4f5f-b1b8-3e0fb9fe6bb9 tempest-AttachVolumeTestJSON-1915243344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5987152-08be-48c2-8f42-1dd37a3e016a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:27:37 devstack sudo[97425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-8012df8c-6935-459e-a325-5f9962c2a8d4 Nov 06 15:27:37 devstack sudo[97425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:27:37 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-09f981a2-c1a7-4f5f-b1b8-3e0fb9fe6bb9 tempest-AttachVolumeTestJSON-1915243344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96478ad6-7d43-4bc9-a14e-9f2ce4c1527e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:27:37 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-09f981a2-c1a7-4f5f-b1b8-3e0fb9fe6bb9 tempest-AttachVolumeTestJSON-1915243344 None] Volume ff32d504-636c-4127-99ea-aa659321c724: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff32d504-636c-4127-99ea-aa659321c724', 'volume_size': 1} Nov 06 15:27:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-09f981a2-c1a7-4f5f-b1b8-3e0fb9fe6bb9 tempest-AttachVolumeTestJSON-1915243344 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:27:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-09f981a2-c1a7-4f5f-b1b8-3e0fb9fe6bb9 tempest-AttachVolumeTestJSON-1915243344 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:27:37 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-09f981a2-c1a7-4f5f-b1b8-3e0fb9fe6bb9 tempest-AttachVolumeTestJSON-1915243344 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:27:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2054074105',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff32d504-636c-4127-99ea-aa659321c724,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df60c116e43e4612a2d71379e4f5f302',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:27:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:27:38Z,use_quota=True,user_id='4314c5201ae84b138adcec47db5e56fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:27:37 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-09f981a2-c1a7-4f5f-b1b8-3e0fb9fe6bb9 tempest-AttachVolumeTestJSON-1915243344 None] Creating volume ff32d504-636c-4127-99ea-aa659321c724 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:27:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-09f981a2-c1a7-4f5f-b1b8-3e0fb9fe6bb9 tempest-AttachVolumeTestJSON-1915243344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:27:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-09f981a2-c1a7-4f5f-b1b8-3e0fb9fe6bb9 tempest-AttachVolumeTestJSON-1915243344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:27:37 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-09f981a2-c1a7-4f5f-b1b8-3e0fb9fe6bb9 tempest-AttachVolumeTestJSON-1915243344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:27:37 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-09f981a2-c1a7-4f5f-b1b8-3e0fb9fe6bb9 tempest-AttachVolumeTestJSON-1915243344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:27:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-09f981a2-c1a7-4f5f-b1b8-3e0fb9fe6bb9 tempest-AttachVolumeTestJSON-1915243344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:27:37 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-09f981a2-c1a7-4f5f-b1b8-3e0fb9fe6bb9 tempest-AttachVolumeTestJSON-1915243344 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:27:37 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-09f981a2-c1a7-4f5f-b1b8-3e0fb9fe6bb9 tempest-AttachVolumeTestJSON-1915243344 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:27:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-09f981a2-c1a7-4f5f-b1b8-3e0fb9fe6bb9 tempest-AttachVolumeTestJSON-1915243344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ff32d504-636c-4127-99ea-aa659321c724 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:27:37 devstack sudo[97427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ff32d504-636c-4127-99ea-aa659321c724 1073741824 Nov 06 15:27:37 devstack sudo[97427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:27:38 devstack sudo[97425]: pam_unix(sudo:session): session closed for user root Nov 06 15:27:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1a1bb075-84a3-4647-825b-3a99ed0285c9 tempest-VolumesListAdminTestJSON-589565954 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-8012df8c-6935-459e-a325-5f9962c2a8d4" returned: 0 in 0.531s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:27:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1a1bb075-84a3-4647-825b-3a99ed0285c9 tempest-VolumesListAdminTestJSON-589565954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-8012df8c-6935-459e-a325-5f9962c2a8d4 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:27:38 devstack sudo[97433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-8012df8c-6935-459e-a325-5f9962c2a8d4 Nov 06 15:27:38 devstack sudo[97433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:27:38 devstack sudo[97433]: pam_unix(sudo:session): session closed for user root Nov 06 15:27:38 devstack sudo[97427]: pam_unix(sudo:session): session closed for user root Nov 06 15:27:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1a1bb075-84a3-4647-825b-3a99ed0285c9 tempest-VolumesListAdminTestJSON-589565954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-8012df8c-6935-459e-a325-5f9962c2a8d4" returned: 0 in 0.320s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:27:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-09f981a2-c1a7-4f5f-b1b8-3e0fb9fe6bb9 tempest-AttachVolumeTestJSON-1915243344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ff32d504-636c-4127-99ea-aa659321c724 1073741824" returned: 0 in 0.652s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:27:38 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-1a1bb075-84a3-4647-825b-3a99ed0285c9 tempest-VolumesListAdminTestJSON-589565954 None] Lock "cinder-quobyte-8012df8c-6935-459e-a325-5f9962c2a8d4" released by "delete_volume" :: held 0.938s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:27:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-09f981a2-c1a7-4f5f-b1b8-3e0fb9fe6bb9 tempest-AttachVolumeTestJSON-1915243344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ff32d504-636c-4127-99ea-aa659321c724 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:27:38 devstack sudo[97439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ff32d504-636c-4127-99ea-aa659321c724 Nov 06 15:27:38 devstack sudo[97439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:27:38 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-1a1bb075-84a3-4647-825b-3a99ed0285c9 tempest-VolumesListAdminTestJSON-589565954 None] Created reservations ['a18d7349-2214-4f6f-806f-6add03c9dd14', '297af559-07f3-4cee-9943-01c29145eb99', 'e7365003-2189-4410-acef-5d0d58c23ed3', 'ff18e8ff-c3d6-4e32-97ed-6dcc4bac2a23'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:27:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1a1bb075-84a3-4647-825b-3a99ed0285c9 tempest-VolumesListAdminTestJSON-589565954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:27:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1a1bb075-84a3-4647-825b-3a99ed0285c9 tempest-VolumesListAdminTestJSON-589565954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:27:38 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1a1bb075-84a3-4647-825b-3a99ed0285c9 tempest-VolumesListAdminTestJSON-589565954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:27:38 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1a1bb075-84a3-4647-825b-3a99ed0285c9 tempest-VolumesListAdminTestJSON-589565954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:27:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1a1bb075-84a3-4647-825b-3a99ed0285c9 tempest-VolumesListAdminTestJSON-589565954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:27:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1a1bb075-84a3-4647-825b-3a99ed0285c9 tempest-VolumesListAdminTestJSON-589565954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:27:38 devstack sudo[97442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:27:38 devstack sudo[97442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:27:38 devstack sudo[97439]: pam_unix(sudo:session): session closed for user root Nov 06 15:27:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-09f981a2-c1a7-4f5f-b1b8-3e0fb9fe6bb9 tempest-AttachVolumeTestJSON-1915243344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ff32d504-636c-4127-99ea-aa659321c724" returned: 0 in 0.322s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:27:38 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-09f981a2-c1a7-4f5f-b1b8-3e0fb9fe6bb9 tempest-AttachVolumeTestJSON-1915243344 None] <== create_volume: return (1084ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:27:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-09f981a2-c1a7-4f5f-b1b8-3e0fb9fe6bb9 tempest-AttachVolumeTestJSON-1915243344 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.088s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:27:38 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-09f981a2-c1a7-4f5f-b1b8-3e0fb9fe6bb9 tempest-AttachVolumeTestJSON-1915243344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96478ad6-7d43-4bc9-a14e-9f2ce4c1527e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff32d504-636c-4127-99ea-aa659321c724', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:27:38 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-09f981a2-c1a7-4f5f-b1b8-3e0fb9fe6bb9 tempest-AttachVolumeTestJSON-1915243344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (532a3107-59bd-477c-9433-8c71f8e2d600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:27:38 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-09f981a2-c1a7-4f5f-b1b8-3e0fb9fe6bb9 tempest-AttachVolumeTestJSON-1915243344 None] Volume volume-ff32d504-636c-4127-99ea-aa659321c724 (ff32d504-636c-4127-99ea-aa659321c724): created successfully Nov 06 15:27:38 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-09f981a2-c1a7-4f5f-b1b8-3e0fb9fe6bb9 tempest-AttachVolumeTestJSON-1915243344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (532a3107-59bd-477c-9433-8c71f8e2d600) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:27:38 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-09f981a2-c1a7-4f5f-b1b8-3e0fb9fe6bb9 tempest-AttachVolumeTestJSON-1915243344 None] Flow 'volume_create_manager' (eea76e98-702e-4cde-bc0c-52a575075947) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:27:38 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-09f981a2-c1a7-4f5f-b1b8-3e0fb9fe6bb9 tempest-AttachVolumeTestJSON-1915243344 None] Created volume successfully. Nov 06 15:27:38 devstack sudo[97442]: pam_unix(sudo:session): session closed for user root Nov 06 15:27:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1a1bb075-84a3-4647-825b-3a99ed0285c9 tempest-VolumesListAdminTestJSON-589565954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.275s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:27:39 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-1a1bb075-84a3-4647-825b-3a99ed0285c9 tempest-VolumesListAdminTestJSON-589565954 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:27:39 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-1a1bb075-84a3-4647-825b-3a99ed0285c9 tempest-VolumesListAdminTestJSON-589565954 None] Deleted volume successfully. Nov 06 15:27:39 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-1a1bb075-84a3-4647-825b-3a99ed0285c9 tempest-VolumesListAdminTestJSON-589565954 None] Lock "cinder-8012df8c-6935-459e-a325-5f9962c2a8d4-delete_volume" released by "delete_volume" :: held 1.781s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:27:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-28af88d5-ebc9-4baa-a428-385339e22e38 req-9d1d20b5-e3f2-43b2-88c1-611351eda0bc tempest-AttachVolumeTestJSON-1915243344 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:27:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-28af88d5-ebc9-4baa-a428-385339e22e38 req-9d1d20b5-e3f2-43b2-88c1-611351eda0bc tempest-AttachVolumeTestJSON-1915243344 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:27:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-28af88d5-ebc9-4baa-a428-385339e22e38 req-9d1d20b5-e3f2-43b2-88c1-611351eda0bc tempest-AttachVolumeTestJSON-1915243344 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:27:40 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-28af88d5-ebc9-4baa-a428-385339e22e38 req-9d1d20b5-e3f2-43b2-88c1-611351eda0bc tempest-AttachVolumeTestJSON-1915243344 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b', 'name': 'volume-ff32d504-636c-4127-99ea-aa659321c724', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '000599e1-8f45-4321-af73-7e8aa53ce77d', 'enforce_multipath': True} {{(pid=87132) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 15:27:40 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-28af88d5-ebc9-4baa-a428-385339e22e38 req-9d1d20b5-e3f2-43b2-88c1-611351eda0bc tempest-AttachVolumeTestJSON-1915243344 None] attachment_update completed successfully. Nov 06 15:27:50 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:SELECT=44,cinder:UPDATE=55,cinder:DELETE=5,cinder:INSERT=15 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 15:27:50 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:UPDATE=63,cinder:INSERT=14,cinder:SELECT=49,cinder:DELETE=5 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 15:27:52 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-c466ea90-f171-4c5e-a552-d1785861f5f6 tempest-VolumesImageMetadata-1249996354 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:27:52 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c466ea90-f171-4c5e-a552-d1785861f5f6 tempest-VolumesImageMetadata-1249996354 None] Flow 'volume_create_manager' (aa095a66-daea-4f04-8e25-b23bc96d209f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:27:52 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c466ea90-f171-4c5e-a552-d1785861f5f6 tempest-VolumesImageMetadata-1249996354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d561aa48-12a2-45d6-a9cd-6979dfb24f92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:27:52 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c466ea90-f171-4c5e-a552-d1785861f5f6 tempest-VolumesImageMetadata-1249996354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d561aa48-12a2-45d6-a9cd-6979dfb24f92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:27:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-875775096',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=339bcb58-6a8c-43f7-ae6e-a8da39d3c272,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e11a53021d348cbac02da3e46eb0872',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:27:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:27:53Z,use_quota=True,user_id='4d848214266344f494b1bb0f1e1059b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:27:52 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c466ea90-f171-4c5e-a552-d1785861f5f6 tempest-VolumesImageMetadata-1249996354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c965230-4a16-4ca1-8ffe-bcadb4446f34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:27:52 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c466ea90-f171-4c5e-a552-d1785861f5f6 tempest-VolumesImageMetadata-1249996354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c965230-4a16-4ca1-8ffe-bcadb4446f34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:27:52 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c466ea90-f171-4c5e-a552-d1785861f5f6 tempest-VolumesImageMetadata-1249996354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (547e2568-0a85-4d7c-868e-a47892025b33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:27:52 devstack cinder-volume[87132]: DEBUG cinder.image.glance [None req-c466ea90-f171-4c5e-a552-d1785861f5f6 tempest-VolumesImageMetadata-1249996354 None] Creating Keystone auth plugin from conf {{(pid=87132) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 06 15:27:53 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c466ea90-f171-4c5e-a552-d1785861f5f6 tempest-VolumesImageMetadata-1249996354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (547e2568-0a85-4d7c-868e-a47892025b33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '339bcb58-6a8c-43f7-ae6e-a8da39d3c272', 'volume_name': 'volume-339bcb58-6a8c-43f7-ae6e-a8da39d3c272', 'volume_size': 1, 'image_id': '3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c02e84193ee841ccb304f909f5951fd0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83', 'created_at': datetime.datetime(2026, 11, 6, 14, 12, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 14, 12, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:27:53 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c466ea90-f171-4c5e-a552-d1785861f5f6 tempest-VolumesImageMetadata-1249996354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e3fa043-f170-4ec7-99fd-db5e030d3cc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:27:53 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c466ea90-f171-4c5e-a552-d1785861f5f6 tempest-VolumesImageMetadata-1249996354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e3fa043-f170-4ec7-99fd-db5e030d3cc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:27:53 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c466ea90-f171-4c5e-a552-d1785861f5f6 tempest-VolumesImageMetadata-1249996354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bef64f6-be21-454a-989c-d4181c7b9a8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:27:53 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-c466ea90-f171-4c5e-a552-d1785861f5f6 tempest-VolumesImageMetadata-1249996354 None] Volume 339bcb58-6a8c-43f7-ae6e-a8da39d3c272: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-339bcb58-6a8c-43f7-ae6e-a8da39d3c272', 'volume_size': 1, 'image_id': '3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c02e84193ee841ccb304f909f5951fd0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83', 'created_at': datetime.datetime(2026, 11, 6, 14, 12, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 14, 12, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 06 15:27:53 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-c466ea90-f171-4c5e-a552-d1785861f5f6 tempest-VolumesImageMetadata-1249996354 None] Trying to clone 339bcb58-6a8c-43f7-ae6e-a8da39d3c272 from image 3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83 at location (None, [{'url': 'file:///opt/stack/data/glance/images/3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83', 'metadata': {}}]). {{(pid=87132) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 06 15:27:53 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-c466ea90-f171-4c5e-a552-d1785861f5f6 tempest-VolumesImageMetadata-1249996354 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83_p5y783xidevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87132) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 06 15:27:53 devstack cinder-volume[87132]: INFO cinder.image.image_utils [None req-c466ea90-f171-4c5e-a552-d1785861f5f6 tempest-VolumesImageMetadata-1249996354 None] Image download 20.69 MB at 20.69 MB/s Nov 06 15:27:53 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d1144ab-4cca-4877-9120-8751391daaa2]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:27:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c466ea90-f171-4c5e-a552-d1785861f5f6 tempest-VolumesImageMetadata-1249996354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83_p5y783xidevstack@QuobyteHD {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:27:53 devstack sudo[98428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83_p5y783xidevstack@QuobyteHD Nov 06 15:27:53 devstack sudo[98428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:27:54 devstack sudo[98428]: pam_unix(sudo:session): session closed for user root Nov 06 15:27:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c466ea90-f171-4c5e-a552-d1785861f5f6 tempest-VolumesImageMetadata-1249996354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83_p5y783xidevstack@QuobyteHD" returned: 0 in 0.442s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:27:54 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-c466ea90-f171-4c5e-a552-d1785861f5f6 tempest-VolumesImageMetadata-1249996354 None] Temporary image 3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83 is fetched for user 4d848214266344f494b1bb0f1e1059b8. {{(pid=87132) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 06 15:27:54 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[abdd5346-0f31-48d6-8c6b-a46ea284fa41]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:27:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c466ea90-f171-4c5e-a552-d1785861f5f6 tempest-VolumesImageMetadata-1249996354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83_p5y783xidevstack@QuobyteHD {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:27:54 devstack sudo[98433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83_p5y783xidevstack@QuobyteHD Nov 06 15:27:54 devstack sudo[98433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:27:54 devstack sudo[98433]: pam_unix(sudo:session): session closed for user root Nov 06 15:27:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c466ea90-f171-4c5e-a552-d1785861f5f6 tempest-VolumesImageMetadata-1249996354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83_p5y783xidevstack@QuobyteHD" returned: 0 in 0.748s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:27:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c466ea90-f171-4c5e-a552-d1785861f5f6 tempest-VolumesImageMetadata-1249996354 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:27:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c466ea90-f171-4c5e-a552-d1785861f5f6 tempest-VolumesImageMetadata-1249996354 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:27:54 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c466ea90-f171-4c5e-a552-d1785861f5f6 tempest-VolumesImageMetadata-1249996354 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:27:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-875775096',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=339bcb58-6a8c-43f7-ae6e-a8da39d3c272,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e11a53021d348cbac02da3e46eb0872',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:27:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:27:53Z,use_quota=True,user_id='4d848214266344f494b1bb0f1e1059b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:27:54 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-c466ea90-f171-4c5e-a552-d1785861f5f6 tempest-VolumesImageMetadata-1249996354 None] Creating volume 339bcb58-6a8c-43f7-ae6e-a8da39d3c272 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:27:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c466ea90-f171-4c5e-a552-d1785861f5f6 tempest-VolumesImageMetadata-1249996354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:27:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c466ea90-f171-4c5e-a552-d1785861f5f6 tempest-VolumesImageMetadata-1249996354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:27:54 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c466ea90-f171-4c5e-a552-d1785861f5f6 tempest-VolumesImageMetadata-1249996354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:27:54 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c466ea90-f171-4c5e-a552-d1785861f5f6 tempest-VolumesImageMetadata-1249996354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:27:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c466ea90-f171-4c5e-a552-d1785861f5f6 tempest-VolumesImageMetadata-1249996354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:27:54 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c466ea90-f171-4c5e-a552-d1785861f5f6 tempest-VolumesImageMetadata-1249996354 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:27:54 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-c466ea90-f171-4c5e-a552-d1785861f5f6 tempest-VolumesImageMetadata-1249996354 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:27:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c466ea90-f171-4c5e-a552-d1785861f5f6 tempest-VolumesImageMetadata-1249996354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-339bcb58-6a8c-43f7-ae6e-a8da39d3c272 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:27:54 devstack sudo[98472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-339bcb58-6a8c-43f7-ae6e-a8da39d3c272 1073741824 Nov 06 15:27:55 devstack sudo[98472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:27:55 devstack sudo[98472]: pam_unix(sudo:session): session closed for user root Nov 06 15:27:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c466ea90-f171-4c5e-a552-d1785861f5f6 tempest-VolumesImageMetadata-1249996354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-339bcb58-6a8c-43f7-ae6e-a8da39d3c272 1073741824" returned: 0 in 0.752s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:27:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c466ea90-f171-4c5e-a552-d1785861f5f6 tempest-VolumesImageMetadata-1249996354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-339bcb58-6a8c-43f7-ae6e-a8da39d3c272 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:27:55 devstack sudo[98480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-339bcb58-6a8c-43f7-ae6e-a8da39d3c272 Nov 06 15:27:55 devstack sudo[98480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:27:56 devstack sudo[98480]: pam_unix(sudo:session): session closed for user root Nov 06 15:27:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c466ea90-f171-4c5e-a552-d1785861f5f6 tempest-VolumesImageMetadata-1249996354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-339bcb58-6a8c-43f7-ae6e-a8da39d3c272" returned: 0 in 0.290s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:27:56 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c466ea90-f171-4c5e-a552-d1785861f5f6 tempest-VolumesImageMetadata-1249996354 None] <== create_volume: return (1148ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:27:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c466ea90-f171-4c5e-a552-d1785861f5f6 tempest-VolumesImageMetadata-1249996354 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.159s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:27:56 devstack cinder-volume[87132]: DEBUG cinder.volume.volume_utils [None req-c466ea90-f171-4c5e-a552-d1785861f5f6 tempest-VolumesImageMetadata-1249996354 None] Attempting download of 3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83 ((None, [{'url': 'file:///opt/stack/data/glance/images/3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83', 'metadata': {}}])) to volume 339bcb58-6a8c-43f7-ae6e-a8da39d3c272. {{(pid=87132) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 06 15:27:56 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ca73664-7a9d-457a-acd8-74f66ee41a96]: (4, 'raw') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:27:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c466ea90-f171-4c5e-a552-d1785861f5f6 tempest-VolumesImageMetadata-1249996354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83_azznv8o9 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:27:56 devstack sudo[98483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83_azznv8o9 Nov 06 15:27:56 devstack sudo[98483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:27:56 devstack sudo[98483]: pam_unix(sudo:session): session closed for user root Nov 06 15:27:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c466ea90-f171-4c5e-a552-d1785861f5f6 tempest-VolumesImageMetadata-1249996354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83_azznv8o9" returned: 0 in 0.359s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:27:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c466ea90-f171-4c5e-a552-d1785861f5f6 tempest-VolumesImageMetadata-1249996354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83_azznv8o9 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:27:56 devstack sudo[98487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83_azznv8o9 Nov 06 15:27:56 devstack sudo[98487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:27:56 devstack sudo[98487]: pam_unix(sudo:session): session closed for user root Nov 06 15:27:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c466ea90-f171-4c5e-a552-d1785861f5f6 tempest-VolumesImageMetadata-1249996354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83_azznv8o9" returned: 1 in 0.377s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:27:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c466ea90-f171-4c5e-a552-d1785861f5f6 tempest-VolumesImageMetadata-1249996354 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83_azznv8o9' failed. Not Retrying. {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 15:27:56 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[7355b219-0c72-491e-870a-91cfa929ac89]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:27:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c466ea90-f171-4c5e-a552-d1785861f5f6 tempest-VolumesImageMetadata-1249996354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83_p5y783xidevstack@QuobyteHD {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:27:57 devstack sudo[98491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83_p5y783xidevstack@QuobyteHD Nov 06 15:27:57 devstack sudo[98491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:27:57 devstack sudo[98491]: pam_unix(sudo:session): session closed for user root Nov 06 15:27:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c466ea90-f171-4c5e-a552-d1785861f5f6 tempest-VolumesImageMetadata-1249996354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83_p5y783xidevstack@QuobyteHD" returned: 0 in 0.395s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:27:57 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-c466ea90-f171-4c5e-a552-d1785861f5f6 tempest-VolumesImageMetadata-1249996354 None] 3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83 was qcow2, converting to qcow2 {{(pid=87132) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 06 15:27:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c466ea90-f171-4c5e-a552-d1785861f5f6 tempest-VolumesImageMetadata-1249996354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83_p5y783xidevstack@QuobyteHD /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-339bcb58-6a8c-43f7-ae6e-a8da39d3c272 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:27:57 devstack sudo[98496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83_p5y783xidevstack@QuobyteHD /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-339bcb58-6a8c-43f7-ae6e-a8da39d3c272 Nov 06 15:27:57 devstack sudo[98496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:27:59 devstack sudo[98496]: pam_unix(sudo:session): session closed for user root Nov 06 15:27:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c466ea90-f171-4c5e-a552-d1785861f5f6 tempest-VolumesImageMetadata-1249996354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83_p5y783xidevstack@QuobyteHD /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-339bcb58-6a8c-43f7-ae6e-a8da39d3c272" returned: 0 in 2.218s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:27:59 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-c466ea90-f171-4c5e-a552-d1785861f5f6 tempest-VolumesImageMetadata-1249996354 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83_p5y783xidevstack@QuobyteHD, size 112.00 MB, duration 2.22 sec, destination /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-339bcb58-6a8c-43f7-ae6e-a8da39d3c272 {{(pid=87132) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 06 15:27:59 devstack cinder-volume[87132]: INFO cinder.image.image_utils [None req-c466ea90-f171-4c5e-a552-d1785861f5f6 tempest-VolumesImageMetadata-1249996354 None] Converted 112.00 MB image at 50.44 MB/s Nov 06 15:27:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c466ea90-f171-4c5e-a552-d1785861f5f6 tempest-VolumesImageMetadata-1249996354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-339bcb58-6a8c-43f7-ae6e-a8da39d3c272 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:27:59 devstack sudo[98512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-339bcb58-6a8c-43f7-ae6e-a8da39d3c272 1G Nov 06 15:27:59 devstack sudo[98512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:27:59 devstack sudo[98512]: pam_unix(sudo:session): session closed for user root Nov 06 15:27:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c466ea90-f171-4c5e-a552-d1785861f5f6 tempest-VolumesImageMetadata-1249996354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-339bcb58-6a8c-43f7-ae6e-a8da39d3c272 1G" returned: 0 in 0.413s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:27:59 devstack cinder-volume[87132]: DEBUG cinder.volume.volume_utils [None req-c466ea90-f171-4c5e-a552-d1785861f5f6 tempest-VolumesImageMetadata-1249996354 None] Downloaded image 3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83 ((None, [{'url': 'file:///opt/stack/data/glance/images/3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83', 'metadata': {}}])) to volume 339bcb58-6a8c-43f7-ae6e-a8da39d3c272 successfully. {{(pid=87132) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 06 15:27:59 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-c466ea90-f171-4c5e-a552-d1785861f5f6 tempest-VolumesImageMetadata-1249996354 None] Temporary image 3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83 for user 4d848214266344f494b1bb0f1e1059b8 is deleted. {{(pid=87132) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 06 15:27:59 devstack cinder-volume[87132]: DEBUG cinder.volume.volume_utils [None req-c466ea90-f171-4c5e-a552-d1785861f5f6 tempest-VolumesImageMetadata-1249996354 None] Marking volume 339bcb58-6a8c-43f7-ae6e-a8da39d3c272 as bootable. {{(pid=87132) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 06 15:27:59 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-c466ea90-f171-4c5e-a552-d1785861f5f6 tempest-VolumesImageMetadata-1249996354 None] Copying metadata from image 3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83 to 339bcb58-6a8c-43f7-ae6e-a8da39d3c272. {{(pid=87132) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 06 15:27:59 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-c466ea90-f171-4c5e-a552-d1785861f5f6 tempest-VolumesImageMetadata-1249996354 None] Creating volume glance metadata for volume 339bcb58-6a8c-43f7-ae6e-a8da39d3c272 backed by image 3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87132) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 06 15:28:00 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c466ea90-f171-4c5e-a552-d1785861f5f6 tempest-VolumesImageMetadata-1249996354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bef64f6-be21-454a-989c-d4181c7b9a8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-339bcb58-6a8c-43f7-ae6e-a8da39d3c272', 'volume_size': 1, 'image_id': '3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c02e84193ee841ccb304f909f5951fd0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83', 'created_at': datetime.datetime(2026, 11, 6, 14, 12, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 14, 12, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:28:00 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c466ea90-f171-4c5e-a552-d1785861f5f6 tempest-VolumesImageMetadata-1249996354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb639a8e-600e-495b-ba54-cfeef2b17e63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:28:00 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-c466ea90-f171-4c5e-a552-d1785861f5f6 tempest-VolumesImageMetadata-1249996354 None] Volume volume-339bcb58-6a8c-43f7-ae6e-a8da39d3c272 (339bcb58-6a8c-43f7-ae6e-a8da39d3c272): created successfully Nov 06 15:28:00 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c466ea90-f171-4c5e-a552-d1785861f5f6 tempest-VolumesImageMetadata-1249996354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb639a8e-600e-495b-ba54-cfeef2b17e63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:28:00 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c466ea90-f171-4c5e-a552-d1785861f5f6 tempest-VolumesImageMetadata-1249996354 None] Flow 'volume_create_manager' (aa095a66-daea-4f04-8e25-b23bc96d209f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:28:00 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-c466ea90-f171-4c5e-a552-d1785861f5f6 tempest-VolumesImageMetadata-1249996354 None] Created volume successfully. Nov 06 15:28:01 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-5ca8726d-3a83-4371-80f2-a0ece2d5a017 tempest-VolumesImageMetadata-1249996354 None] Acquiring lock "cinder-339bcb58-6a8c-43f7-ae6e-a8da39d3c272-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:28:01 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-5ca8726d-3a83-4371-80f2-a0ece2d5a017 tempest-VolumesImageMetadata-1249996354 None] Lock "cinder-339bcb58-6a8c-43f7-ae6e-a8da39d3c272-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:28:01 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-5ca8726d-3a83-4371-80f2-a0ece2d5a017 tempest-VolumesImageMetadata-1249996354 None] Acquiring lock "cinder-quobyte-339bcb58-6a8c-43f7-ae6e-a8da39d3c272" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:28:01 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-5ca8726d-3a83-4371-80f2-a0ece2d5a017 tempest-VolumesImageMetadata-1249996354 None] Lock "cinder-quobyte-339bcb58-6a8c-43f7-ae6e-a8da39d3c272" acquired by "delete_volume" :: waited 0.032s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:28:01 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[52c0a307-cb1d-46b7-8eb3-deda8c7b88cd]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:28:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5ca8726d-3a83-4371-80f2-a0ece2d5a017 tempest-VolumesImageMetadata-1249996354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-339bcb58-6a8c-43f7-ae6e-a8da39d3c272 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:28:01 devstack sudo[98542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-339bcb58-6a8c-43f7-ae6e-a8da39d3c272 Nov 06 15:28:01 devstack sudo[98542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:28:01 devstack sudo[98542]: pam_unix(sudo:session): session closed for user root Nov 06 15:28:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5ca8726d-3a83-4371-80f2-a0ece2d5a017 tempest-VolumesImageMetadata-1249996354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-339bcb58-6a8c-43f7-ae6e-a8da39d3c272" returned: 0 in 0.427s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:28:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5ca8726d-3a83-4371-80f2-a0ece2d5a017 tempest-VolumesImageMetadata-1249996354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-339bcb58-6a8c-43f7-ae6e-a8da39d3c272 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:28:01 devstack sudo[98547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-339bcb58-6a8c-43f7-ae6e-a8da39d3c272 Nov 06 15:28:01 devstack sudo[98547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:28:02 devstack sudo[98547]: pam_unix(sudo:session): session closed for user root Nov 06 15:28:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5ca8726d-3a83-4371-80f2-a0ece2d5a017 tempest-VolumesImageMetadata-1249996354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-339bcb58-6a8c-43f7-ae6e-a8da39d3c272" returned: 0 in 0.348s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:28:02 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-5ca8726d-3a83-4371-80f2-a0ece2d5a017 tempest-VolumesImageMetadata-1249996354 None] Lock "cinder-quobyte-339bcb58-6a8c-43f7-ae6e-a8da39d3c272" released by "delete_volume" :: held 0.891s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:28:02 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-5ca8726d-3a83-4371-80f2-a0ece2d5a017 tempest-VolumesImageMetadata-1249996354 None] Created reservations ['e6c4a5d0-30dc-4bc4-a8c4-1cece612fb09', 'a6fbda9c-0dc5-4be7-8940-b545b55a055d', 'bbade036-7d51-48a4-a26f-da88097aa289', '5714f8e3-ac33-44cf-80e8-5df4cbb72833'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:28:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5ca8726d-3a83-4371-80f2-a0ece2d5a017 tempest-VolumesImageMetadata-1249996354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:28:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5ca8726d-3a83-4371-80f2-a0ece2d5a017 tempest-VolumesImageMetadata-1249996354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:28:02 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-5ca8726d-3a83-4371-80f2-a0ece2d5a017 tempest-VolumesImageMetadata-1249996354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:28:02 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-5ca8726d-3a83-4371-80f2-a0ece2d5a017 tempest-VolumesImageMetadata-1249996354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:28:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5ca8726d-3a83-4371-80f2-a0ece2d5a017 tempest-VolumesImageMetadata-1249996354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:28:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5ca8726d-3a83-4371-80f2-a0ece2d5a017 tempest-VolumesImageMetadata-1249996354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:28:02 devstack sudo[98561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:28:02 devstack sudo[98561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:28:02 devstack sudo[98561]: pam_unix(sudo:session): session closed for user root Nov 06 15:28:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5ca8726d-3a83-4371-80f2-a0ece2d5a017 tempest-VolumesImageMetadata-1249996354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.377s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:28:02 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-5ca8726d-3a83-4371-80f2-a0ece2d5a017 tempest-VolumesImageMetadata-1249996354 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:28:02 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-5ca8726d-3a83-4371-80f2-a0ece2d5a017 tempest-VolumesImageMetadata-1249996354 None] Deleted volume successfully. Nov 06 15:28:02 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-5ca8726d-3a83-4371-80f2-a0ece2d5a017 tempest-VolumesImageMetadata-1249996354 None] Lock "cinder-339bcb58-6a8c-43f7-ae6e-a8da39d3c272-delete_volume" released by "delete_volume" :: held 1.615s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:28:06 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f599d3d-ae2f-4277-9eee-e77d932751c0 tempest-VolumesDeleteCascade-1403262175 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:28:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7f599d3d-ae2f-4277-9eee-e77d932751c0 tempest-VolumesDeleteCascade-1403262175 None] Flow 'volume_create_manager' (a926ff8b-fdae-4a45-968a-436678929471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:28:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7f599d3d-ae2f-4277-9eee-e77d932751c0 tempest-VolumesDeleteCascade-1403262175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5218ee8-2ec5-4dc7-9764-f667f3031987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:28:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7f599d3d-ae2f-4277-9eee-e77d932751c0 tempest-VolumesDeleteCascade-1403262175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5218ee8-2ec5-4dc7-9764-f667f3031987) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:28:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-844494638',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb0644e7-c2b7-435a-85b2-8f304055770a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f57e170f84984d9c83c6f0e97da1b798',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:28:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:28:06Z,use_quota=True,user_id='fe984252e48341f38328889e12dee7dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:28:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7f599d3d-ae2f-4277-9eee-e77d932751c0 tempest-VolumesDeleteCascade-1403262175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb558e20-146e-445d-9dff-cbaa5abe3705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:28:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7f599d3d-ae2f-4277-9eee-e77d932751c0 tempest-VolumesDeleteCascade-1403262175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb558e20-146e-445d-9dff-cbaa5abe3705) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:28:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7f599d3d-ae2f-4277-9eee-e77d932751c0 tempest-VolumesDeleteCascade-1403262175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12544011-4a3a-43ea-8f18-3e1a71847277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:28:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7f599d3d-ae2f-4277-9eee-e77d932751c0 tempest-VolumesDeleteCascade-1403262175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12544011-4a3a-43ea-8f18-3e1a71847277) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb0644e7-c2b7-435a-85b2-8f304055770a', 'volume_name': 'volume-cb0644e7-c2b7-435a-85b2-8f304055770a', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:28:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7f599d3d-ae2f-4277-9eee-e77d932751c0 tempest-VolumesDeleteCascade-1403262175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e95655e2-3da4-49d0-9bc8-76c764400d02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:28:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7f599d3d-ae2f-4277-9eee-e77d932751c0 tempest-VolumesDeleteCascade-1403262175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e95655e2-3da4-49d0-9bc8-76c764400d02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:28:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7f599d3d-ae2f-4277-9eee-e77d932751c0 tempest-VolumesDeleteCascade-1403262175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38db4902-17ea-4b06-901c-bf57b86039a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:28:06 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-7f599d3d-ae2f-4277-9eee-e77d932751c0 tempest-VolumesDeleteCascade-1403262175 None] Volume cb0644e7-c2b7-435a-85b2-8f304055770a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb0644e7-c2b7-435a-85b2-8f304055770a', 'volume_size': 1} Nov 06 15:28:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7f599d3d-ae2f-4277-9eee-e77d932751c0 tempest-VolumesDeleteCascade-1403262175 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:28:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7f599d3d-ae2f-4277-9eee-e77d932751c0 tempest-VolumesDeleteCascade-1403262175 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:28:06 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-7f599d3d-ae2f-4277-9eee-e77d932751c0 tempest-VolumesDeleteCascade-1403262175 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:28:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-844494638',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb0644e7-c2b7-435a-85b2-8f304055770a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f57e170f84984d9c83c6f0e97da1b798',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:28:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:28:06Z,use_quota=True,user_id='fe984252e48341f38328889e12dee7dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:28:06 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-7f599d3d-ae2f-4277-9eee-e77d932751c0 tempest-VolumesDeleteCascade-1403262175 None] Creating volume cb0644e7-c2b7-435a-85b2-8f304055770a {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:28:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7f599d3d-ae2f-4277-9eee-e77d932751c0 tempest-VolumesDeleteCascade-1403262175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:28:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7f599d3d-ae2f-4277-9eee-e77d932751c0 tempest-VolumesDeleteCascade-1403262175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:28:06 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-7f599d3d-ae2f-4277-9eee-e77d932751c0 tempest-VolumesDeleteCascade-1403262175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:28:06 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-7f599d3d-ae2f-4277-9eee-e77d932751c0 tempest-VolumesDeleteCascade-1403262175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:28:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7f599d3d-ae2f-4277-9eee-e77d932751c0 tempest-VolumesDeleteCascade-1403262175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:28:06 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-7f599d3d-ae2f-4277-9eee-e77d932751c0 tempest-VolumesDeleteCascade-1403262175 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:28:06 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-7f599d3d-ae2f-4277-9eee-e77d932751c0 tempest-VolumesDeleteCascade-1403262175 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:28:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7f599d3d-ae2f-4277-9eee-e77d932751c0 tempest-VolumesDeleteCascade-1403262175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-cb0644e7-c2b7-435a-85b2-8f304055770a 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:28:06 devstack sudo[98590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-cb0644e7-c2b7-435a-85b2-8f304055770a 1073741824 Nov 06 15:28:06 devstack sudo[98590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:28:07 devstack sudo[98590]: pam_unix(sudo:session): session closed for user root Nov 06 15:28:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7f599d3d-ae2f-4277-9eee-e77d932751c0 tempest-VolumesDeleteCascade-1403262175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-cb0644e7-c2b7-435a-85b2-8f304055770a 1073741824" returned: 0 in 0.568s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:28:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7f599d3d-ae2f-4277-9eee-e77d932751c0 tempest-VolumesDeleteCascade-1403262175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-cb0644e7-c2b7-435a-85b2-8f304055770a {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:28:07 devstack sudo[98600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-cb0644e7-c2b7-435a-85b2-8f304055770a Nov 06 15:28:07 devstack sudo[98600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:28:07 devstack sudo[98600]: pam_unix(sudo:session): session closed for user root Nov 06 15:28:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7f599d3d-ae2f-4277-9eee-e77d932751c0 tempest-VolumesDeleteCascade-1403262175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-cb0644e7-c2b7-435a-85b2-8f304055770a" returned: 0 in 0.313s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:28:07 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-7f599d3d-ae2f-4277-9eee-e77d932751c0 tempest-VolumesDeleteCascade-1403262175 None] <== create_volume: return (937ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:28:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7f599d3d-ae2f-4277-9eee-e77d932751c0 tempest-VolumesDeleteCascade-1403262175 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.940s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:28:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7f599d3d-ae2f-4277-9eee-e77d932751c0 tempest-VolumesDeleteCascade-1403262175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38db4902-17ea-4b06-901c-bf57b86039a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb0644e7-c2b7-435a-85b2-8f304055770a', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:28:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7f599d3d-ae2f-4277-9eee-e77d932751c0 tempest-VolumesDeleteCascade-1403262175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd52b732-d566-4071-acfd-bbb2f4050c95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:28:07 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-7f599d3d-ae2f-4277-9eee-e77d932751c0 tempest-VolumesDeleteCascade-1403262175 None] Volume volume-cb0644e7-c2b7-435a-85b2-8f304055770a (cb0644e7-c2b7-435a-85b2-8f304055770a): created successfully Nov 06 15:28:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7f599d3d-ae2f-4277-9eee-e77d932751c0 tempest-VolumesDeleteCascade-1403262175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd52b732-d566-4071-acfd-bbb2f4050c95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:28:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7f599d3d-ae2f-4277-9eee-e77d932751c0 tempest-VolumesDeleteCascade-1403262175 None] Flow 'volume_create_manager' (a926ff8b-fdae-4a45-968a-436678929471) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:28:07 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-7f599d3d-ae2f-4277-9eee-e77d932751c0 tempest-VolumesDeleteCascade-1403262175 None] Created volume successfully. Nov 06 15:28:08 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 15:28:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:28:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:28:08 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:28:08 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:28:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:28:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:28:08 devstack sudo[98614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:28:08 devstack sudo[98614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:28:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-a4031d1b-afaf-43f9-bec4-adb1a70983a8 req-d2cb6122-f0a4-4c82-b5d4-6564f9d6963d tempest-TestStampPattern-2123587362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:28:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-a4031d1b-afaf-43f9-bec4-adb1a70983a8 req-d2cb6122-f0a4-4c82-b5d4-6564f9d6963d tempest-TestStampPattern-2123587362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:28:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-a4031d1b-afaf-43f9-bec4-adb1a70983a8 req-d2cb6122-f0a4-4c82-b5d4-6564f9d6963d tempest-TestStampPattern-2123587362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:28:08 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-a4031d1b-afaf-43f9-bec4-adb1a70983a8 req-d2cb6122-f0a4-4c82-b5d4-6564f9d6963d tempest-TestStampPattern-2123587362 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b', 'name': 'volume-9a8ebbbf-037d-41a7-b9ed-a4f47c62589f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a7090753-ef6a-4bb7-8c83-263c20f0c03a', 'enforce_multipath': True} {{(pid=87132) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 15:28:08 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-a4031d1b-afaf-43f9-bec4-adb1a70983a8 req-d2cb6122-f0a4-4c82-b5d4-6564f9d6963d tempest-TestStampPattern-2123587362 None] attachment_update completed successfully. Nov 06 15:28:08 devstack sudo[98614]: pam_unix(sudo:session): session closed for user root Nov 06 15:28:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.284s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:28:08 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:28:08 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Running periodic task VolumeManager._thread_info {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 15:28:08 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] thread count: 28 {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 15:28:08 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] thread info: [<_MainThread(MainThread, started 140011251929216)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 06 15:28:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6efc754c-25d5-4c87-88fe-d53a6850cd56 tempest-VolumesDeleteCascade-1403262175 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:28:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6efc754c-25d5-4c87-88fe-d53a6850cd56 tempest-VolumesDeleteCascade-1403262175 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:28:09 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-6efc754c-25d5-4c87-88fe-d53a6850cd56 tempest-VolumesDeleteCascade-1403262175 None] Creating offline snapshot 8809053b-d059-4b94-b6fd-f604d0bef2c7 of volume cb0644e7-c2b7-435a-85b2-8f304055770a {{(pid=87132) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 15:28:09 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[985bf4f9-ac17-41c4-a681-1c33d4a666bc]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:28:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6efc754c-25d5-4c87-88fe-d53a6850cd56 tempest-VolumesDeleteCascade-1403262175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-cb0644e7-c2b7-435a-85b2-8f304055770a {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:28:09 devstack sudo[98621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-cb0644e7-c2b7-435a-85b2-8f304055770a Nov 06 15:28:09 devstack sudo[98621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:28:09 devstack sudo[98621]: pam_unix(sudo:session): session closed for user root Nov 06 15:28:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6efc754c-25d5-4c87-88fe-d53a6850cd56 tempest-VolumesDeleteCascade-1403262175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-cb0644e7-c2b7-435a-85b2-8f304055770a" returned: 0 in 0.458s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:28:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6efc754c-25d5-4c87-88fe-d53a6850cd56 tempest-VolumesDeleteCascade-1403262175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-cb0644e7-c2b7-435a-85b2-8f304055770a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-cb0644e7-c2b7-435a-85b2-8f304055770a.8809053b-d059-4b94-b6fd-f604d0bef2c7 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:28:09 devstack sudo[98636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-cb0644e7-c2b7-435a-85b2-8f304055770a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-cb0644e7-c2b7-435a-85b2-8f304055770a.8809053b-d059-4b94-b6fd-f604d0bef2c7 1G Nov 06 15:28:09 devstack sudo[98636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:28:10 devstack sudo[98636]: pam_unix(sudo:session): session closed for user root Nov 06 15:28:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6efc754c-25d5-4c87-88fe-d53a6850cd56 tempest-VolumesDeleteCascade-1403262175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-cb0644e7-c2b7-435a-85b2-8f304055770a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-cb0644e7-c2b7-435a-85b2-8f304055770a.8809053b-d059-4b94-b6fd-f604d0bef2c7 1G" returned: 0 in 0.519s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:28:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6efc754c-25d5-4c87-88fe-d53a6850cd56 tempest-VolumesDeleteCascade-1403262175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb0644e7-c2b7-435a-85b2-8f304055770a -F qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-cb0644e7-c2b7-435a-85b2-8f304055770a.8809053b-d059-4b94-b6fd-f604d0bef2c7 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:28:10 devstack sudo[98646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb0644e7-c2b7-435a-85b2-8f304055770a -F qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-cb0644e7-c2b7-435a-85b2-8f304055770a.8809053b-d059-4b94-b6fd-f604d0bef2c7 Nov 06 15:28:10 devstack sudo[98646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:28:10 devstack sudo[98646]: pam_unix(sudo:session): session closed for user root Nov 06 15:28:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6efc754c-25d5-4c87-88fe-d53a6850cd56 tempest-VolumesDeleteCascade-1403262175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb0644e7-c2b7-435a-85b2-8f304055770a -F qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-cb0644e7-c2b7-435a-85b2-8f304055770a.8809053b-d059-4b94-b6fd-f604d0bef2c7" returned: 0 in 0.487s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:28:10 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-6efc754c-25d5-4c87-88fe-d53a6850cd56 tempest-VolumesDeleteCascade-1403262175 None] /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-cb0644e7-c2b7-435a-85b2-8f304055770a.8809053b-d059-4b94-b6fd-f604d0bef2c7 is being set with open permissions: ugo+rw Nov 06 15:28:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6efc754c-25d5-4c87-88fe-d53a6850cd56 tempest-VolumesDeleteCascade-1403262175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-cb0644e7-c2b7-435a-85b2-8f304055770a.8809053b-d059-4b94-b6fd-f604d0bef2c7 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:28:10 devstack sudo[98652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-cb0644e7-c2b7-435a-85b2-8f304055770a.8809053b-d059-4b94-b6fd-f604d0bef2c7 Nov 06 15:28:10 devstack sudo[98652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:28:10 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-99cbce4d-51b4-470d-a2da-99a2ac0276e9 req-2dd88992-a9ad-41a0-850f-f889d5abde2a tempest-TestStampPattern-2123587362 None] Terminate volume connection completed successfully. Nov 06 15:28:10 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-99cbce4d-51b4-470d-a2da-99a2ac0276e9 req-2dd88992-a9ad-41a0-850f-f889d5abde2a tempest-TestStampPattern-2123587362 None] Deleting attachment a7090753-ef6a-4bb7-8c83-263c20f0c03a. {{(pid=87132) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 06 15:28:10 devstack sudo[98652]: pam_unix(sudo:session): session closed for user root Nov 06 15:28:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6efc754c-25d5-4c87-88fe-d53a6850cd56 tempest-VolumesDeleteCascade-1403262175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-cb0644e7-c2b7-435a-85b2-8f304055770a.8809053b-d059-4b94-b6fd-f604d0bef2c7" returned: 0 in 0.319s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:28:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6efc754c-25d5-4c87-88fe-d53a6850cd56 tempest-VolumesDeleteCascade-1403262175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-cb0644e7-c2b7-435a-85b2-8f304055770a.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:28:10 devstack sudo[98657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-cb0644e7-c2b7-435a-85b2-8f304055770a.info Nov 06 15:28:10 devstack sudo[98657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:28:11 devstack sudo[98657]: pam_unix(sudo:session): session closed for user root Nov 06 15:28:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6efc754c-25d5-4c87-88fe-d53a6850cd56 tempest-VolumesDeleteCascade-1403262175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-cb0644e7-c2b7-435a-85b2-8f304055770a.info" returned: 0 in 0.332s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:28:11 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-6efc754c-25d5-4c87-88fe-d53a6850cd56 tempest-VolumesDeleteCascade-1403262175 None] /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-cb0644e7-c2b7-435a-85b2-8f304055770a.info is being set with open permissions: ugo+rw Nov 06 15:28:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6efc754c-25d5-4c87-88fe-d53a6850cd56 tempest-VolumesDeleteCascade-1403262175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-cb0644e7-c2b7-435a-85b2-8f304055770a.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:28:11 devstack sudo[98660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-cb0644e7-c2b7-435a-85b2-8f304055770a.info Nov 06 15:28:11 devstack sudo[98660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:28:11 devstack sudo[98660]: pam_unix(sudo:session): session closed for user root Nov 06 15:28:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6efc754c-25d5-4c87-88fe-d53a6850cd56 tempest-VolumesDeleteCascade-1403262175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-cb0644e7-c2b7-435a-85b2-8f304055770a.info" returned: 0 in 0.277s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:28:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6efc754c-25d5-4c87-88fe-d53a6850cd56 tempest-VolumesDeleteCascade-1403262175 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.510s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:28:11 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-6efc754c-25d5-4c87-88fe-d53a6850cd56 tempest-VolumesDeleteCascade-1403262175 None] Create snapshot completed successfully Nov 06 15:28:12 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-f77a154c-315e-497e-be1e-5de1cfaef2d5 req-10e86672-a047-4de3-8a9d-0980d286e138 tempest-AttachVolumeTestJSON-1915243344 None] Terminate volume connection completed successfully. Nov 06 15:28:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-f77a154c-315e-497e-be1e-5de1cfaef2d5 req-10e86672-a047-4de3-8a9d-0980d286e138 tempest-AttachVolumeTestJSON-1915243344 None] Deleting attachment 000599e1-8f45-4321-af73-7e8aa53ce77d. {{(pid=87132) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 06 15:28:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-665e3890-2814-4c83-9a7a-3afb608a03cc tempest-VolumesDeleteCascade-1403262175 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:28:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-665e3890-2814-4c83-9a7a-3afb608a03cc tempest-VolumesDeleteCascade-1403262175 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:28:12 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-665e3890-2814-4c83-9a7a-3afb608a03cc tempest-VolumesDeleteCascade-1403262175 None] Creating offline snapshot 0ab47e86-b00d-44cf-91ca-11ae0ea86a7d of volume cb0644e7-c2b7-435a-85b2-8f304055770a {{(pid=87132) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 15:28:12 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[2082da78-c5b3-4c9b-8757-7f0da4e46d30]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:28:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-665e3890-2814-4c83-9a7a-3afb608a03cc tempest-VolumesDeleteCascade-1403262175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-cb0644e7-c2b7-435a-85b2-8f304055770a.8809053b-d059-4b94-b6fd-f604d0bef2c7 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:28:12 devstack sudo[98670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-cb0644e7-c2b7-435a-85b2-8f304055770a.8809053b-d059-4b94-b6fd-f604d0bef2c7 Nov 06 15:28:12 devstack sudo[98670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:28:13 devstack sudo[98670]: pam_unix(sudo:session): session closed for user root Nov 06 15:28:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-665e3890-2814-4c83-9a7a-3afb608a03cc tempest-VolumesDeleteCascade-1403262175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-cb0644e7-c2b7-435a-85b2-8f304055770a.8809053b-d059-4b94-b6fd-f604d0bef2c7" returned: 0 in 0.724s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:28:13 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-665e3890-2814-4c83-9a7a-3afb608a03cc tempest-VolumesDeleteCascade-1403262175 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cb0644e7-c2b7-435a-85b2-8f304055770a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 15:28:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-665e3890-2814-4c83-9a7a-3afb608a03cc tempest-VolumesDeleteCascade-1403262175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-cb0644e7-c2b7-435a-85b2-8f304055770a.8809053b-d059-4b94-b6fd-f604d0bef2c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-cb0644e7-c2b7-435a-85b2-8f304055770a.0ab47e86-b00d-44cf-91ca-11ae0ea86a7d 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:28:13 devstack sudo[98693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-cb0644e7-c2b7-435a-85b2-8f304055770a.8809053b-d059-4b94-b6fd-f604d0bef2c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-cb0644e7-c2b7-435a-85b2-8f304055770a.0ab47e86-b00d-44cf-91ca-11ae0ea86a7d 1G Nov 06 15:28:13 devstack sudo[98693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:28:14 devstack sudo[98693]: pam_unix(sudo:session): session closed for user root Nov 06 15:28:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-665e3890-2814-4c83-9a7a-3afb608a03cc tempest-VolumesDeleteCascade-1403262175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-cb0644e7-c2b7-435a-85b2-8f304055770a.8809053b-d059-4b94-b6fd-f604d0bef2c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-cb0644e7-c2b7-435a-85b2-8f304055770a.0ab47e86-b00d-44cf-91ca-11ae0ea86a7d 1G" returned: 0 in 0.735s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:28:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-665e3890-2814-4c83-9a7a-3afb608a03cc tempest-VolumesDeleteCascade-1403262175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb0644e7-c2b7-435a-85b2-8f304055770a.8809053b-d059-4b94-b6fd-f604d0bef2c7 -F qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-cb0644e7-c2b7-435a-85b2-8f304055770a.0ab47e86-b00d-44cf-91ca-11ae0ea86a7d {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:28:14 devstack sudo[98710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb0644e7-c2b7-435a-85b2-8f304055770a.8809053b-d059-4b94-b6fd-f604d0bef2c7 -F qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-cb0644e7-c2b7-435a-85b2-8f304055770a.0ab47e86-b00d-44cf-91ca-11ae0ea86a7d Nov 06 15:28:14 devstack sudo[98710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:28:14 devstack sudo[98710]: pam_unix(sudo:session): session closed for user root Nov 06 15:28:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-665e3890-2814-4c83-9a7a-3afb608a03cc tempest-VolumesDeleteCascade-1403262175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb0644e7-c2b7-435a-85b2-8f304055770a.8809053b-d059-4b94-b6fd-f604d0bef2c7 -F qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-cb0644e7-c2b7-435a-85b2-8f304055770a.0ab47e86-b00d-44cf-91ca-11ae0ea86a7d" returned: 0 in 0.401s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:28:14 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-665e3890-2814-4c83-9a7a-3afb608a03cc tempest-VolumesDeleteCascade-1403262175 None] /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-cb0644e7-c2b7-435a-85b2-8f304055770a.0ab47e86-b00d-44cf-91ca-11ae0ea86a7d is being set with open permissions: ugo+rw Nov 06 15:28:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-665e3890-2814-4c83-9a7a-3afb608a03cc tempest-VolumesDeleteCascade-1403262175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-cb0644e7-c2b7-435a-85b2-8f304055770a.0ab47e86-b00d-44cf-91ca-11ae0ea86a7d {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:28:14 devstack sudo[98715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-cb0644e7-c2b7-435a-85b2-8f304055770a.0ab47e86-b00d-44cf-91ca-11ae0ea86a7d Nov 06 15:28:14 devstack sudo[98715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:28:14 devstack sudo[98715]: pam_unix(sudo:session): session closed for user root Nov 06 15:28:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-665e3890-2814-4c83-9a7a-3afb608a03cc tempest-VolumesDeleteCascade-1403262175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-cb0644e7-c2b7-435a-85b2-8f304055770a.0ab47e86-b00d-44cf-91ca-11ae0ea86a7d" returned: 0 in 0.307s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:28:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-665e3890-2814-4c83-9a7a-3afb608a03cc tempest-VolumesDeleteCascade-1403262175 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.338s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:28:14 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-665e3890-2814-4c83-9a7a-3afb608a03cc tempest-VolumesDeleteCascade-1403262175 None] Create snapshot completed successfully Nov 06 15:28:15 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-84a422dd-7c0f-4224-8a1f-c42c3bede888 tempest-TestStampPattern-2123587362 None] Acquiring lock "cinder-9a8ebbbf-037d-41a7-b9ed-a4f47c62589f-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:28:15 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-84a422dd-7c0f-4224-8a1f-c42c3bede888 tempest-TestStampPattern-2123587362 None] Lock "cinder-9a8ebbbf-037d-41a7-b9ed-a4f47c62589f-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:28:15 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-2b37150e-469f-4e79-b447-da7452f0a1cd tempest-VolumesDeleteCascade-1403262175 None] Acquiring lock "cinder-cb0644e7-c2b7-435a-85b2-8f304055770a-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:28:15 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-84a422dd-7c0f-4224-8a1f-c42c3bede888 tempest-TestStampPattern-2123587362 None] Acquiring lock "cinder-quobyte-9a8ebbbf-037d-41a7-b9ed-a4f47c62589f" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:28:15 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-2b37150e-469f-4e79-b447-da7452f0a1cd tempest-VolumesDeleteCascade-1403262175 None] Lock "cinder-cb0644e7-c2b7-435a-85b2-8f304055770a-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:28:15 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-84a422dd-7c0f-4224-8a1f-c42c3bede888 tempest-TestStampPattern-2123587362 None] Lock "cinder-quobyte-9a8ebbbf-037d-41a7-b9ed-a4f47c62589f" acquired by "delete_volume" :: waited 0.053s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:28:15 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[7829f8b7-17d2-4ae4-a634-dd1b4cfde48a]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:28:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-84a422dd-7c0f-4224-8a1f-c42c3bede888 tempest-TestStampPattern-2123587362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-9a8ebbbf-037d-41a7-b9ed-a4f47c62589f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:28:16 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2b37150e-469f-4e79-b447-da7452f0a1cd tempest-VolumesDeleteCascade-1403262175 None] Performing cascade delete. {{(pid=87132) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Nov 06 15:28:16 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-2b37150e-469f-4e79-b447-da7452f0a1cd tempest-VolumesDeleteCascade-1403262175 None] Acquiring lock "cinder-0ab47e86-b00d-44cf-91ca-11ae0ea86a7d-delete_snapshot" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:28:16 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-2b37150e-469f-4e79-b447-da7452f0a1cd tempest-VolumesDeleteCascade-1403262175 None] Lock "cinder-0ab47e86-b00d-44cf-91ca-11ae0ea86a7d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:28:16 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-2b37150e-469f-4e79-b447-da7452f0a1cd tempest-VolumesDeleteCascade-1403262175 None] Acquiring lock "cinder-quobyte-cb0644e7-c2b7-435a-85b2-8f304055770a" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:28:16 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-2b37150e-469f-4e79-b447-da7452f0a1cd tempest-VolumesDeleteCascade-1403262175 None] Lock "cinder-quobyte-cb0644e7-c2b7-435a-85b2-8f304055770a" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:28:16 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-2b37150e-469f-4e79-b447-da7452f0a1cd tempest-VolumesDeleteCascade-1403262175 None] Acquiring lock "cinder-quobyte-0ab47e86-b00d-44cf-91ca-11ae0ea86a7d" by "_delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:28:16 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-2b37150e-469f-4e79-b447-da7452f0a1cd tempest-VolumesDeleteCascade-1403262175 None] Lock "cinder-quobyte-0ab47e86-b00d-44cf-91ca-11ae0ea86a7d" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:28:16 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-2b37150e-469f-4e79-b447-da7452f0a1cd tempest-VolumesDeleteCascade-1403262175 None] Deleting offline snapshot 0ab47e86-b00d-44cf-91ca-11ae0ea86a7d of volume cb0644e7-c2b7-435a-85b2-8f304055770a {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 15:28:16 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-2b37150e-469f-4e79-b447-da7452f0a1cd tempest-VolumesDeleteCascade-1403262175 None] snapshot_file for this snap is: volume-cb0644e7-c2b7-435a-85b2-8f304055770a.0ab47e86-b00d-44cf-91ca-11ae0ea86a7d {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 15:28:16 devstack sudo[98723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-9a8ebbbf-037d-41a7-b9ed-a4f47c62589f Nov 06 15:28:16 devstack sudo[98723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:28:16 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f8d8b19-9684-46ae-98ae-1c5a19e81ea9]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:28:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2b37150e-469f-4e79-b447-da7452f0a1cd tempest-VolumesDeleteCascade-1403262175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-cb0644e7-c2b7-435a-85b2-8f304055770a.0ab47e86-b00d-44cf-91ca-11ae0ea86a7d {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:28:16 devstack sudo[98725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-cb0644e7-c2b7-435a-85b2-8f304055770a.0ab47e86-b00d-44cf-91ca-11ae0ea86a7d Nov 06 15:28:16 devstack sudo[98725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:28:16 devstack sudo[98723]: pam_unix(sudo:session): session closed for user root Nov 06 15:28:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-84a422dd-7c0f-4224-8a1f-c42c3bede888 tempest-TestStampPattern-2123587362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-9a8ebbbf-037d-41a7-b9ed-a4f47c62589f" returned: 0 in 0.781s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:28:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-84a422dd-7c0f-4224-8a1f-c42c3bede888 tempest-TestStampPattern-2123587362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-9a8ebbbf-037d-41a7-b9ed-a4f47c62589f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:28:16 devstack sudo[98725]: pam_unix(sudo:session): session closed for user root Nov 06 15:28:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2b37150e-469f-4e79-b447-da7452f0a1cd tempest-VolumesDeleteCascade-1403262175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-cb0644e7-c2b7-435a-85b2-8f304055770a.0ab47e86-b00d-44cf-91ca-11ae0ea86a7d" returned: 0 in 0.621s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:28:16 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-2b37150e-469f-4e79-b447-da7452f0a1cd tempest-VolumesDeleteCascade-1403262175 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cb0644e7-c2b7-435a-85b2-8f304055770a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 15:28:16 devstack sudo[98744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-9a8ebbbf-037d-41a7-b9ed-a4f47c62589f Nov 06 15:28:16 devstack sudo[98744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:28:16 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[d546bd01-f953-4e5b-bceb-849e9f3898e8]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:28:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2b37150e-469f-4e79-b447-da7452f0a1cd tempest-VolumesDeleteCascade-1403262175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-cb0644e7-c2b7-435a-85b2-8f304055770a.8809053b-d059-4b94-b6fd-f604d0bef2c7 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:28:17 devstack sudo[98744]: pam_unix(sudo:session): session closed for user root Nov 06 15:28:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-84a422dd-7c0f-4224-8a1f-c42c3bede888 tempest-TestStampPattern-2123587362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-9a8ebbbf-037d-41a7-b9ed-a4f47c62589f" returned: 0 in 0.414s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:28:17 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-84a422dd-7c0f-4224-8a1f-c42c3bede888 tempest-TestStampPattern-2123587362 None] Lock "cinder-quobyte-9a8ebbbf-037d-41a7-b9ed-a4f47c62589f" released by "delete_volume" :: held 1.283s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:28:17 devstack sudo[98749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-cb0644e7-c2b7-435a-85b2-8f304055770a.8809053b-d059-4b94-b6fd-f604d0bef2c7 Nov 06 15:28:17 devstack sudo[98749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:28:17 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-84a422dd-7c0f-4224-8a1f-c42c3bede888 tempest-TestStampPattern-2123587362 None] Created reservations ['0d0dcb99-e8ea-43d3-b6b9-256a64a12364', '66391283-90dd-4163-82f3-5dbf3757d5b6', '209deb68-a14b-4827-89f8-a30d663e73ba', '3b8bf6d8-9a42-47ff-ad03-d7695bf6d1d5'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:28:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-84a422dd-7c0f-4224-8a1f-c42c3bede888 tempest-TestStampPattern-2123587362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:28:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-84a422dd-7c0f-4224-8a1f-c42c3bede888 tempest-TestStampPattern-2123587362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:28:17 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-84a422dd-7c0f-4224-8a1f-c42c3bede888 tempest-TestStampPattern-2123587362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:28:17 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-84a422dd-7c0f-4224-8a1f-c42c3bede888 tempest-TestStampPattern-2123587362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:28:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-84a422dd-7c0f-4224-8a1f-c42c3bede888 tempest-TestStampPattern-2123587362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:28:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-84a422dd-7c0f-4224-8a1f-c42c3bede888 tempest-TestStampPattern-2123587362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:28:17 devstack sudo[98761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:28:17 devstack sudo[98761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:28:17 devstack sudo[98749]: pam_unix(sudo:session): session closed for user root Nov 06 15:28:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2b37150e-469f-4e79-b447-da7452f0a1cd tempest-VolumesDeleteCascade-1403262175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-cb0644e7-c2b7-435a-85b2-8f304055770a.8809053b-d059-4b94-b6fd-f604d0bef2c7" returned: 0 in 1.013s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:28:17 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-2b37150e-469f-4e79-b447-da7452f0a1cd tempest-VolumesDeleteCascade-1403262175 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cb0644e7-c2b7-435a-85b2-8f304055770a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 15:28:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2b37150e-469f-4e79-b447-da7452f0a1cd tempest-VolumesDeleteCascade-1403262175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-cb0644e7-c2b7-435a-85b2-8f304055770a.0ab47e86-b00d-44cf-91ca-11ae0ea86a7d {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:28:17 devstack sudo[98772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-cb0644e7-c2b7-435a-85b2-8f304055770a.0ab47e86-b00d-44cf-91ca-11ae0ea86a7d Nov 06 15:28:17 devstack sudo[98772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:28:18 devstack sudo[98761]: pam_unix(sudo:session): session closed for user root Nov 06 15:28:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-84a422dd-7c0f-4224-8a1f-c42c3bede888 tempest-TestStampPattern-2123587362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.609s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:28:18 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-84a422dd-7c0f-4224-8a1f-c42c3bede888 tempest-TestStampPattern-2123587362 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:28:18 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-84a422dd-7c0f-4224-8a1f-c42c3bede888 tempest-TestStampPattern-2123587362 None] Deleted volume successfully. Nov 06 15:28:18 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-84a422dd-7c0f-4224-8a1f-c42c3bede888 tempest-TestStampPattern-2123587362 None] Lock "cinder-9a8ebbbf-037d-41a7-b9ed-a4f47c62589f-delete_volume" released by "delete_volume" :: held 2.343s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:28:18 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-bc267e29-eda0-48c6-8c84-49c6ba0a7107 tempest-TestStampPattern-2123587362 None] Acquiring lock "cinder-7470e204-ea7f-415a-a8a0-931912e52b0e-delete_snapshot" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:28:18 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-bc267e29-eda0-48c6-8c84-49c6ba0a7107 tempest-TestStampPattern-2123587362 None] Lock "cinder-7470e204-ea7f-415a-a8a0-931912e52b0e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.054s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:28:18 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-bc267e29-eda0-48c6-8c84-49c6ba0a7107 tempest-TestStampPattern-2123587362 None] Acquiring lock "cinder-quobyte-70555739-c658-4506-9144-58189ae89625" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:28:18 devstack sudo[98772]: pam_unix(sudo:session): session closed for user root Nov 06 15:28:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2b37150e-469f-4e79-b447-da7452f0a1cd tempest-VolumesDeleteCascade-1403262175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-cb0644e7-c2b7-435a-85b2-8f304055770a.0ab47e86-b00d-44cf-91ca-11ae0ea86a7d" returned: 0 in 1.035s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:28:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2b37150e-469f-4e79-b447-da7452f0a1cd tempest-VolumesDeleteCascade-1403262175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-cb0644e7-c2b7-435a-85b2-8f304055770a.0ab47e86-b00d-44cf-91ca-11ae0ea86a7d {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:28:19 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-bc267e29-eda0-48c6-8c84-49c6ba0a7107 tempest-TestStampPattern-2123587362 None] Lock "cinder-quobyte-70555739-c658-4506-9144-58189ae89625" acquired by "delete_snapshot" :: waited 0.062s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:28:19 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-bc267e29-eda0-48c6-8c84-49c6ba0a7107 tempest-TestStampPattern-2123587362 None] Acquiring lock "cinder-quobyte-7470e204-ea7f-415a-a8a0-931912e52b0e" by "_delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:28:19 devstack sudo[98841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-cb0644e7-c2b7-435a-85b2-8f304055770a.0ab47e86-b00d-44cf-91ca-11ae0ea86a7d Nov 06 15:28:19 devstack sudo[98841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:28:19 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-bc267e29-eda0-48c6-8c84-49c6ba0a7107 tempest-TestStampPattern-2123587362 None] Lock "cinder-quobyte-7470e204-ea7f-415a-a8a0-931912e52b0e" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:28:19 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-bc267e29-eda0-48c6-8c84-49c6ba0a7107 tempest-TestStampPattern-2123587362 None] Deleting offline snapshot 7470e204-ea7f-415a-a8a0-931912e52b0e of volume 70555739-c658-4506-9144-58189ae89625 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 15:28:19 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-bc267e29-eda0-48c6-8c84-49c6ba0a7107 tempest-TestStampPattern-2123587362 None] snapshot_file for this snap is: volume-70555739-c658-4506-9144-58189ae89625.7470e204-ea7f-415a-a8a0-931912e52b0e {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 15:28:19 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a77f361-8207-444d-af74-a52c858aab22]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:28:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bc267e29-eda0-48c6-8c84-49c6ba0a7107 tempest-TestStampPattern-2123587362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-70555739-c658-4506-9144-58189ae89625.7470e204-ea7f-415a-a8a0-931912e52b0e {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:28:19 devstack sudo[98846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-70555739-c658-4506-9144-58189ae89625.7470e204-ea7f-415a-a8a0-931912e52b0e Nov 06 15:28:19 devstack sudo[98846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:28:19 devstack sudo[98841]: pam_unix(sudo:session): session closed for user root Nov 06 15:28:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2b37150e-469f-4e79-b447-da7452f0a1cd tempest-VolumesDeleteCascade-1403262175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-cb0644e7-c2b7-435a-85b2-8f304055770a.0ab47e86-b00d-44cf-91ca-11ae0ea86a7d" returned: 0 in 0.559s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:28:19 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-2b37150e-469f-4e79-b447-da7452f0a1cd tempest-VolumesDeleteCascade-1403262175 None] Lock "cinder-quobyte-0ab47e86-b00d-44cf-91ca-11ae0ea86a7d" released by "_delete_snapshot" :: held 3.512s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:28:19 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-2b37150e-469f-4e79-b447-da7452f0a1cd tempest-VolumesDeleteCascade-1403262175 None] Lock "cinder-quobyte-cb0644e7-c2b7-435a-85b2-8f304055770a" released by "delete_snapshot" :: held 3.559s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:28:19 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-2b37150e-469f-4e79-b447-da7452f0a1cd tempest-VolumesDeleteCascade-1403262175 None] Created reservations ['de261434-8eba-415f-9bd7-110c3ba94030', '920adf5e-0c96-4c81-972f-015d63e0fe3c', '082e4932-bfa4-492c-8458-137215d91200', '8b199284-effe-47b6-ab8f-cad014987982'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:28:19 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-2b37150e-469f-4e79-b447-da7452f0a1cd tempest-VolumesDeleteCascade-1403262175 None] Delete snapshot completed successfully. Nov 06 15:28:19 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-2b37150e-469f-4e79-b447-da7452f0a1cd tempest-VolumesDeleteCascade-1403262175 None] Lock "cinder-0ab47e86-b00d-44cf-91ca-11ae0ea86a7d-delete_snapshot" released by "delete_snapshot" :: held 3.902s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:28:19 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-2b37150e-469f-4e79-b447-da7452f0a1cd tempest-VolumesDeleteCascade-1403262175 None] Acquiring lock "cinder-8809053b-d059-4b94-b6fd-f604d0bef2c7-delete_snapshot" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:28:20 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-2b37150e-469f-4e79-b447-da7452f0a1cd tempest-VolumesDeleteCascade-1403262175 None] Lock "cinder-8809053b-d059-4b94-b6fd-f604d0bef2c7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:28:20 devstack sudo[98846]: pam_unix(sudo:session): session closed for user root Nov 06 15:28:20 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-2b37150e-469f-4e79-b447-da7452f0a1cd tempest-VolumesDeleteCascade-1403262175 None] Acquiring lock "cinder-quobyte-cb0644e7-c2b7-435a-85b2-8f304055770a" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:28:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bc267e29-eda0-48c6-8c84-49c6ba0a7107 tempest-TestStampPattern-2123587362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-70555739-c658-4506-9144-58189ae89625.7470e204-ea7f-415a-a8a0-931912e52b0e" returned: 0 in 0.910s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:28:20 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-bc267e29-eda0-48c6-8c84-49c6ba0a7107 tempest-TestStampPattern-2123587362 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-70555739-c658-4506-9144-58189ae89625(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 15:28:20 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-2b37150e-469f-4e79-b447-da7452f0a1cd tempest-VolumesDeleteCascade-1403262175 None] Lock "cinder-quobyte-cb0644e7-c2b7-435a-85b2-8f304055770a" acquired by "delete_snapshot" :: waited 0.066s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:28:20 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-2b37150e-469f-4e79-b447-da7452f0a1cd tempest-VolumesDeleteCascade-1403262175 None] Acquiring lock "cinder-quobyte-8809053b-d059-4b94-b6fd-f604d0bef2c7" by "_delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:28:20 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ae3d747-9286-4cf1-9cbf-b2917b23526e]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:28:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bc267e29-eda0-48c6-8c84-49c6ba0a7107 tempest-TestStampPattern-2123587362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-70555739-c658-4506-9144-58189ae89625 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:28:20 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-2b37150e-469f-4e79-b447-da7452f0a1cd tempest-VolumesDeleteCascade-1403262175 None] Lock "cinder-quobyte-8809053b-d059-4b94-b6fd-f604d0bef2c7" acquired by "_delete_snapshot" :: waited 0.053s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:28:20 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-2b37150e-469f-4e79-b447-da7452f0a1cd tempest-VolumesDeleteCascade-1403262175 None] Deleting offline snapshot 8809053b-d059-4b94-b6fd-f604d0bef2c7 of volume cb0644e7-c2b7-435a-85b2-8f304055770a {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 15:28:20 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-2b37150e-469f-4e79-b447-da7452f0a1cd tempest-VolumesDeleteCascade-1403262175 None] snapshot_file for this snap is: volume-cb0644e7-c2b7-435a-85b2-8f304055770a.8809053b-d059-4b94-b6fd-f604d0bef2c7 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 15:28:20 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1bfb607-c039-4847-bba2-cf45067b4d0e]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:28:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2b37150e-469f-4e79-b447-da7452f0a1cd tempest-VolumesDeleteCascade-1403262175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-cb0644e7-c2b7-435a-85b2-8f304055770a.8809053b-d059-4b94-b6fd-f604d0bef2c7 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:28:20 devstack sudo[98872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-70555739-c658-4506-9144-58189ae89625 Nov 06 15:28:20 devstack sudo[98872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:28:20 devstack sudo[98876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-cb0644e7-c2b7-435a-85b2-8f304055770a.8809053b-d059-4b94-b6fd-f604d0bef2c7 Nov 06 15:28:20 devstack sudo[98876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:28:21 devstack sudo[98876]: pam_unix(sudo:session): session closed for user root Nov 06 15:28:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2b37150e-469f-4e79-b447-da7452f0a1cd tempest-VolumesDeleteCascade-1403262175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-cb0644e7-c2b7-435a-85b2-8f304055770a.8809053b-d059-4b94-b6fd-f604d0bef2c7" returned: 0 in 0.986s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:28:21 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-2b37150e-469f-4e79-b447-da7452f0a1cd tempest-VolumesDeleteCascade-1403262175 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cb0644e7-c2b7-435a-85b2-8f304055770a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 15:28:21 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[b74e21f4-c3dc-4366-93f6-edaf8af04c7f]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:28:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2b37150e-469f-4e79-b447-da7452f0a1cd tempest-VolumesDeleteCascade-1403262175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-cb0644e7-c2b7-435a-85b2-8f304055770a {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:28:21 devstack sudo[98872]: pam_unix(sudo:session): session closed for user root Nov 06 15:28:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bc267e29-eda0-48c6-8c84-49c6ba0a7107 tempest-TestStampPattern-2123587362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-70555739-c658-4506-9144-58189ae89625" returned: 0 in 1.229s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:28:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bc267e29-eda0-48c6-8c84-49c6ba0a7107 tempest-TestStampPattern-2123587362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-70555739-c658-4506-9144-58189ae89625.7470e204-ea7f-415a-a8a0-931912e52b0e {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:28:21 devstack sudo[98897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-70555739-c658-4506-9144-58189ae89625.7470e204-ea7f-415a-a8a0-931912e52b0e Nov 06 15:28:21 devstack sudo[98897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:28:21 devstack sudo[98896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-cb0644e7-c2b7-435a-85b2-8f304055770a Nov 06 15:28:21 devstack sudo[98896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:28:21 devstack sudo[98897]: pam_unix(sudo:session): session closed for user root Nov 06 15:28:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bc267e29-eda0-48c6-8c84-49c6ba0a7107 tempest-TestStampPattern-2123587362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-70555739-c658-4506-9144-58189ae89625.7470e204-ea7f-415a-a8a0-931912e52b0e" returned: 0 in 0.531s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:28:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bc267e29-eda0-48c6-8c84-49c6ba0a7107 tempest-TestStampPattern-2123587362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-70555739-c658-4506-9144-58189ae89625.7470e204-ea7f-415a-a8a0-931912e52b0e {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:28:21 devstack sudo[98896]: pam_unix(sudo:session): session closed for user root Nov 06 15:28:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2b37150e-469f-4e79-b447-da7452f0a1cd tempest-VolumesDeleteCascade-1403262175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-cb0644e7-c2b7-435a-85b2-8f304055770a" returned: 0 in 0.575s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:28:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2b37150e-469f-4e79-b447-da7452f0a1cd tempest-VolumesDeleteCascade-1403262175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-cb0644e7-c2b7-435a-85b2-8f304055770a.8809053b-d059-4b94-b6fd-f604d0bef2c7 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:28:21 devstack sudo[98908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-70555739-c658-4506-9144-58189ae89625.7470e204-ea7f-415a-a8a0-931912e52b0e Nov 06 15:28:21 devstack sudo[98908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:28:21 devstack sudo[98909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-cb0644e7-c2b7-435a-85b2-8f304055770a.8809053b-d059-4b94-b6fd-f604d0bef2c7 Nov 06 15:28:21 devstack sudo[98909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:28:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bc267e29-eda0-48c6-8c84-49c6ba0a7107 tempest-TestStampPattern-2123587362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-70555739-c658-4506-9144-58189ae89625.7470e204-ea7f-415a-a8a0-931912e52b0e" returned: 0 in 0.539s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:28:22 devstack sudo[98908]: pam_unix(sudo:session): session closed for user root Nov 06 15:28:22 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-bc267e29-eda0-48c6-8c84-49c6ba0a7107 tempest-TestStampPattern-2123587362 None] Lock "cinder-quobyte-7470e204-ea7f-415a-a8a0-931912e52b0e" released by "_delete_snapshot" :: held 3.485s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:28:22 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-bc267e29-eda0-48c6-8c84-49c6ba0a7107 tempest-TestStampPattern-2123587362 None] Lock "cinder-quobyte-70555739-c658-4506-9144-58189ae89625" released by "delete_snapshot" :: held 3.568s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:28:22 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-bc267e29-eda0-48c6-8c84-49c6ba0a7107 tempest-TestStampPattern-2123587362 None] Created reservations ['e3cb7c60-50b1-400e-ab33-168fd37de8f2', 'b332f656-15f5-4311-9935-f79401d56268', '8e8bf9a8-c35c-47ea-8e4d-28d0d0a13570', '4c71efeb-d68f-4773-b142-1765efcb193a'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:28:22 devstack sudo[98909]: pam_unix(sudo:session): session closed for user root Nov 06 15:28:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2b37150e-469f-4e79-b447-da7452f0a1cd tempest-VolumesDeleteCascade-1403262175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-cb0644e7-c2b7-435a-85b2-8f304055770a.8809053b-d059-4b94-b6fd-f604d0bef2c7" returned: 0 in 1.013s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:28:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2b37150e-469f-4e79-b447-da7452f0a1cd tempest-VolumesDeleteCascade-1403262175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-cb0644e7-c2b7-435a-85b2-8f304055770a.8809053b-d059-4b94-b6fd-f604d0bef2c7 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:28:23 devstack sudo[98961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-cb0644e7-c2b7-435a-85b2-8f304055770a.8809053b-d059-4b94-b6fd-f604d0bef2c7 Nov 06 15:28:23 devstack sudo[98961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:28:23 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-bc267e29-eda0-48c6-8c84-49c6ba0a7107 tempest-TestStampPattern-2123587362 None] Delete snapshot completed successfully. Nov 06 15:28:23 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-bc267e29-eda0-48c6-8c84-49c6ba0a7107 tempest-TestStampPattern-2123587362 None] Lock "cinder-7470e204-ea7f-415a-a8a0-931912e52b0e-delete_snapshot" released by "delete_snapshot" :: held 4.247s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:28:23 devstack sudo[98961]: pam_unix(sudo:session): session closed for user root Nov 06 15:28:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2b37150e-469f-4e79-b447-da7452f0a1cd tempest-VolumesDeleteCascade-1403262175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-cb0644e7-c2b7-435a-85b2-8f304055770a.8809053b-d059-4b94-b6fd-f604d0bef2c7" returned: 0 in 0.745s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:28:23 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-2b37150e-469f-4e79-b447-da7452f0a1cd tempest-VolumesDeleteCascade-1403262175 None] Lock "cinder-quobyte-8809053b-d059-4b94-b6fd-f604d0bef2c7" released by "_delete_snapshot" :: held 3.624s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:28:23 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-2b37150e-469f-4e79-b447-da7452f0a1cd tempest-VolumesDeleteCascade-1403262175 None] Lock "cinder-quobyte-cb0644e7-c2b7-435a-85b2-8f304055770a" released by "delete_snapshot" :: held 3.722s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:28:23 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-2b37150e-469f-4e79-b447-da7452f0a1cd tempest-VolumesDeleteCascade-1403262175 None] Created reservations ['b6d1e89d-e478-4cc0-9dfc-f061460dea99', '5f3d4086-bc39-47c2-aed4-3651ca76c7f0', 'cb39b1d0-d22f-44ec-a01c-50148c042943', '3ef4f067-31f7-4a8e-b4da-dd012f1ae278'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:28:24 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-2b37150e-469f-4e79-b447-da7452f0a1cd tempest-VolumesDeleteCascade-1403262175 None] Delete snapshot completed successfully. Nov 06 15:28:24 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-2b37150e-469f-4e79-b447-da7452f0a1cd tempest-VolumesDeleteCascade-1403262175 None] Lock "cinder-8809053b-d059-4b94-b6fd-f604d0bef2c7-delete_snapshot" released by "delete_snapshot" :: held 4.211s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:28:24 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2b37150e-469f-4e79-b447-da7452f0a1cd tempest-VolumesDeleteCascade-1403262175 None] Snapshots deleted, issuing volume delete {{(pid=87132) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Nov 06 15:28:24 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-2b37150e-469f-4e79-b447-da7452f0a1cd tempest-VolumesDeleteCascade-1403262175 None] Acquiring lock "cinder-quobyte-cb0644e7-c2b7-435a-85b2-8f304055770a" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:28:24 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-2b37150e-469f-4e79-b447-da7452f0a1cd tempest-VolumesDeleteCascade-1403262175 None] Lock "cinder-quobyte-cb0644e7-c2b7-435a-85b2-8f304055770a" acquired by "delete_volume" :: waited 0.035s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:28:24 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[64233f80-5953-4b81-99ae-43459e7840c7]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:28:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2b37150e-469f-4e79-b447-da7452f0a1cd tempest-VolumesDeleteCascade-1403262175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-cb0644e7-c2b7-435a-85b2-8f304055770a {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:28:24 devstack sudo[98986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-cb0644e7-c2b7-435a-85b2-8f304055770a Nov 06 15:28:24 devstack sudo[98986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:28:25 devstack sudo[98986]: pam_unix(sudo:session): session closed for user root Nov 06 15:28:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2b37150e-469f-4e79-b447-da7452f0a1cd tempest-VolumesDeleteCascade-1403262175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-cb0644e7-c2b7-435a-85b2-8f304055770a" returned: 0 in 1.049s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:28:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2b37150e-469f-4e79-b447-da7452f0a1cd tempest-VolumesDeleteCascade-1403262175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-cb0644e7-c2b7-435a-85b2-8f304055770a {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:28:25 devstack sudo[98997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-cb0644e7-c2b7-435a-85b2-8f304055770a Nov 06 15:28:25 devstack sudo[98997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:28:25 devstack sudo[98997]: pam_unix(sudo:session): session closed for user root Nov 06 15:28:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2b37150e-469f-4e79-b447-da7452f0a1cd tempest-VolumesDeleteCascade-1403262175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-cb0644e7-c2b7-435a-85b2-8f304055770a" returned: 0 in 0.510s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:28:25 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-2b37150e-469f-4e79-b447-da7452f0a1cd tempest-VolumesDeleteCascade-1403262175 None] Lock "cinder-quobyte-cb0644e7-c2b7-435a-85b2-8f304055770a" released by "delete_volume" :: held 1.706s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:28:26 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-2b37150e-469f-4e79-b447-da7452f0a1cd tempest-VolumesDeleteCascade-1403262175 None] Created reservations ['b004ef2c-fc07-43ea-9939-b297bfa77f12', 'a52ac2b9-5e84-40ec-ac4d-1f9b8dd9ee5f', '3dadaa4b-31a5-4de5-af5a-ecfa8fb016c1', '2faa5651-b258-4962-9bd3-51b85c1fc4ed'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:28:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-2b37150e-469f-4e79-b447-da7452f0a1cd tempest-VolumesDeleteCascade-1403262175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:28:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-2b37150e-469f-4e79-b447-da7452f0a1cd tempest-VolumesDeleteCascade-1403262175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:28:26 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-2b37150e-469f-4e79-b447-da7452f0a1cd tempest-VolumesDeleteCascade-1403262175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:28:26 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-2b37150e-469f-4e79-b447-da7452f0a1cd tempest-VolumesDeleteCascade-1403262175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:28:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-2b37150e-469f-4e79-b447-da7452f0a1cd tempest-VolumesDeleteCascade-1403262175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:28:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2b37150e-469f-4e79-b447-da7452f0a1cd tempest-VolumesDeleteCascade-1403262175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:28:26 devstack sudo[99003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:28:26 devstack sudo[99003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:28:26 devstack sudo[99003]: pam_unix(sudo:session): session closed for user root Nov 06 15:28:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2b37150e-469f-4e79-b447-da7452f0a1cd tempest-VolumesDeleteCascade-1403262175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.800s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:28:27 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-2b37150e-469f-4e79-b447-da7452f0a1cd tempest-VolumesDeleteCascade-1403262175 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:28:27 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-2b37150e-469f-4e79-b447-da7452f0a1cd tempest-VolumesDeleteCascade-1403262175 None] Deleted volume successfully. Nov 06 15:28:27 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-2b37150e-469f-4e79-b447-da7452f0a1cd tempest-VolumesDeleteCascade-1403262175 None] Lock "cinder-cb0644e7-c2b7-435a-85b2-8f304055770a-delete_volume" released by "delete_volume" :: held 11.213s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:28:28 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fecf4f3-e4bd-4e5e-b72d-e417e5537aee tempest-VolumesDeleteCascade-1403262175 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:28:28 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9fecf4f3-e4bd-4e5e-b72d-e417e5537aee tempest-VolumesDeleteCascade-1403262175 None] Flow 'volume_create_manager' (9e1e5f10-5b05-4d5c-8bb7-4e10463df08a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:28:28 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9fecf4f3-e4bd-4e5e-b72d-e417e5537aee tempest-VolumesDeleteCascade-1403262175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa35543c-773b-4528-8155-bdd28c1359ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:28:28 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9fecf4f3-e4bd-4e5e-b72d-e417e5537aee tempest-VolumesDeleteCascade-1403262175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa35543c-773b-4528-8155-bdd28c1359ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:28:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-407075564',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e089542-631b-4e2f-a658-412599a511c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f57e170f84984d9c83c6f0e97da1b798',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:28:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:28:29Z,use_quota=True,user_id='fe984252e48341f38328889e12dee7dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:28:28 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9fecf4f3-e4bd-4e5e-b72d-e417e5537aee tempest-VolumesDeleteCascade-1403262175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (889a987c-9cc2-40ce-9cd2-53c3261a16c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:28:28 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9fecf4f3-e4bd-4e5e-b72d-e417e5537aee tempest-VolumesDeleteCascade-1403262175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (889a987c-9cc2-40ce-9cd2-53c3261a16c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:28:28 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9fecf4f3-e4bd-4e5e-b72d-e417e5537aee tempest-VolumesDeleteCascade-1403262175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e8e9094-ca2a-4329-bbf1-530f611a2290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:28:28 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9fecf4f3-e4bd-4e5e-b72d-e417e5537aee tempest-VolumesDeleteCascade-1403262175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e8e9094-ca2a-4329-bbf1-530f611a2290) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e089542-631b-4e2f-a658-412599a511c9', 'volume_name': 'volume-2e089542-631b-4e2f-a658-412599a511c9', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:28:28 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9fecf4f3-e4bd-4e5e-b72d-e417e5537aee tempest-VolumesDeleteCascade-1403262175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee6f8e2a-ff20-4852-ac95-02ad0b7c98fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:28:28 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9fecf4f3-e4bd-4e5e-b72d-e417e5537aee tempest-VolumesDeleteCascade-1403262175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee6f8e2a-ff20-4852-ac95-02ad0b7c98fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:28:28 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9fecf4f3-e4bd-4e5e-b72d-e417e5537aee tempest-VolumesDeleteCascade-1403262175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6f3962b-cbe9-46fe-a102-8f1b0e4c80ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:28:28 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-9fecf4f3-e4bd-4e5e-b72d-e417e5537aee tempest-VolumesDeleteCascade-1403262175 None] Volume 2e089542-631b-4e2f-a658-412599a511c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e089542-631b-4e2f-a658-412599a511c9', 'volume_size': 1} Nov 06 15:28:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9fecf4f3-e4bd-4e5e-b72d-e417e5537aee tempest-VolumesDeleteCascade-1403262175 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:28:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9fecf4f3-e4bd-4e5e-b72d-e417e5537aee tempest-VolumesDeleteCascade-1403262175 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:28:28 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-9fecf4f3-e4bd-4e5e-b72d-e417e5537aee tempest-VolumesDeleteCascade-1403262175 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:28:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-407075564',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e089542-631b-4e2f-a658-412599a511c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f57e170f84984d9c83c6f0e97da1b798',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:28:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:28:29Z,use_quota=True,user_id='fe984252e48341f38328889e12dee7dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:28:28 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-9fecf4f3-e4bd-4e5e-b72d-e417e5537aee tempest-VolumesDeleteCascade-1403262175 None] Creating volume 2e089542-631b-4e2f-a658-412599a511c9 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:28:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9fecf4f3-e4bd-4e5e-b72d-e417e5537aee tempest-VolumesDeleteCascade-1403262175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:28:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9fecf4f3-e4bd-4e5e-b72d-e417e5537aee tempest-VolumesDeleteCascade-1403262175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:28:28 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-9fecf4f3-e4bd-4e5e-b72d-e417e5537aee tempest-VolumesDeleteCascade-1403262175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:28:28 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-9fecf4f3-e4bd-4e5e-b72d-e417e5537aee tempest-VolumesDeleteCascade-1403262175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:28:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9fecf4f3-e4bd-4e5e-b72d-e417e5537aee tempest-VolumesDeleteCascade-1403262175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:28:28 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-9fecf4f3-e4bd-4e5e-b72d-e417e5537aee tempest-VolumesDeleteCascade-1403262175 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:28:28 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-9fecf4f3-e4bd-4e5e-b72d-e417e5537aee tempest-VolumesDeleteCascade-1403262175 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:28:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9fecf4f3-e4bd-4e5e-b72d-e417e5537aee tempest-VolumesDeleteCascade-1403262175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-2e089542-631b-4e2f-a658-412599a511c9 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:28:29 devstack sudo[99030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-2e089542-631b-4e2f-a658-412599a511c9 1073741824 Nov 06 15:28:29 devstack sudo[99030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:28:29 devstack sudo[99030]: pam_unix(sudo:session): session closed for user root Nov 06 15:28:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9fecf4f3-e4bd-4e5e-b72d-e417e5537aee tempest-VolumesDeleteCascade-1403262175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-2e089542-631b-4e2f-a658-412599a511c9 1073741824" returned: 0 in 0.858s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:28:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9fecf4f3-e4bd-4e5e-b72d-e417e5537aee tempest-VolumesDeleteCascade-1403262175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-2e089542-631b-4e2f-a658-412599a511c9 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:28:29 devstack sudo[99036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-2e089542-631b-4e2f-a658-412599a511c9 Nov 06 15:28:29 devstack sudo[99036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:28:30 devstack sudo[99036]: pam_unix(sudo:session): session closed for user root Nov 06 15:28:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9fecf4f3-e4bd-4e5e-b72d-e417e5537aee tempest-VolumesDeleteCascade-1403262175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-2e089542-631b-4e2f-a658-412599a511c9" returned: 0 in 0.357s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:28:30 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-9fecf4f3-e4bd-4e5e-b72d-e417e5537aee tempest-VolumesDeleteCascade-1403262175 None] <== create_volume: return (1313ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:28:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9fecf4f3-e4bd-4e5e-b72d-e417e5537aee tempest-VolumesDeleteCascade-1403262175 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.317s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:28:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9fecf4f3-e4bd-4e5e-b72d-e417e5537aee tempest-VolumesDeleteCascade-1403262175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6f3962b-cbe9-46fe-a102-8f1b0e4c80ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e089542-631b-4e2f-a658-412599a511c9', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:28:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9fecf4f3-e4bd-4e5e-b72d-e417e5537aee tempest-VolumesDeleteCascade-1403262175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4740bd92-e8e7-4605-8bc3-c1dddcf1de66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:28:30 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-cdd04a09-4f53-418e-a99a-2c55653c3adb tempest-TestStampPattern-2123587362 None] Acquiring lock "cinder-70555739-c658-4506-9144-58189ae89625-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:28:30 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-cdd04a09-4f53-418e-a99a-2c55653c3adb tempest-TestStampPattern-2123587362 None] Lock "cinder-70555739-c658-4506-9144-58189ae89625-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:28:30 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-9fecf4f3-e4bd-4e5e-b72d-e417e5537aee tempest-VolumesDeleteCascade-1403262175 None] Volume volume-2e089542-631b-4e2f-a658-412599a511c9 (2e089542-631b-4e2f-a658-412599a511c9): created successfully Nov 06 15:28:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9fecf4f3-e4bd-4e5e-b72d-e417e5537aee tempest-VolumesDeleteCascade-1403262175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4740bd92-e8e7-4605-8bc3-c1dddcf1de66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:28:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9fecf4f3-e4bd-4e5e-b72d-e417e5537aee tempest-VolumesDeleteCascade-1403262175 None] Flow 'volume_create_manager' (9e1e5f10-5b05-4d5c-8bb7-4e10463df08a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:28:30 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-9fecf4f3-e4bd-4e5e-b72d-e417e5537aee tempest-VolumesDeleteCascade-1403262175 None] Created volume successfully. Nov 06 15:28:30 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-cdd04a09-4f53-418e-a99a-2c55653c3adb tempest-TestStampPattern-2123587362 None] Acquiring lock "cinder-quobyte-70555739-c658-4506-9144-58189ae89625" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:28:30 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-cdd04a09-4f53-418e-a99a-2c55653c3adb tempest-TestStampPattern-2123587362 None] Lock "cinder-quobyte-70555739-c658-4506-9144-58189ae89625" acquired by "delete_volume" :: waited 0.016s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:28:30 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[8346e222-4a2b-4728-a1ac-5941abd2bbdb]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:28:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-cdd04a09-4f53-418e-a99a-2c55653c3adb tempest-TestStampPattern-2123587362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-70555739-c658-4506-9144-58189ae89625 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:28:30 devstack sudo[99039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-70555739-c658-4506-9144-58189ae89625 Nov 06 15:28:30 devstack sudo[99039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:28:30 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7c4d933-e88c-4e45-8535-937f28fc6f74 tempest-TestMinimumBasicScenario-695150570 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:28:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c7c4d933-e88c-4e45-8535-937f28fc6f74 tempest-TestMinimumBasicScenario-695150570 None] Flow 'volume_create_manager' (3c011dd1-ed89-485d-97e8-a88aab3a1d49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:28:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c7c4d933-e88c-4e45-8535-937f28fc6f74 tempest-TestMinimumBasicScenario-695150570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8650f8b0-6501-465d-9fe4-b968b13cb272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:28:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c7c4d933-e88c-4e45-8535-937f28fc6f74 tempest-TestMinimumBasicScenario-695150570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8650f8b0-6501-465d-9fe4-b968b13cb272) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:28:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-484731281',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34da549c-cadd-4301-96cf-213722ffa79a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a504018b0d98404db83303f73b33cc1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:28:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:28:31Z,use_quota=True,user_id='70ffd2f772b64368af79f6c6a9652d38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:28:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c7c4d933-e88c-4e45-8535-937f28fc6f74 tempest-TestMinimumBasicScenario-695150570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4dc572c-1e5f-40cc-bdcb-80daadc6220e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:28:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c7c4d933-e88c-4e45-8535-937f28fc6f74 tempest-TestMinimumBasicScenario-695150570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4dc572c-1e5f-40cc-bdcb-80daadc6220e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:28:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c7c4d933-e88c-4e45-8535-937f28fc6f74 tempest-TestMinimumBasicScenario-695150570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83a6b39b-5665-43e3-ac1d-f5eac74d0cae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:28:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c7c4d933-e88c-4e45-8535-937f28fc6f74 tempest-TestMinimumBasicScenario-695150570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83a6b39b-5665-43e3-ac1d-f5eac74d0cae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34da549c-cadd-4301-96cf-213722ffa79a', 'volume_name': 'volume-34da549c-cadd-4301-96cf-213722ffa79a', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:28:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c7c4d933-e88c-4e45-8535-937f28fc6f74 tempest-TestMinimumBasicScenario-695150570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc9f5b90-c3ba-4a56-b209-cfb21e0b84a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:28:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c7c4d933-e88c-4e45-8535-937f28fc6f74 tempest-TestMinimumBasicScenario-695150570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc9f5b90-c3ba-4a56-b209-cfb21e0b84a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:28:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c7c4d933-e88c-4e45-8535-937f28fc6f74 tempest-TestMinimumBasicScenario-695150570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb878c64-2f0c-4464-b149-09e4288f5fe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:28:31 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-c7c4d933-e88c-4e45-8535-937f28fc6f74 tempest-TestMinimumBasicScenario-695150570 None] Volume 34da549c-cadd-4301-96cf-213722ffa79a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34da549c-cadd-4301-96cf-213722ffa79a', 'volume_size': 1} Nov 06 15:28:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c7c4d933-e88c-4e45-8535-937f28fc6f74 tempest-TestMinimumBasicScenario-695150570 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:28:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c7c4d933-e88c-4e45-8535-937f28fc6f74 tempest-TestMinimumBasicScenario-695150570 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:28:31 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c7c4d933-e88c-4e45-8535-937f28fc6f74 tempest-TestMinimumBasicScenario-695150570 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:28:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-484731281',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34da549c-cadd-4301-96cf-213722ffa79a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a504018b0d98404db83303f73b33cc1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:28:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:28:31Z,use_quota=True,user_id='70ffd2f772b64368af79f6c6a9652d38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:28:31 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-c7c4d933-e88c-4e45-8535-937f28fc6f74 tempest-TestMinimumBasicScenario-695150570 None] Creating volume 34da549c-cadd-4301-96cf-213722ffa79a {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:28:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c7c4d933-e88c-4e45-8535-937f28fc6f74 tempest-TestMinimumBasicScenario-695150570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:28:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c7c4d933-e88c-4e45-8535-937f28fc6f74 tempest-TestMinimumBasicScenario-695150570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:28:31 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c7c4d933-e88c-4e45-8535-937f28fc6f74 tempest-TestMinimumBasicScenario-695150570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:28:31 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c7c4d933-e88c-4e45-8535-937f28fc6f74 tempest-TestMinimumBasicScenario-695150570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:28:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c7c4d933-e88c-4e45-8535-937f28fc6f74 tempest-TestMinimumBasicScenario-695150570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:28:31 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c7c4d933-e88c-4e45-8535-937f28fc6f74 tempest-TestMinimumBasicScenario-695150570 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:28:31 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-c7c4d933-e88c-4e45-8535-937f28fc6f74 tempest-TestMinimumBasicScenario-695150570 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:28:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c7c4d933-e88c-4e45-8535-937f28fc6f74 tempest-TestMinimumBasicScenario-695150570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-34da549c-cadd-4301-96cf-213722ffa79a 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:28:31 devstack sudo[99039]: pam_unix(sudo:session): session closed for user root Nov 06 15:28:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-cdd04a09-4f53-418e-a99a-2c55653c3adb tempest-TestStampPattern-2123587362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-70555739-c658-4506-9144-58189ae89625" returned: 0 in 0.595s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:28:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-cdd04a09-4f53-418e-a99a-2c55653c3adb tempest-TestStampPattern-2123587362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-70555739-c658-4506-9144-58189ae89625 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:28:31 devstack sudo[99044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-34da549c-cadd-4301-96cf-213722ffa79a 1073741824 Nov 06 15:28:31 devstack sudo[99044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:28:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-16345418-58d9-4046-a354-f7440d51b504 tempest-VolumesDeleteCascade-1403262175 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:28:31 devstack sudo[99045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-70555739-c658-4506-9144-58189ae89625 Nov 06 15:28:31 devstack sudo[99045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:28:31 devstack sudo[99045]: pam_unix(sudo:session): session closed for user root Nov 06 15:28:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-cdd04a09-4f53-418e-a99a-2c55653c3adb tempest-TestStampPattern-2123587362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-70555739-c658-4506-9144-58189ae89625" returned: 0 in 0.341s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:28:31 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-cdd04a09-4f53-418e-a99a-2c55653c3adb tempest-TestStampPattern-2123587362 None] Lock "cinder-quobyte-70555739-c658-4506-9144-58189ae89625" released by "delete_volume" :: held 1.020s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:28:31 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-cdd04a09-4f53-418e-a99a-2c55653c3adb tempest-TestStampPattern-2123587362 None] Created reservations ['f8932716-8e3c-40cb-8b0f-c218d821a73f', '352769e5-94df-4be5-bdc3-059482685975', '4f95dbcc-dff6-49e6-8e82-de179b8a083f', '44f96bc6-7f6a-4e7e-b789-0941948cf776'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:28:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-cdd04a09-4f53-418e-a99a-2c55653c3adb tempest-TestStampPattern-2123587362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:28:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-cdd04a09-4f53-418e-a99a-2c55653c3adb tempest-TestStampPattern-2123587362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:28:31 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-cdd04a09-4f53-418e-a99a-2c55653c3adb tempest-TestStampPattern-2123587362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:28:31 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-cdd04a09-4f53-418e-a99a-2c55653c3adb tempest-TestStampPattern-2123587362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:28:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-cdd04a09-4f53-418e-a99a-2c55653c3adb tempest-TestStampPattern-2123587362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:28:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-cdd04a09-4f53-418e-a99a-2c55653c3adb tempest-TestStampPattern-2123587362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:28:31 devstack sudo[99053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:28:31 devstack sudo[99053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:28:31 devstack sudo[99044]: pam_unix(sudo:session): session closed for user root Nov 06 15:28:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c7c4d933-e88c-4e45-8535-937f28fc6f74 tempest-TestMinimumBasicScenario-695150570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-34da549c-cadd-4301-96cf-213722ffa79a 1073741824" returned: 0 in 0.631s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:28:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c7c4d933-e88c-4e45-8535-937f28fc6f74 tempest-TestMinimumBasicScenario-695150570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-34da549c-cadd-4301-96cf-213722ffa79a {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:28:31 devstack sudo[99055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-34da549c-cadd-4301-96cf-213722ffa79a Nov 06 15:28:31 devstack sudo[99055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:28:31 devstack sudo[99053]: pam_unix(sudo:session): session closed for user root Nov 06 15:28:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-cdd04a09-4f53-418e-a99a-2c55653c3adb tempest-TestStampPattern-2123587362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.285s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:28:31 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-cdd04a09-4f53-418e-a99a-2c55653c3adb tempest-TestStampPattern-2123587362 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:28:31 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-cdd04a09-4f53-418e-a99a-2c55653c3adb tempest-TestStampPattern-2123587362 None] Deleted volume successfully. Nov 06 15:28:31 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-cdd04a09-4f53-418e-a99a-2c55653c3adb tempest-TestStampPattern-2123587362 None] Lock "cinder-70555739-c658-4506-9144-58189ae89625-delete_volume" released by "delete_volume" :: held 1.610s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:28:32 devstack sudo[99055]: pam_unix(sudo:session): session closed for user root Nov 06 15:28:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c7c4d933-e88c-4e45-8535-937f28fc6f74 tempest-TestMinimumBasicScenario-695150570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-34da549c-cadd-4301-96cf-213722ffa79a" returned: 0 in 0.325s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:28:32 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c7c4d933-e88c-4e45-8535-937f28fc6f74 tempest-TestMinimumBasicScenario-695150570 None] <== create_volume: return (1024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:28:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c7c4d933-e88c-4e45-8535-937f28fc6f74 tempest-TestMinimumBasicScenario-695150570 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.028s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:28:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-16345418-58d9-4046-a354-f7440d51b504 tempest-VolumesDeleteCascade-1403262175 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.947s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:28:32 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c7c4d933-e88c-4e45-8535-937f28fc6f74 tempest-TestMinimumBasicScenario-695150570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb878c64-2f0c-4464-b149-09e4288f5fe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34da549c-cadd-4301-96cf-213722ffa79a', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:28:32 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c7c4d933-e88c-4e45-8535-937f28fc6f74 tempest-TestMinimumBasicScenario-695150570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bce78cf-997d-41cf-854c-9c5abfd27b86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:28:32 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-16345418-58d9-4046-a354-f7440d51b504 tempest-VolumesDeleteCascade-1403262175 None] Creating offline snapshot 6cb34fb4-98a9-4b07-8443-790ab68e9ba2 of volume 2e089542-631b-4e2f-a658-412599a511c9 {{(pid=87132) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 15:28:32 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-c7c4d933-e88c-4e45-8535-937f28fc6f74 tempest-TestMinimumBasicScenario-695150570 None] Volume volume-34da549c-cadd-4301-96cf-213722ffa79a (34da549c-cadd-4301-96cf-213722ffa79a): created successfully Nov 06 15:28:32 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c7c4d933-e88c-4e45-8535-937f28fc6f74 tempest-TestMinimumBasicScenario-695150570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bce78cf-997d-41cf-854c-9c5abfd27b86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:28:32 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c7c4d933-e88c-4e45-8535-937f28fc6f74 tempest-TestMinimumBasicScenario-695150570 None] Flow 'volume_create_manager' (3c011dd1-ed89-485d-97e8-a88aab3a1d49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:28:32 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f42a70e-6c45-4ffe-80f0-9d9e5d973d14]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:28:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-16345418-58d9-4046-a354-f7440d51b504 tempest-VolumesDeleteCascade-1403262175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-2e089542-631b-4e2f-a658-412599a511c9 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:28:32 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-c7c4d933-e88c-4e45-8535-937f28fc6f74 tempest-TestMinimumBasicScenario-695150570 None] Created volume successfully. Nov 06 15:28:32 devstack sudo[99059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-2e089542-631b-4e2f-a658-412599a511c9 Nov 06 15:28:32 devstack sudo[99059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:28:32 devstack sudo[99059]: pam_unix(sudo:session): session closed for user root Nov 06 15:28:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-16345418-58d9-4046-a354-f7440d51b504 tempest-VolumesDeleteCascade-1403262175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-2e089542-631b-4e2f-a658-412599a511c9" returned: 0 in 0.390s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:28:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-16345418-58d9-4046-a354-f7440d51b504 tempest-VolumesDeleteCascade-1403262175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-2e089542-631b-4e2f-a658-412599a511c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-2e089542-631b-4e2f-a658-412599a511c9.6cb34fb4-98a9-4b07-8443-790ab68e9ba2 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:28:32 devstack sudo[99064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-2e089542-631b-4e2f-a658-412599a511c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-2e089542-631b-4e2f-a658-412599a511c9.6cb34fb4-98a9-4b07-8443-790ab68e9ba2 1G Nov 06 15:28:32 devstack sudo[99064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:28:33 devstack sudo[99064]: pam_unix(sudo:session): session closed for user root Nov 06 15:28:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-16345418-58d9-4046-a354-f7440d51b504 tempest-VolumesDeleteCascade-1403262175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-2e089542-631b-4e2f-a658-412599a511c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-2e089542-631b-4e2f-a658-412599a511c9.6cb34fb4-98a9-4b07-8443-790ab68e9ba2 1G" returned: 0 in 0.719s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:28:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-16345418-58d9-4046-a354-f7440d51b504 tempest-VolumesDeleteCascade-1403262175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e089542-631b-4e2f-a658-412599a511c9 -F qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-2e089542-631b-4e2f-a658-412599a511c9.6cb34fb4-98a9-4b07-8443-790ab68e9ba2 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:28:33 devstack sudo[99070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e089542-631b-4e2f-a658-412599a511c9 -F qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-2e089542-631b-4e2f-a658-412599a511c9.6cb34fb4-98a9-4b07-8443-790ab68e9ba2 Nov 06 15:28:33 devstack sudo[99070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:28:33 devstack sudo[99070]: pam_unix(sudo:session): session closed for user root Nov 06 15:28:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-16345418-58d9-4046-a354-f7440d51b504 tempest-VolumesDeleteCascade-1403262175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e089542-631b-4e2f-a658-412599a511c9 -F qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-2e089542-631b-4e2f-a658-412599a511c9.6cb34fb4-98a9-4b07-8443-790ab68e9ba2" returned: 0 in 0.502s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:28:33 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-16345418-58d9-4046-a354-f7440d51b504 tempest-VolumesDeleteCascade-1403262175 None] /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-2e089542-631b-4e2f-a658-412599a511c9.6cb34fb4-98a9-4b07-8443-790ab68e9ba2 is being set with open permissions: ugo+rw Nov 06 15:28:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-16345418-58d9-4046-a354-f7440d51b504 tempest-VolumesDeleteCascade-1403262175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-2e089542-631b-4e2f-a658-412599a511c9.6cb34fb4-98a9-4b07-8443-790ab68e9ba2 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:28:33 devstack sudo[99082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-2e089542-631b-4e2f-a658-412599a511c9.6cb34fb4-98a9-4b07-8443-790ab68e9ba2 Nov 06 15:28:33 devstack sudo[99082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:28:34 devstack sudo[99082]: pam_unix(sudo:session): session closed for user root Nov 06 15:28:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-16345418-58d9-4046-a354-f7440d51b504 tempest-VolumesDeleteCascade-1403262175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-2e089542-631b-4e2f-a658-412599a511c9.6cb34fb4-98a9-4b07-8443-790ab68e9ba2" returned: 0 in 0.692s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:28:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-16345418-58d9-4046-a354-f7440d51b504 tempest-VolumesDeleteCascade-1403262175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-2e089542-631b-4e2f-a658-412599a511c9.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:28:34 devstack sudo[99085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-2e089542-631b-4e2f-a658-412599a511c9.info Nov 06 15:28:34 devstack sudo[99085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:28:34 devstack sudo[99085]: pam_unix(sudo:session): session closed for user root Nov 06 15:28:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-16345418-58d9-4046-a354-f7440d51b504 tempest-VolumesDeleteCascade-1403262175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-2e089542-631b-4e2f-a658-412599a511c9.info" returned: 0 in 0.336s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:28:34 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-16345418-58d9-4046-a354-f7440d51b504 tempest-VolumesDeleteCascade-1403262175 None] /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-2e089542-631b-4e2f-a658-412599a511c9.info is being set with open permissions: ugo+rw Nov 06 15:28:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-16345418-58d9-4046-a354-f7440d51b504 tempest-VolumesDeleteCascade-1403262175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-2e089542-631b-4e2f-a658-412599a511c9.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:28:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-8d9a8c77-17ba-4f40-850e-4fb906b9c7f7 req-6f208c95-13a7-4751-87a9-d69ee373e84e tempest-TestMinimumBasicScenario-695150570 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:28:34 devstack sudo[99096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-2e089542-631b-4e2f-a658-412599a511c9.info Nov 06 15:28:34 devstack sudo[99096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:28:35 devstack sudo[99096]: pam_unix(sudo:session): session closed for user root Nov 06 15:28:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-16345418-58d9-4046-a354-f7440d51b504 tempest-VolumesDeleteCascade-1403262175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-2e089542-631b-4e2f-a658-412599a511c9.info" returned: 0 in 0.252s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:28:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-16345418-58d9-4046-a354-f7440d51b504 tempest-VolumesDeleteCascade-1403262175 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.043s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:28:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-8d9a8c77-17ba-4f40-850e-4fb906b9c7f7 req-6f208c95-13a7-4751-87a9-d69ee373e84e tempest-TestMinimumBasicScenario-695150570 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.255s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:28:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-8d9a8c77-17ba-4f40-850e-4fb906b9c7f7 req-6f208c95-13a7-4751-87a9-d69ee373e84e tempest-TestMinimumBasicScenario-695150570 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:28:35 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-16345418-58d9-4046-a354-f7440d51b504 tempest-VolumesDeleteCascade-1403262175 None] Create snapshot completed successfully Nov 06 15:28:35 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-8d9a8c77-17ba-4f40-850e-4fb906b9c7f7 req-6f208c95-13a7-4751-87a9-d69ee373e84e tempest-TestMinimumBasicScenario-695150570 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b', 'name': 'volume-34da549c-cadd-4301-96cf-213722ffa79a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '53b39914-32ff-4dde-bdeb-b2ee76f59bb0', 'enforce_multipath': True} {{(pid=87132) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 15:28:35 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-8d9a8c77-17ba-4f40-850e-4fb906b9c7f7 req-6f208c95-13a7-4751-87a9-d69ee373e84e tempest-TestMinimumBasicScenario-695150570 None] attachment_update completed successfully. Nov 06 15:28:36 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-a409d6e2-d58c-468f-b572-e1d9c3340678 tempest-VolumesDeleteCascade-1403262175 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:28:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a409d6e2-d58c-468f-b572-e1d9c3340678 tempest-VolumesDeleteCascade-1403262175 None] Flow 'volume_create_manager' (62a573dd-a074-4528-ba6c-7dc019a22404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:28:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a409d6e2-d58c-468f-b572-e1d9c3340678 tempest-VolumesDeleteCascade-1403262175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e6c9f6a-0c16-45ed-b44d-af1b8876377b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:28:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a409d6e2-d58c-468f-b572-e1d9c3340678 tempest-VolumesDeleteCascade-1403262175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e6c9f6a-0c16-45ed-b44d-af1b8876377b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:28:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-534046586',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8eea9454-d151-488e-b934-9eace4a46e0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f57e170f84984d9c83c6f0e97da1b798',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:28:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=6cb34fb4-98a9-4b07-8443-790ab68e9ba2,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:28:36Z,use_quota=True,user_id='fe984252e48341f38328889e12dee7dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:28:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a409d6e2-d58c-468f-b572-e1d9c3340678 tempest-VolumesDeleteCascade-1403262175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (146d6926-be81-4b7a-9a03-6a155b03d4b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:28:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a409d6e2-d58c-468f-b572-e1d9c3340678 tempest-VolumesDeleteCascade-1403262175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (146d6926-be81-4b7a-9a03-6a155b03d4b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:28:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a409d6e2-d58c-468f-b572-e1d9c3340678 tempest-VolumesDeleteCascade-1403262175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab6f4ee4-2871-475b-a1df-a10972b2af8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:28:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a409d6e2-d58c-468f-b572-e1d9c3340678 tempest-VolumesDeleteCascade-1403262175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab6f4ee4-2871-475b-a1df-a10972b2af8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8eea9454-d151-488e-b934-9eace4a46e0d', 'volume_name': 'volume-8eea9454-d151-488e-b934-9eace4a46e0d', 'volume_size': 1, 'snapshot_id': '6cb34fb4-98a9-4b07-8443-790ab68e9ba2'}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:28:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a409d6e2-d58c-468f-b572-e1d9c3340678 tempest-VolumesDeleteCascade-1403262175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f81c5ac0-cb45-4e86-87b3-fc73ac7c4dbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:28:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a409d6e2-d58c-468f-b572-e1d9c3340678 tempest-VolumesDeleteCascade-1403262175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f81c5ac0-cb45-4e86-87b3-fc73ac7c4dbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:28:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a409d6e2-d58c-468f-b572-e1d9c3340678 tempest-VolumesDeleteCascade-1403262175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bba60570-42c2-4713-8841-86429ed825d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:28:36 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-a409d6e2-d58c-468f-b572-e1d9c3340678 tempest-VolumesDeleteCascade-1403262175 None] Volume 8eea9454-d151-488e-b934-9eace4a46e0d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8eea9454-d151-488e-b934-9eace4a46e0d', 'volume_size': 1, 'snapshot_id': '6cb34fb4-98a9-4b07-8443-790ab68e9ba2'} Nov 06 15:28:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a409d6e2-d58c-468f-b572-e1d9c3340678 tempest-VolumesDeleteCascade-1403262175 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:28:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a409d6e2-d58c-468f-b572-e1d9c3340678 tempest-VolumesDeleteCascade-1403262175 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:28:36 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a409d6e2-d58c-468f-b572-e1d9c3340678 tempest-VolumesDeleteCascade-1403262175 None] Acquiring lock "cinder-quobyte-6cb34fb4-98a9-4b07-8443-790ab68e9ba2-8eea9454-d151-488e-b934-9eace4a46e0d" by "_create_volume_from_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:28:36 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a409d6e2-d58c-468f-b572-e1d9c3340678 tempest-VolumesDeleteCascade-1403262175 None] Lock "cinder-quobyte-6cb34fb4-98a9-4b07-8443-790ab68e9ba2-8eea9454-d151-488e-b934-9eace4a46e0d" acquired by "_create_volume_from_snapshot" :: waited 0.032s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:28:36 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-a409d6e2-d58c-468f-b572-e1d9c3340678 tempest-VolumesDeleteCascade-1403262175 None] Creating volume 8eea9454-d151-488e-b934-9eace4a46e0d from snapshot 6cb34fb4-98a9-4b07-8443-790ab68e9ba2 {{(pid=87132) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 06 15:28:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a409d6e2-d58c-468f-b572-e1d9c3340678 tempest-VolumesDeleteCascade-1403262175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:28:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a409d6e2-d58c-468f-b572-e1d9c3340678 tempest-VolumesDeleteCascade-1403262175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:28:36 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-a409d6e2-d58c-468f-b572-e1d9c3340678 tempest-VolumesDeleteCascade-1403262175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:28:36 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-a409d6e2-d58c-468f-b572-e1d9c3340678 tempest-VolumesDeleteCascade-1403262175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:28:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a409d6e2-d58c-468f-b572-e1d9c3340678 tempest-VolumesDeleteCascade-1403262175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:28:36 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-a409d6e2-d58c-468f-b572-e1d9c3340678 tempest-VolumesDeleteCascade-1403262175 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:28:36 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a409d6e2-d58c-468f-b572-e1d9c3340678 tempest-VolumesDeleteCascade-1403262175 None] Acquiring lock "cinder-quobyte-8eea9454-d151-488e-b934-9eace4a46e0d" by "_copy_volume_from_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:28:36 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a409d6e2-d58c-468f-b572-e1d9c3340678 tempest-VolumesDeleteCascade-1403262175 None] Lock "cinder-quobyte-8eea9454-d151-488e-b934-9eace4a46e0d" acquired by "_copy_volume_from_snapshot" :: waited 0.034s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:28:36 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-a409d6e2-d58c-468f-b572-e1d9c3340678 tempest-VolumesDeleteCascade-1403262175 None] snapshot: 6cb34fb4-98a9-4b07-8443-790ab68e9ba2, volume: 8eea9454-d151-488e-b934-9eace4a46e0d, {{(pid=87132) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 06 15:28:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a409d6e2-d58c-468f-b572-e1d9c3340678 tempest-VolumesDeleteCascade-1403262175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:28:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a409d6e2-d58c-468f-b572-e1d9c3340678 tempest-VolumesDeleteCascade-1403262175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:28:36 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-a409d6e2-d58c-468f-b572-e1d9c3340678 tempest-VolumesDeleteCascade-1403262175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:28:36 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-a409d6e2-d58c-468f-b572-e1d9c3340678 tempest-VolumesDeleteCascade-1403262175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:28:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a409d6e2-d58c-468f-b572-e1d9c3340678 tempest-VolumesDeleteCascade-1403262175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:28:36 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[092bf364-2670-4ba1-91ea-0ff048ac0e11]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:28:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a409d6e2-d58c-468f-b572-e1d9c3340678 tempest-VolumesDeleteCascade-1403262175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-2e089542-631b-4e2f-a658-412599a511c9.6cb34fb4-98a9-4b07-8443-790ab68e9ba2 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:28:36 devstack sudo[99516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-2e089542-631b-4e2f-a658-412599a511c9.6cb34fb4-98a9-4b07-8443-790ab68e9ba2 Nov 06 15:28:36 devstack sudo[99516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:28:36 devstack sudo[99516]: pam_unix(sudo:session): session closed for user root Nov 06 15:28:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a409d6e2-d58c-468f-b572-e1d9c3340678 tempest-VolumesDeleteCascade-1403262175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-2e089542-631b-4e2f-a658-412599a511c9.6cb34fb4-98a9-4b07-8443-790ab68e9ba2" returned: 0 in 0.428s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:28:37 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-a409d6e2-d58c-468f-b572-e1d9c3340678 tempest-VolumesDeleteCascade-1403262175 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2e089542-631b-4e2f-a658-412599a511c9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 15:28:37 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[80f80e66-8d6c-4597-9983-cee5125235e9]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:28:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a409d6e2-d58c-468f-b572-e1d9c3340678 tempest-VolumesDeleteCascade-1403262175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-2e089542-631b-4e2f-a658-412599a511c9 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:28:37 devstack sudo[99522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-2e089542-631b-4e2f-a658-412599a511c9 Nov 06 15:28:37 devstack sudo[99522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:28:37 devstack sudo[99522]: pam_unix(sudo:session): session closed for user root Nov 06 15:28:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a409d6e2-d58c-468f-b572-e1d9c3340678 tempest-VolumesDeleteCascade-1403262175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-2e089542-631b-4e2f-a658-412599a511c9" returned: 0 in 0.504s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:28:37 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-a409d6e2-d58c-468f-b572-e1d9c3340678 tempest-VolumesDeleteCascade-1403262175 None] will copy from snapshot at /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-2e089542-631b-4e2f-a658-412599a511c9 {{(pid=87132) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 06 15:28:37 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-a409d6e2-d58c-468f-b572-e1d9c3340678 tempest-VolumesDeleteCascade-1403262175 None] Creating direct copy from snapshot {{(pid=87132) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 06 15:28:37 devstack cinder-volume[87132]: DEBUG cinder.utils [None req-a409d6e2-d58c-468f-b572-e1d9c3340678 tempest-VolumesDeleteCascade-1403262175 None] Path /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-8eea9454-d151-488e-b934-9eace4a46e0d not found in is_blk_device check {{(pid=87132) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 06 15:28:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a409d6e2-d58c-468f-b572-e1d9c3340678 tempest-VolumesDeleteCascade-1403262175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-2e089542-631b-4e2f-a658-412599a511c9 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-8eea9454-d151-488e-b934-9eace4a46e0d {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:28:37 devstack sudo[99528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-2e089542-631b-4e2f-a658-412599a511c9 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-8eea9454-d151-488e-b934-9eace4a46e0d Nov 06 15:28:37 devstack sudo[99528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:28:46 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:UPDATE=65,cinder:SELECT=81,cinder:INSERT=26,cinder:DELETE=6 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 15:28:46 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:SELECT=75,cinder:UPDATE=74,cinder:INSERT=21,cinder:DELETE=5 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 15:28:47 devstack sudo[99528]: pam_unix(sudo:session): session closed for user root Nov 06 15:28:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a409d6e2-d58c-468f-b572-e1d9c3340678 tempest-VolumesDeleteCascade-1403262175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-2e089542-631b-4e2f-a658-412599a511c9 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-8eea9454-d151-488e-b934-9eace4a46e0d" returned: 0 in 9.466s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:28:47 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-a409d6e2-d58c-468f-b572-e1d9c3340678 tempest-VolumesDeleteCascade-1403262175 None] Image conversion details: src /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-2e089542-631b-4e2f-a658-412599a511c9, size 1024.00 MB, duration 9.47 sec, destination /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-8eea9454-d151-488e-b934-9eace4a46e0d {{(pid=87132) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 06 15:28:47 devstack cinder-volume[87132]: INFO cinder.image.image_utils [None req-a409d6e2-d58c-468f-b572-e1d9c3340678 tempest-VolumesDeleteCascade-1403262175 None] Converted 1024.00 MB image at 108.16 MB/s Nov 06 15:28:47 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-a409d6e2-d58c-468f-b572-e1d9c3340678 tempest-VolumesDeleteCascade-1403262175 None] /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-8eea9454-d151-488e-b934-9eace4a46e0d is being set with open permissions: ugo+rw Nov 06 15:28:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a409d6e2-d58c-468f-b572-e1d9c3340678 tempest-VolumesDeleteCascade-1403262175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-8eea9454-d151-488e-b934-9eace4a46e0d {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:28:47 devstack sudo[99575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-8eea9454-d151-488e-b934-9eace4a46e0d Nov 06 15:28:47 devstack sudo[99575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:28:47 devstack sudo[99575]: pam_unix(sudo:session): session closed for user root Nov 06 15:28:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a409d6e2-d58c-468f-b572-e1d9c3340678 tempest-VolumesDeleteCascade-1403262175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-8eea9454-d151-488e-b934-9eace4a46e0d" returned: 0 in 0.360s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:28:47 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a409d6e2-d58c-468f-b572-e1d9c3340678 tempest-VolumesDeleteCascade-1403262175 None] Lock "cinder-quobyte-8eea9454-d151-488e-b934-9eace4a46e0d" released by "_copy_volume_from_snapshot" :: held 10.885s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:28:47 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a409d6e2-d58c-468f-b572-e1d9c3340678 tempest-VolumesDeleteCascade-1403262175 None] Lock "cinder-quobyte-6cb34fb4-98a9-4b07-8443-790ab68e9ba2-8eea9454-d151-488e-b934-9eace4a46e0d" released by "_create_volume_from_snapshot" :: held 11.028s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:28:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a409d6e2-d58c-468f-b572-e1d9c3340678 tempest-VolumesDeleteCascade-1403262175 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.062s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:28:47 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a409d6e2-d58c-468f-b572-e1d9c3340678 tempest-VolumesDeleteCascade-1403262175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bba60570-42c2-4713-8841-86429ed825d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8eea9454-d151-488e-b934-9eace4a46e0d', 'volume_size': 1, 'snapshot_id': '6cb34fb4-98a9-4b07-8443-790ab68e9ba2'}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:28:47 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a409d6e2-d58c-468f-b572-e1d9c3340678 tempest-VolumesDeleteCascade-1403262175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5f0d318-60de-4ceb-bf36-e3b3f1475681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:28:47 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-a409d6e2-d58c-468f-b572-e1d9c3340678 tempest-VolumesDeleteCascade-1403262175 None] Volume volume-8eea9454-d151-488e-b934-9eace4a46e0d (8eea9454-d151-488e-b934-9eace4a46e0d): created successfully Nov 06 15:28:47 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a409d6e2-d58c-468f-b572-e1d9c3340678 tempest-VolumesDeleteCascade-1403262175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5f0d318-60de-4ceb-bf36-e3b3f1475681) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:28:47 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a409d6e2-d58c-468f-b572-e1d9c3340678 tempest-VolumesDeleteCascade-1403262175 None] Flow 'volume_create_manager' (62a573dd-a074-4528-ba6c-7dc019a22404) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:28:47 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-a409d6e2-d58c-468f-b572-e1d9c3340678 tempest-VolumesDeleteCascade-1403262175 None] Created volume successfully. Nov 06 15:28:48 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e7e53842-dba0-4424-ade9-e84959f21a45 tempest-VolumesDeleteCascade-1403262175 None] Acquiring lock "cinder-2e089542-631b-4e2f-a658-412599a511c9-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:28:48 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e7e53842-dba0-4424-ade9-e84959f21a45 tempest-VolumesDeleteCascade-1403262175 None] Lock "cinder-2e089542-631b-4e2f-a658-412599a511c9-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:28:48 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e7e53842-dba0-4424-ade9-e84959f21a45 tempest-VolumesDeleteCascade-1403262175 None] Performing cascade delete. {{(pid=87132) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Nov 06 15:28:48 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e7e53842-dba0-4424-ade9-e84959f21a45 tempest-VolumesDeleteCascade-1403262175 None] Acquiring lock "cinder-6cb34fb4-98a9-4b07-8443-790ab68e9ba2-delete_snapshot" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:28:48 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e7e53842-dba0-4424-ade9-e84959f21a45 tempest-VolumesDeleteCascade-1403262175 None] Lock "cinder-6cb34fb4-98a9-4b07-8443-790ab68e9ba2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:28:48 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e7e53842-dba0-4424-ade9-e84959f21a45 tempest-VolumesDeleteCascade-1403262175 None] Acquiring lock "cinder-quobyte-2e089542-631b-4e2f-a658-412599a511c9" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:28:48 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e7e53842-dba0-4424-ade9-e84959f21a45 tempest-VolumesDeleteCascade-1403262175 None] Lock "cinder-quobyte-2e089542-631b-4e2f-a658-412599a511c9" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:28:48 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e7e53842-dba0-4424-ade9-e84959f21a45 tempest-VolumesDeleteCascade-1403262175 None] Acquiring lock "cinder-quobyte-6cb34fb4-98a9-4b07-8443-790ab68e9ba2" by "_delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:28:48 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e7e53842-dba0-4424-ade9-e84959f21a45 tempest-VolumesDeleteCascade-1403262175 None] Lock "cinder-quobyte-6cb34fb4-98a9-4b07-8443-790ab68e9ba2" acquired by "_delete_snapshot" :: waited 0.049s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:28:48 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-e7e53842-dba0-4424-ade9-e84959f21a45 tempest-VolumesDeleteCascade-1403262175 None] Deleting offline snapshot 6cb34fb4-98a9-4b07-8443-790ab68e9ba2 of volume 2e089542-631b-4e2f-a658-412599a511c9 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 15:28:48 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-e7e53842-dba0-4424-ade9-e84959f21a45 tempest-VolumesDeleteCascade-1403262175 None] snapshot_file for this snap is: volume-2e089542-631b-4e2f-a658-412599a511c9.6cb34fb4-98a9-4b07-8443-790ab68e9ba2 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 15:28:48 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[029653e5-da8b-4ef0-a329-c2e40a98db31]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:28:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e7e53842-dba0-4424-ade9-e84959f21a45 tempest-VolumesDeleteCascade-1403262175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-2e089542-631b-4e2f-a658-412599a511c9.6cb34fb4-98a9-4b07-8443-790ab68e9ba2 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:28:48 devstack sudo[99598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-2e089542-631b-4e2f-a658-412599a511c9.6cb34fb4-98a9-4b07-8443-790ab68e9ba2 Nov 06 15:28:48 devstack sudo[99598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:28:48 devstack sudo[99598]: pam_unix(sudo:session): session closed for user root Nov 06 15:28:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e7e53842-dba0-4424-ade9-e84959f21a45 tempest-VolumesDeleteCascade-1403262175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-2e089542-631b-4e2f-a658-412599a511c9.6cb34fb4-98a9-4b07-8443-790ab68e9ba2" returned: 0 in 0.497s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:28:48 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-e7e53842-dba0-4424-ade9-e84959f21a45 tempest-VolumesDeleteCascade-1403262175 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2e089542-631b-4e2f-a658-412599a511c9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 15:28:49 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[d78398dd-fe1b-431c-b7e9-4671e0031b5a]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:28:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e7e53842-dba0-4424-ade9-e84959f21a45 tempest-VolumesDeleteCascade-1403262175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-2e089542-631b-4e2f-a658-412599a511c9 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:28:49 devstack sudo[99605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-2e089542-631b-4e2f-a658-412599a511c9 Nov 06 15:28:49 devstack sudo[99605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:28:49 devstack sudo[99605]: pam_unix(sudo:session): session closed for user root Nov 06 15:28:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e7e53842-dba0-4424-ade9-e84959f21a45 tempest-VolumesDeleteCascade-1403262175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-2e089542-631b-4e2f-a658-412599a511c9" returned: 0 in 0.780s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:28:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e7e53842-dba0-4424-ade9-e84959f21a45 tempest-VolumesDeleteCascade-1403262175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-2e089542-631b-4e2f-a658-412599a511c9.6cb34fb4-98a9-4b07-8443-790ab68e9ba2 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:28:49 devstack sudo[99613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-2e089542-631b-4e2f-a658-412599a511c9.6cb34fb4-98a9-4b07-8443-790ab68e9ba2 Nov 06 15:28:49 devstack sudo[99613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:28:50 devstack sudo[99613]: pam_unix(sudo:session): session closed for user root Nov 06 15:28:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e7e53842-dba0-4424-ade9-e84959f21a45 tempest-VolumesDeleteCascade-1403262175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-2e089542-631b-4e2f-a658-412599a511c9.6cb34fb4-98a9-4b07-8443-790ab68e9ba2" returned: 0 in 0.651s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:28:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e7e53842-dba0-4424-ade9-e84959f21a45 tempest-VolumesDeleteCascade-1403262175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-2e089542-631b-4e2f-a658-412599a511c9.6cb34fb4-98a9-4b07-8443-790ab68e9ba2 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:28:50 devstack sudo[99620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-2e089542-631b-4e2f-a658-412599a511c9.6cb34fb4-98a9-4b07-8443-790ab68e9ba2 Nov 06 15:28:50 devstack sudo[99620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:28:50 devstack sudo[99620]: pam_unix(sudo:session): session closed for user root Nov 06 15:28:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e7e53842-dba0-4424-ade9-e84959f21a45 tempest-VolumesDeleteCascade-1403262175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-2e089542-631b-4e2f-a658-412599a511c9.6cb34fb4-98a9-4b07-8443-790ab68e9ba2" returned: 0 in 0.346s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:28:50 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e7e53842-dba0-4424-ade9-e84959f21a45 tempest-VolumesDeleteCascade-1403262175 None] Lock "cinder-quobyte-6cb34fb4-98a9-4b07-8443-790ab68e9ba2" released by "_delete_snapshot" :: held 2.442s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:28:50 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e7e53842-dba0-4424-ade9-e84959f21a45 tempest-VolumesDeleteCascade-1403262175 None] Lock "cinder-quobyte-2e089542-631b-4e2f-a658-412599a511c9" released by "delete_snapshot" :: held 2.511s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:28:50 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-e7e53842-dba0-4424-ade9-e84959f21a45 tempest-VolumesDeleteCascade-1403262175 None] Created reservations ['9beef8d3-895d-4b9e-8258-8deef57cc9df', '16b036bc-5846-4011-869c-021f8421791c', 'b6267898-d009-44d4-ac8a-5386ecd7ba45', '19e54728-d1ca-4494-ab50-554a574e2982'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:28:51 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-e7e53842-dba0-4424-ade9-e84959f21a45 tempest-VolumesDeleteCascade-1403262175 None] Delete snapshot completed successfully. Nov 06 15:28:51 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e7e53842-dba0-4424-ade9-e84959f21a45 tempest-VolumesDeleteCascade-1403262175 None] Lock "cinder-6cb34fb4-98a9-4b07-8443-790ab68e9ba2-delete_snapshot" released by "delete_snapshot" :: held 2.824s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:28:51 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e7e53842-dba0-4424-ade9-e84959f21a45 tempest-VolumesDeleteCascade-1403262175 None] Snapshots deleted, issuing volume delete {{(pid=87132) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Nov 06 15:28:51 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e7e53842-dba0-4424-ade9-e84959f21a45 tempest-VolumesDeleteCascade-1403262175 None] Acquiring lock "cinder-quobyte-2e089542-631b-4e2f-a658-412599a511c9" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:28:51 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e7e53842-dba0-4424-ade9-e84959f21a45 tempest-VolumesDeleteCascade-1403262175 None] Lock "cinder-quobyte-2e089542-631b-4e2f-a658-412599a511c9" acquired by "delete_volume" :: waited 0.021s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:28:51 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[c167cdec-a617-48db-b7d9-778452cfe951]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:28:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e7e53842-dba0-4424-ade9-e84959f21a45 tempest-VolumesDeleteCascade-1403262175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-2e089542-631b-4e2f-a658-412599a511c9 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:28:51 devstack sudo[99624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-2e089542-631b-4e2f-a658-412599a511c9 Nov 06 15:28:51 devstack sudo[99624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:28:51 devstack sudo[99624]: pam_unix(sudo:session): session closed for user root Nov 06 15:28:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e7e53842-dba0-4424-ade9-e84959f21a45 tempest-VolumesDeleteCascade-1403262175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-2e089542-631b-4e2f-a658-412599a511c9" returned: 0 in 0.569s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:28:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e7e53842-dba0-4424-ade9-e84959f21a45 tempest-VolumesDeleteCascade-1403262175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-2e089542-631b-4e2f-a658-412599a511c9 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:28:51 devstack sudo[99631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-2e089542-631b-4e2f-a658-412599a511c9 Nov 06 15:28:51 devstack sudo[99631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:28:52 devstack sudo[99631]: pam_unix(sudo:session): session closed for user root Nov 06 15:28:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e7e53842-dba0-4424-ade9-e84959f21a45 tempest-VolumesDeleteCascade-1403262175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-2e089542-631b-4e2f-a658-412599a511c9" returned: 0 in 0.420s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:28:52 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e7e53842-dba0-4424-ade9-e84959f21a45 tempest-VolumesDeleteCascade-1403262175 None] Lock "cinder-quobyte-2e089542-631b-4e2f-a658-412599a511c9" released by "delete_volume" :: held 1.085s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:28:52 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-e7e53842-dba0-4424-ade9-e84959f21a45 tempest-VolumesDeleteCascade-1403262175 None] Created reservations ['e4dd1a26-f4a8-472b-a309-c1f14b39aee2', '2a864715-e7f0-4a3f-a5c9-519a24a6a9ed', '44adffb3-c221-482f-9a03-cf4c6f8b6a87', 'bba92d8d-7f22-4d02-8343-756458b056bf'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:28:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e7e53842-dba0-4424-ade9-e84959f21a45 tempest-VolumesDeleteCascade-1403262175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:28:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e7e53842-dba0-4424-ade9-e84959f21a45 tempest-VolumesDeleteCascade-1403262175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:28:52 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e7e53842-dba0-4424-ade9-e84959f21a45 tempest-VolumesDeleteCascade-1403262175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:28:52 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e7e53842-dba0-4424-ade9-e84959f21a45 tempest-VolumesDeleteCascade-1403262175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:28:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e7e53842-dba0-4424-ade9-e84959f21a45 tempest-VolumesDeleteCascade-1403262175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:28:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e7e53842-dba0-4424-ade9-e84959f21a45 tempest-VolumesDeleteCascade-1403262175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:28:52 devstack sudo[99636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:28:52 devstack sudo[99636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:28:52 devstack sudo[99636]: pam_unix(sudo:session): session closed for user root Nov 06 15:28:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e7e53842-dba0-4424-ade9-e84959f21a45 tempest-VolumesDeleteCascade-1403262175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.392s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:28:52 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-e7e53842-dba0-4424-ade9-e84959f21a45 tempest-VolumesDeleteCascade-1403262175 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:28:52 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-e7e53842-dba0-4424-ade9-e84959f21a45 tempest-VolumesDeleteCascade-1403262175 None] Deleted volume successfully. Nov 06 15:28:52 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e7e53842-dba0-4424-ade9-e84959f21a45 tempest-VolumesDeleteCascade-1403262175 None] Lock "cinder-2e089542-631b-4e2f-a658-412599a511c9-delete_volume" released by "delete_volume" :: held 4.689s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:28:52 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-9bdf7dfa-6b0a-43ed-816d-e22e6d135a84 tempest-VolumesDeleteCascade-1403262175 None] Acquiring lock "cinder-8eea9454-d151-488e-b934-9eace4a46e0d-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:28:52 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-9bdf7dfa-6b0a-43ed-816d-e22e6d135a84 tempest-VolumesDeleteCascade-1403262175 None] Lock "cinder-8eea9454-d151-488e-b934-9eace4a46e0d-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:28:52 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-9bdf7dfa-6b0a-43ed-816d-e22e6d135a84 tempest-VolumesDeleteCascade-1403262175 None] Acquiring lock "cinder-quobyte-8eea9454-d151-488e-b934-9eace4a46e0d" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:28:52 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-9bdf7dfa-6b0a-43ed-816d-e22e6d135a84 tempest-VolumesDeleteCascade-1403262175 None] Lock "cinder-quobyte-8eea9454-d151-488e-b934-9eace4a46e0d" acquired by "delete_volume" :: waited 0.019s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:28:53 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[f03b1a4b-bbcd-4cf4-91b9-d2cad505e265]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:28:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9bdf7dfa-6b0a-43ed-816d-e22e6d135a84 tempest-VolumesDeleteCascade-1403262175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-8eea9454-d151-488e-b934-9eace4a46e0d {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:28:53 devstack sudo[99639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-8eea9454-d151-488e-b934-9eace4a46e0d Nov 06 15:28:53 devstack sudo[99639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:28:53 devstack sudo[99639]: pam_unix(sudo:session): session closed for user root Nov 06 15:28:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9bdf7dfa-6b0a-43ed-816d-e22e6d135a84 tempest-VolumesDeleteCascade-1403262175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-8eea9454-d151-488e-b934-9eace4a46e0d" returned: 0 in 0.697s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:28:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9bdf7dfa-6b0a-43ed-816d-e22e6d135a84 tempest-VolumesDeleteCascade-1403262175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-8eea9454-d151-488e-b934-9eace4a46e0d {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:28:53 devstack sudo[99644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-8eea9454-d151-488e-b934-9eace4a46e0d Nov 06 15:28:53 devstack sudo[99644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:28:54 devstack sudo[99644]: pam_unix(sudo:session): session closed for user root Nov 06 15:28:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9bdf7dfa-6b0a-43ed-816d-e22e6d135a84 tempest-VolumesDeleteCascade-1403262175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-8eea9454-d151-488e-b934-9eace4a46e0d" returned: 0 in 0.424s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:28:54 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-9bdf7dfa-6b0a-43ed-816d-e22e6d135a84 tempest-VolumesDeleteCascade-1403262175 None] Lock "cinder-quobyte-8eea9454-d151-488e-b934-9eace4a46e0d" released by "delete_volume" :: held 1.199s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:28:54 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-9bdf7dfa-6b0a-43ed-816d-e22e6d135a84 tempest-VolumesDeleteCascade-1403262175 None] Created reservations ['b2541832-cc23-4155-89f6-a8e540f762a3', '6ebe0684-97ed-4299-84eb-0613ea22d2e2', 'c8c42809-87b9-45d7-9b63-0561b9dafe35', 'ca0abae3-7e7e-42e0-8104-93abc842d524'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:28:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9bdf7dfa-6b0a-43ed-816d-e22e6d135a84 tempest-VolumesDeleteCascade-1403262175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:28:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9bdf7dfa-6b0a-43ed-816d-e22e6d135a84 tempest-VolumesDeleteCascade-1403262175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:28:54 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-9bdf7dfa-6b0a-43ed-816d-e22e6d135a84 tempest-VolumesDeleteCascade-1403262175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:28:54 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-9bdf7dfa-6b0a-43ed-816d-e22e6d135a84 tempest-VolumesDeleteCascade-1403262175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:28:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9bdf7dfa-6b0a-43ed-816d-e22e6d135a84 tempest-VolumesDeleteCascade-1403262175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:28:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9bdf7dfa-6b0a-43ed-816d-e22e6d135a84 tempest-VolumesDeleteCascade-1403262175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:28:54 devstack sudo[99647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:28:54 devstack sudo[99647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:28:54 devstack sudo[99647]: pam_unix(sudo:session): session closed for user root Nov 06 15:28:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9bdf7dfa-6b0a-43ed-816d-e22e6d135a84 tempest-VolumesDeleteCascade-1403262175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.273s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:28:54 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-9bdf7dfa-6b0a-43ed-816d-e22e6d135a84 tempest-VolumesDeleteCascade-1403262175 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:28:54 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-9bdf7dfa-6b0a-43ed-816d-e22e6d135a84 tempest-VolumesDeleteCascade-1403262175 None] Deleted volume successfully. Nov 06 15:28:54 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-9bdf7dfa-6b0a-43ed-816d-e22e6d135a84 tempest-VolumesDeleteCascade-1403262175 None] Lock "cinder-8eea9454-d151-488e-b934-9eace4a46e0d-delete_volume" released by "delete_volume" :: held 1.735s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:28:54 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-73a48426-c6bd-4641-9fa4-e05832516344 tempest-CreateVolumesFromImageTest-946342167 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:28:55 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-73a48426-c6bd-4641-9fa4-e05832516344 tempest-CreateVolumesFromImageTest-946342167 None] Flow 'volume_create_manager' (c3ebea6d-9237-482e-93ef-bc2527bae02d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:28:55 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-73a48426-c6bd-4641-9fa4-e05832516344 tempest-CreateVolumesFromImageTest-946342167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac2ed301-3327-44ec-af00-518277f681da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:28:55 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-73a48426-c6bd-4641-9fa4-e05832516344 tempest-CreateVolumesFromImageTest-946342167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac2ed301-3327-44ec-af00-518277f681da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:28:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-158377432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=072f9bad-ffb7-44a8-bbfa-d58fb18ddfbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79dc869aa03f4fbc86739bc68dfc7eda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:28:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:28:55Z,use_quota=True,user_id='9dda65a285a4410fade8a01459c0b384',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:28:55 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-73a48426-c6bd-4641-9fa4-e05832516344 tempest-CreateVolumesFromImageTest-946342167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c14391c9-521e-4206-a9db-982947f2a105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:28:55 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-73a48426-c6bd-4641-9fa4-e05832516344 tempest-CreateVolumesFromImageTest-946342167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c14391c9-521e-4206-a9db-982947f2a105) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:28:55 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-73a48426-c6bd-4641-9fa4-e05832516344 tempest-CreateVolumesFromImageTest-946342167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59fffb87-bdb5-411d-91ce-0cda6889cf42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:28:55 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-73a48426-c6bd-4641-9fa4-e05832516344 tempest-CreateVolumesFromImageTest-946342167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59fffb87-bdb5-411d-91ce-0cda6889cf42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '072f9bad-ffb7-44a8-bbfa-d58fb18ddfbb', 'volume_name': 'volume-072f9bad-ffb7-44a8-bbfa-d58fb18ddfbb', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:28:55 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-73a48426-c6bd-4641-9fa4-e05832516344 tempest-CreateVolumesFromImageTest-946342167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6548c610-b713-45ad-b965-ee2339ef9320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:28:55 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-73a48426-c6bd-4641-9fa4-e05832516344 tempest-CreateVolumesFromImageTest-946342167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6548c610-b713-45ad-b965-ee2339ef9320) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:28:55 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-73a48426-c6bd-4641-9fa4-e05832516344 tempest-CreateVolumesFromImageTest-946342167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9d82e13-3ead-43e2-8fa0-d44a245e3800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:28:55 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-73a48426-c6bd-4641-9fa4-e05832516344 tempest-CreateVolumesFromImageTest-946342167 None] Volume 072f9bad-ffb7-44a8-bbfa-d58fb18ddfbb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-072f9bad-ffb7-44a8-bbfa-d58fb18ddfbb', 'volume_size': 1} Nov 06 15:28:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-73a48426-c6bd-4641-9fa4-e05832516344 tempest-CreateVolumesFromImageTest-946342167 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:28:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-73a48426-c6bd-4641-9fa4-e05832516344 tempest-CreateVolumesFromImageTest-946342167 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:28:55 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-73a48426-c6bd-4641-9fa4-e05832516344 tempest-CreateVolumesFromImageTest-946342167 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:28:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-158377432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=072f9bad-ffb7-44a8-bbfa-d58fb18ddfbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79dc869aa03f4fbc86739bc68dfc7eda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:28:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:28:55Z,use_quota=True,user_id='9dda65a285a4410fade8a01459c0b384',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:28:55 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-73a48426-c6bd-4641-9fa4-e05832516344 tempest-CreateVolumesFromImageTest-946342167 None] Creating volume 072f9bad-ffb7-44a8-bbfa-d58fb18ddfbb {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:28:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-73a48426-c6bd-4641-9fa4-e05832516344 tempest-CreateVolumesFromImageTest-946342167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:28:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-73a48426-c6bd-4641-9fa4-e05832516344 tempest-CreateVolumesFromImageTest-946342167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:28:55 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-73a48426-c6bd-4641-9fa4-e05832516344 tempest-CreateVolumesFromImageTest-946342167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:28:55 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-73a48426-c6bd-4641-9fa4-e05832516344 tempest-CreateVolumesFromImageTest-946342167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:28:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-73a48426-c6bd-4641-9fa4-e05832516344 tempest-CreateVolumesFromImageTest-946342167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:28:55 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-73a48426-c6bd-4641-9fa4-e05832516344 tempest-CreateVolumesFromImageTest-946342167 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:28:55 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-73a48426-c6bd-4641-9fa4-e05832516344 tempest-CreateVolumesFromImageTest-946342167 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:28:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-73a48426-c6bd-4641-9fa4-e05832516344 tempest-CreateVolumesFromImageTest-946342167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-072f9bad-ffb7-44a8-bbfa-d58fb18ddfbb 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:28:55 devstack sudo[99650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-072f9bad-ffb7-44a8-bbfa-d58fb18ddfbb 1073741824 Nov 06 15:28:55 devstack sudo[99650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:28:55 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-008ae548-c9b9-43c9-935b-0f3b29d953dd tempest-CreateVolumesFromImageTest-946342167 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:28:55 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-008ae548-c9b9-43c9-935b-0f3b29d953dd tempest-CreateVolumesFromImageTest-946342167 None] Flow 'volume_create_manager' (9f9a9c0b-b65f-4eba-98e7-38a160d033b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:28:55 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-008ae548-c9b9-43c9-935b-0f3b29d953dd tempest-CreateVolumesFromImageTest-946342167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4096ca8-e0f1-4fc4-860d-f4cb5f4a5bb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:28:55 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-008ae548-c9b9-43c9-935b-0f3b29d953dd tempest-CreateVolumesFromImageTest-946342167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4096ca8-e0f1-4fc4-860d-f4cb5f4a5bb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:28:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1523997086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85c7c06b-c000-4da5-b1fa-5ef08d5224e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79dc869aa03f4fbc86739bc68dfc7eda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:28:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:28:55Z,use_quota=True,user_id='9dda65a285a4410fade8a01459c0b384',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:28:55 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-008ae548-c9b9-43c9-935b-0f3b29d953dd tempest-CreateVolumesFromImageTest-946342167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19ebbc9f-4f51-428a-9a3b-3436de00c8ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:28:55 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-008ae548-c9b9-43c9-935b-0f3b29d953dd tempest-CreateVolumesFromImageTest-946342167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19ebbc9f-4f51-428a-9a3b-3436de00c8ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:28:55 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-008ae548-c9b9-43c9-935b-0f3b29d953dd tempest-CreateVolumesFromImageTest-946342167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40d8fe40-ca9c-44e7-b5a9-b33395839d90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:28:55 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-008ae548-c9b9-43c9-935b-0f3b29d953dd tempest-CreateVolumesFromImageTest-946342167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40d8fe40-ca9c-44e7-b5a9-b33395839d90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85c7c06b-c000-4da5-b1fa-5ef08d5224e6', 'volume_name': 'volume-85c7c06b-c000-4da5-b1fa-5ef08d5224e6', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:28:55 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-008ae548-c9b9-43c9-935b-0f3b29d953dd tempest-CreateVolumesFromImageTest-946342167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aee8b2d6-699c-4888-9aaf-d0bbf499844d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:28:55 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-008ae548-c9b9-43c9-935b-0f3b29d953dd tempest-CreateVolumesFromImageTest-946342167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aee8b2d6-699c-4888-9aaf-d0bbf499844d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:28:55 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-008ae548-c9b9-43c9-935b-0f3b29d953dd tempest-CreateVolumesFromImageTest-946342167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6914e772-0d21-4ee8-ad63-210a1b5665a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:28:55 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-008ae548-c9b9-43c9-935b-0f3b29d953dd tempest-CreateVolumesFromImageTest-946342167 None] Volume 85c7c06b-c000-4da5-b1fa-5ef08d5224e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85c7c06b-c000-4da5-b1fa-5ef08d5224e6', 'volume_size': 1} Nov 06 15:28:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-008ae548-c9b9-43c9-935b-0f3b29d953dd tempest-CreateVolumesFromImageTest-946342167 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:28:55 devstack sudo[99650]: pam_unix(sudo:session): session closed for user root Nov 06 15:28:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-73a48426-c6bd-4641-9fa4-e05832516344 tempest-CreateVolumesFromImageTest-946342167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-072f9bad-ffb7-44a8-bbfa-d58fb18ddfbb 1073741824" returned: 0 in 0.676s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:28:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-73a48426-c6bd-4641-9fa4-e05832516344 tempest-CreateVolumesFromImageTest-946342167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-072f9bad-ffb7-44a8-bbfa-d58fb18ddfbb {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:28:55 devstack sudo[99715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-072f9bad-ffb7-44a8-bbfa-d58fb18ddfbb Nov 06 15:28:55 devstack sudo[99715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:28:56 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c1fc908-0aaa-4694-bf90-2889dd6a9318 tempest-CreateVolumesFromImageTest-946342167 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:28:56 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7c1fc908-0aaa-4694-bf90-2889dd6a9318 tempest-CreateVolumesFromImageTest-946342167 None] Flow 'volume_create_manager' (799ad1d5-be16-4123-89e1-47a374b4626c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:28:56 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7c1fc908-0aaa-4694-bf90-2889dd6a9318 tempest-CreateVolumesFromImageTest-946342167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c458d7ec-94b6-473b-a4a5-df047d4c1459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:28:56 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7c1fc908-0aaa-4694-bf90-2889dd6a9318 tempest-CreateVolumesFromImageTest-946342167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c458d7ec-94b6-473b-a4a5-df047d4c1459) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:28:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1189727668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a2e3021-025b-4012-a8e1-6e4952451cb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79dc869aa03f4fbc86739bc68dfc7eda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:28:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:28:56Z,use_quota=True,user_id='9dda65a285a4410fade8a01459c0b384',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:28:56 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7c1fc908-0aaa-4694-bf90-2889dd6a9318 tempest-CreateVolumesFromImageTest-946342167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b19ff9d-56b4-46c1-8765-475a9412e45b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:28:56 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7c1fc908-0aaa-4694-bf90-2889dd6a9318 tempest-CreateVolumesFromImageTest-946342167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b19ff9d-56b4-46c1-8765-475a9412e45b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:28:56 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7c1fc908-0aaa-4694-bf90-2889dd6a9318 tempest-CreateVolumesFromImageTest-946342167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0af9383c-ca94-4349-9c3b-5d73852aaf41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:28:56 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7c1fc908-0aaa-4694-bf90-2889dd6a9318 tempest-CreateVolumesFromImageTest-946342167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0af9383c-ca94-4349-9c3b-5d73852aaf41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a2e3021-025b-4012-a8e1-6e4952451cb7', 'volume_name': 'volume-9a2e3021-025b-4012-a8e1-6e4952451cb7', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:28:56 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7c1fc908-0aaa-4694-bf90-2889dd6a9318 tempest-CreateVolumesFromImageTest-946342167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ef34bf7-dfdf-47ec-af30-74ec9efadca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:28:56 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7c1fc908-0aaa-4694-bf90-2889dd6a9318 tempest-CreateVolumesFromImageTest-946342167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ef34bf7-dfdf-47ec-af30-74ec9efadca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:28:56 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7c1fc908-0aaa-4694-bf90-2889dd6a9318 tempest-CreateVolumesFromImageTest-946342167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9788720d-b8e5-48cd-b67e-578bf470f543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:28:56 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-7c1fc908-0aaa-4694-bf90-2889dd6a9318 tempest-CreateVolumesFromImageTest-946342167 None] Volume 9a2e3021-025b-4012-a8e1-6e4952451cb7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a2e3021-025b-4012-a8e1-6e4952451cb7', 'volume_size': 1} Nov 06 15:28:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7c1fc908-0aaa-4694-bf90-2889dd6a9318 tempest-CreateVolumesFromImageTest-946342167 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:28:56 devstack sudo[99715]: pam_unix(sudo:session): session closed for user root Nov 06 15:28:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-73a48426-c6bd-4641-9fa4-e05832516344 tempest-CreateVolumesFromImageTest-946342167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-072f9bad-ffb7-44a8-bbfa-d58fb18ddfbb" returned: 0 in 0.523s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:28:56 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-73a48426-c6bd-4641-9fa4-e05832516344 tempest-CreateVolumesFromImageTest-946342167 None] <== create_volume: return (1291ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:28:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-73a48426-c6bd-4641-9fa4-e05832516344 tempest-CreateVolumesFromImageTest-946342167 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.294s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:28:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-008ae548-c9b9-43c9-935b-0f3b29d953dd tempest-CreateVolumesFromImageTest-946342167 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.805s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:28:56 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-008ae548-c9b9-43c9-935b-0f3b29d953dd tempest-CreateVolumesFromImageTest-946342167 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:28:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1523997086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85c7c06b-c000-4da5-b1fa-5ef08d5224e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79dc869aa03f4fbc86739bc68dfc7eda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:28:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:28:55Z,use_quota=True,user_id='9dda65a285a4410fade8a01459c0b384',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:28:56 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-008ae548-c9b9-43c9-935b-0f3b29d953dd tempest-CreateVolumesFromImageTest-946342167 None] Creating volume 85c7c06b-c000-4da5-b1fa-5ef08d5224e6 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:28:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-008ae548-c9b9-43c9-935b-0f3b29d953dd tempest-CreateVolumesFromImageTest-946342167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:28:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-008ae548-c9b9-43c9-935b-0f3b29d953dd tempest-CreateVolumesFromImageTest-946342167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:28:56 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-008ae548-c9b9-43c9-935b-0f3b29d953dd tempest-CreateVolumesFromImageTest-946342167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:28:56 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-008ae548-c9b9-43c9-935b-0f3b29d953dd tempest-CreateVolumesFromImageTest-946342167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:28:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-008ae548-c9b9-43c9-935b-0f3b29d953dd tempest-CreateVolumesFromImageTest-946342167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.044s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:28:56 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-008ae548-c9b9-43c9-935b-0f3b29d953dd tempest-CreateVolumesFromImageTest-946342167 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:28:56 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-008ae548-c9b9-43c9-935b-0f3b29d953dd tempest-CreateVolumesFromImageTest-946342167 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:28:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-008ae548-c9b9-43c9-935b-0f3b29d953dd tempest-CreateVolumesFromImageTest-946342167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-85c7c06b-c000-4da5-b1fa-5ef08d5224e6 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:28:56 devstack sudo[99720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-85c7c06b-c000-4da5-b1fa-5ef08d5224e6 1073741824 Nov 06 15:28:56 devstack sudo[99720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:28:56 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-73a48426-c6bd-4641-9fa4-e05832516344 tempest-CreateVolumesFromImageTest-946342167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9d82e13-3ead-43e2-8fa0-d44a245e3800) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-072f9bad-ffb7-44a8-bbfa-d58fb18ddfbb', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:28:56 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-73a48426-c6bd-4641-9fa4-e05832516344 tempest-CreateVolumesFromImageTest-946342167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e3db27c-1092-451d-b3af-64c159c5f219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:28:56 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-73a48426-c6bd-4641-9fa4-e05832516344 tempest-CreateVolumesFromImageTest-946342167 None] Volume volume-072f9bad-ffb7-44a8-bbfa-d58fb18ddfbb (072f9bad-ffb7-44a8-bbfa-d58fb18ddfbb): created successfully Nov 06 15:28:56 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-73a48426-c6bd-4641-9fa4-e05832516344 tempest-CreateVolumesFromImageTest-946342167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e3db27c-1092-451d-b3af-64c159c5f219) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:28:56 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-73a48426-c6bd-4641-9fa4-e05832516344 tempest-CreateVolumesFromImageTest-946342167 None] Flow 'volume_create_manager' (c3ebea6d-9237-482e-93ef-bc2527bae02d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:28:56 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-a86413c0-2ac9-4f3a-a854-2466fd0d44d8 tempest-CreateVolumesFromImageTest-946342167 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:28:56 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a86413c0-2ac9-4f3a-a854-2466fd0d44d8 tempest-CreateVolumesFromImageTest-946342167 None] Flow 'volume_create_manager' (5e6a2276-dac4-4bf0-a877-eb9db7d655cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:28:56 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a86413c0-2ac9-4f3a-a854-2466fd0d44d8 tempest-CreateVolumesFromImageTest-946342167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4789b5d-70f3-4196-ba5f-8503cb7a3d59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:28:56 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-73a48426-c6bd-4641-9fa4-e05832516344 tempest-CreateVolumesFromImageTest-946342167 None] Created volume successfully. Nov 06 15:28:56 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a86413c0-2ac9-4f3a-a854-2466fd0d44d8 tempest-CreateVolumesFromImageTest-946342167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4789b5d-70f3-4196-ba5f-8503cb7a3d59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:28:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1796567252',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bae29a3-622d-489d-9690-25523f01fc1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79dc869aa03f4fbc86739bc68dfc7eda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:28:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:28:57Z,use_quota=True,user_id='9dda65a285a4410fade8a01459c0b384',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:28:56 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a86413c0-2ac9-4f3a-a854-2466fd0d44d8 tempest-CreateVolumesFromImageTest-946342167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (222366d3-69dc-4b0a-8cdc-9c2a96fb7a33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:28:56 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a86413c0-2ac9-4f3a-a854-2466fd0d44d8 tempest-CreateVolumesFromImageTest-946342167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (222366d3-69dc-4b0a-8cdc-9c2a96fb7a33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:28:56 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a86413c0-2ac9-4f3a-a854-2466fd0d44d8 tempest-CreateVolumesFromImageTest-946342167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36173f67-92a2-4c90-9b20-400517a05c5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:28:56 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a86413c0-2ac9-4f3a-a854-2466fd0d44d8 tempest-CreateVolumesFromImageTest-946342167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36173f67-92a2-4c90-9b20-400517a05c5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6bae29a3-622d-489d-9690-25523f01fc1e', 'volume_name': 'volume-6bae29a3-622d-489d-9690-25523f01fc1e', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:28:56 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a86413c0-2ac9-4f3a-a854-2466fd0d44d8 tempest-CreateVolumesFromImageTest-946342167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (224f5e72-f45b-4846-a38b-a098dc71f399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:28:56 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a86413c0-2ac9-4f3a-a854-2466fd0d44d8 tempest-CreateVolumesFromImageTest-946342167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (224f5e72-f45b-4846-a38b-a098dc71f399) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:28:56 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a86413c0-2ac9-4f3a-a854-2466fd0d44d8 tempest-CreateVolumesFromImageTest-946342167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65e771eb-3acb-43d9-ad06-e6a20b45267e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:28:56 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-a86413c0-2ac9-4f3a-a854-2466fd0d44d8 tempest-CreateVolumesFromImageTest-946342167 None] Volume 6bae29a3-622d-489d-9690-25523f01fc1e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6bae29a3-622d-489d-9690-25523f01fc1e', 'volume_size': 1} Nov 06 15:28:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a86413c0-2ac9-4f3a-a854-2466fd0d44d8 tempest-CreateVolumesFromImageTest-946342167 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:28:57 devstack sudo[99720]: pam_unix(sudo:session): session closed for user root Nov 06 15:28:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-008ae548-c9b9-43c9-935b-0f3b29d953dd tempest-CreateVolumesFromImageTest-946342167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-85c7c06b-c000-4da5-b1fa-5ef08d5224e6 1073741824" returned: 0 in 0.784s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:28:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-008ae548-c9b9-43c9-935b-0f3b29d953dd tempest-CreateVolumesFromImageTest-946342167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-85c7c06b-c000-4da5-b1fa-5ef08d5224e6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:28:57 devstack sudo[99726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-85c7c06b-c000-4da5-b1fa-5ef08d5224e6 Nov 06 15:28:57 devstack sudo[99726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:28:57 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe2b98b6-6edb-45bc-a066-5a209873e909 tempest-CreateVolumesFromImageTest-946342167 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:28:57 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fe2b98b6-6edb-45bc-a066-5a209873e909 tempest-CreateVolumesFromImageTest-946342167 None] Flow 'volume_create_manager' (ee4ee9eb-d18e-4321-b35a-4b9e7a455e56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:28:57 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fe2b98b6-6edb-45bc-a066-5a209873e909 tempest-CreateVolumesFromImageTest-946342167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (851404c5-bf43-4f7b-94af-f000e65262e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:28:57 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fe2b98b6-6edb-45bc-a066-5a209873e909 tempest-CreateVolumesFromImageTest-946342167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (851404c5-bf43-4f7b-94af-f000e65262e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:28:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-446065212',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28b0664b-6e54-47d5-abe1-3f58c1fe7ae9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79dc869aa03f4fbc86739bc68dfc7eda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:28:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:28:57Z,use_quota=True,user_id='9dda65a285a4410fade8a01459c0b384',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:28:57 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fe2b98b6-6edb-45bc-a066-5a209873e909 tempest-CreateVolumesFromImageTest-946342167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bdccd94-e696-4e24-a6ed-6aeed407b529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:28:57 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fe2b98b6-6edb-45bc-a066-5a209873e909 tempest-CreateVolumesFromImageTest-946342167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bdccd94-e696-4e24-a6ed-6aeed407b529) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:28:57 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fe2b98b6-6edb-45bc-a066-5a209873e909 tempest-CreateVolumesFromImageTest-946342167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e641029b-79e2-4516-8a4b-7e6eece336e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:28:57 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fe2b98b6-6edb-45bc-a066-5a209873e909 tempest-CreateVolumesFromImageTest-946342167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e641029b-79e2-4516-8a4b-7e6eece336e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28b0664b-6e54-47d5-abe1-3f58c1fe7ae9', 'volume_name': 'volume-28b0664b-6e54-47d5-abe1-3f58c1fe7ae9', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:28:57 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fe2b98b6-6edb-45bc-a066-5a209873e909 tempest-CreateVolumesFromImageTest-946342167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4f77e03-8cf0-4420-ba79-6ad428e8f0c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:28:57 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fe2b98b6-6edb-45bc-a066-5a209873e909 tempest-CreateVolumesFromImageTest-946342167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4f77e03-8cf0-4420-ba79-6ad428e8f0c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:28:57 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fe2b98b6-6edb-45bc-a066-5a209873e909 tempest-CreateVolumesFromImageTest-946342167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2af9396-6449-4067-a74b-70da0beaee2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:28:57 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-fe2b98b6-6edb-45bc-a066-5a209873e909 tempest-CreateVolumesFromImageTest-946342167 None] Volume 28b0664b-6e54-47d5-abe1-3f58c1fe7ae9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28b0664b-6e54-47d5-abe1-3f58c1fe7ae9', 'volume_size': 1} Nov 06 15:28:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-fe2b98b6-6edb-45bc-a066-5a209873e909 tempest-CreateVolumesFromImageTest-946342167 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:28:57 devstack sudo[99726]: pam_unix(sudo:session): session closed for user root Nov 06 15:28:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-008ae548-c9b9-43c9-935b-0f3b29d953dd tempest-CreateVolumesFromImageTest-946342167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-85c7c06b-c000-4da5-b1fa-5ef08d5224e6" returned: 0 in 0.298s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:28:57 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-008ae548-c9b9-43c9-935b-0f3b29d953dd tempest-CreateVolumesFromImageTest-946342167 None] <== create_volume: return (1207ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:28:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-008ae548-c9b9-43c9-935b-0f3b29d953dd tempest-CreateVolumesFromImageTest-946342167 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.213s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:28:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7c1fc908-0aaa-4694-bf90-2889dd6a9318 tempest-CreateVolumesFromImageTest-946342167 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.271s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:28:57 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-7c1fc908-0aaa-4694-bf90-2889dd6a9318 tempest-CreateVolumesFromImageTest-946342167 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:28:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1189727668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a2e3021-025b-4012-a8e1-6e4952451cb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79dc869aa03f4fbc86739bc68dfc7eda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:28:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:28:56Z,use_quota=True,user_id='9dda65a285a4410fade8a01459c0b384',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:28:57 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-7c1fc908-0aaa-4694-bf90-2889dd6a9318 tempest-CreateVolumesFromImageTest-946342167 None] Creating volume 9a2e3021-025b-4012-a8e1-6e4952451cb7 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:28:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7c1fc908-0aaa-4694-bf90-2889dd6a9318 tempest-CreateVolumesFromImageTest-946342167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:28:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7c1fc908-0aaa-4694-bf90-2889dd6a9318 tempest-CreateVolumesFromImageTest-946342167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:28:57 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-7c1fc908-0aaa-4694-bf90-2889dd6a9318 tempest-CreateVolumesFromImageTest-946342167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:28:57 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-7c1fc908-0aaa-4694-bf90-2889dd6a9318 tempest-CreateVolumesFromImageTest-946342167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:28:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7c1fc908-0aaa-4694-bf90-2889dd6a9318 tempest-CreateVolumesFromImageTest-946342167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:28:57 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-7c1fc908-0aaa-4694-bf90-2889dd6a9318 tempest-CreateVolumesFromImageTest-946342167 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:28:57 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-7c1fc908-0aaa-4694-bf90-2889dd6a9318 tempest-CreateVolumesFromImageTest-946342167 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:28:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7c1fc908-0aaa-4694-bf90-2889dd6a9318 tempest-CreateVolumesFromImageTest-946342167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-9a2e3021-025b-4012-a8e1-6e4952451cb7 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:28:57 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-008ae548-c9b9-43c9-935b-0f3b29d953dd tempest-CreateVolumesFromImageTest-946342167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6914e772-0d21-4ee8-ad63-210a1b5665a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85c7c06b-c000-4da5-b1fa-5ef08d5224e6', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:28:57 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-008ae548-c9b9-43c9-935b-0f3b29d953dd tempest-CreateVolumesFromImageTest-946342167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05447d3d-8aa8-46d6-9508-9fd3a4a59c6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:28:57 devstack sudo[99735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-9a2e3021-025b-4012-a8e1-6e4952451cb7 1073741824 Nov 06 15:28:57 devstack sudo[99735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:28:57 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-008ae548-c9b9-43c9-935b-0f3b29d953dd tempest-CreateVolumesFromImageTest-946342167 None] Volume volume-85c7c06b-c000-4da5-b1fa-5ef08d5224e6 (85c7c06b-c000-4da5-b1fa-5ef08d5224e6): created successfully Nov 06 15:28:57 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-008ae548-c9b9-43c9-935b-0f3b29d953dd tempest-CreateVolumesFromImageTest-946342167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05447d3d-8aa8-46d6-9508-9fd3a4a59c6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:28:57 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-008ae548-c9b9-43c9-935b-0f3b29d953dd tempest-CreateVolumesFromImageTest-946342167 None] Flow 'volume_create_manager' (9f9a9c0b-b65f-4eba-98e7-38a160d033b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:28:57 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-008ae548-c9b9-43c9-935b-0f3b29d953dd tempest-CreateVolumesFromImageTest-946342167 None] Created volume successfully. Nov 06 15:28:58 devstack sudo[99735]: pam_unix(sudo:session): session closed for user root Nov 06 15:28:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7c1fc908-0aaa-4694-bf90-2889dd6a9318 tempest-CreateVolumesFromImageTest-946342167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-9a2e3021-025b-4012-a8e1-6e4952451cb7 1073741824" returned: 0 in 0.624s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:28:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7c1fc908-0aaa-4694-bf90-2889dd6a9318 tempest-CreateVolumesFromImageTest-946342167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-9a2e3021-025b-4012-a8e1-6e4952451cb7 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:28:58 devstack sudo[99744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-9a2e3021-025b-4012-a8e1-6e4952451cb7 Nov 06 15:28:58 devstack sudo[99744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:28:58 devstack sudo[99744]: pam_unix(sudo:session): session closed for user root Nov 06 15:28:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7c1fc908-0aaa-4694-bf90-2889dd6a9318 tempest-CreateVolumesFromImageTest-946342167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-9a2e3021-025b-4012-a8e1-6e4952451cb7" returned: 0 in 0.336s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:28:58 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-7c1fc908-0aaa-4694-bf90-2889dd6a9318 tempest-CreateVolumesFromImageTest-946342167 None] <== create_volume: return (1034ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:28:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7c1fc908-0aaa-4694-bf90-2889dd6a9318 tempest-CreateVolumesFromImageTest-946342167 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.039s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:28:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a86413c0-2ac9-4f3a-a854-2466fd0d44d8 tempest-CreateVolumesFromImageTest-946342167 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.763s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:28:58 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-a86413c0-2ac9-4f3a-a854-2466fd0d44d8 tempest-CreateVolumesFromImageTest-946342167 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:28:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1796567252',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bae29a3-622d-489d-9690-25523f01fc1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79dc869aa03f4fbc86739bc68dfc7eda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:28:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:28:57Z,use_quota=True,user_id='9dda65a285a4410fade8a01459c0b384',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:28:58 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-a86413c0-2ac9-4f3a-a854-2466fd0d44d8 tempest-CreateVolumesFromImageTest-946342167 None] Creating volume 6bae29a3-622d-489d-9690-25523f01fc1e {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:28:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a86413c0-2ac9-4f3a-a854-2466fd0d44d8 tempest-CreateVolumesFromImageTest-946342167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:28:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a86413c0-2ac9-4f3a-a854-2466fd0d44d8 tempest-CreateVolumesFromImageTest-946342167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:28:58 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-a86413c0-2ac9-4f3a-a854-2466fd0d44d8 tempest-CreateVolumesFromImageTest-946342167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:28:58 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-a86413c0-2ac9-4f3a-a854-2466fd0d44d8 tempest-CreateVolumesFromImageTest-946342167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:28:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a86413c0-2ac9-4f3a-a854-2466fd0d44d8 tempest-CreateVolumesFromImageTest-946342167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:28:58 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-a86413c0-2ac9-4f3a-a854-2466fd0d44d8 tempest-CreateVolumesFromImageTest-946342167 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:28:58 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-a86413c0-2ac9-4f3a-a854-2466fd0d44d8 tempest-CreateVolumesFromImageTest-946342167 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:28:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a86413c0-2ac9-4f3a-a854-2466fd0d44d8 tempest-CreateVolumesFromImageTest-946342167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-6bae29a3-622d-489d-9690-25523f01fc1e 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:28:58 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7c1fc908-0aaa-4694-bf90-2889dd6a9318 tempest-CreateVolumesFromImageTest-946342167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9788720d-b8e5-48cd-b67e-578bf470f543) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a2e3021-025b-4012-a8e1-6e4952451cb7', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:28:58 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7c1fc908-0aaa-4694-bf90-2889dd6a9318 tempest-CreateVolumesFromImageTest-946342167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c81ab7ff-bfc2-46eb-8a50-32f8495310c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:28:58 devstack sudo[99747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-6bae29a3-622d-489d-9690-25523f01fc1e 1073741824 Nov 06 15:28:58 devstack sudo[99747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:28:58 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-7c1fc908-0aaa-4694-bf90-2889dd6a9318 tempest-CreateVolumesFromImageTest-946342167 None] Volume volume-9a2e3021-025b-4012-a8e1-6e4952451cb7 (9a2e3021-025b-4012-a8e1-6e4952451cb7): created successfully Nov 06 15:28:58 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7c1fc908-0aaa-4694-bf90-2889dd6a9318 tempest-CreateVolumesFromImageTest-946342167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c81ab7ff-bfc2-46eb-8a50-32f8495310c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:28:58 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7c1fc908-0aaa-4694-bf90-2889dd6a9318 tempest-CreateVolumesFromImageTest-946342167 None] Flow 'volume_create_manager' (799ad1d5-be16-4123-89e1-47a374b4626c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:28:58 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-7c1fc908-0aaa-4694-bf90-2889dd6a9318 tempest-CreateVolumesFromImageTest-946342167 None] Created volume successfully. Nov 06 15:28:59 devstack sudo[99747]: pam_unix(sudo:session): session closed for user root Nov 06 15:28:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a86413c0-2ac9-4f3a-a854-2466fd0d44d8 tempest-CreateVolumesFromImageTest-946342167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-6bae29a3-622d-489d-9690-25523f01fc1e 1073741824" returned: 0 in 0.587s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:28:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a86413c0-2ac9-4f3a-a854-2466fd0d44d8 tempest-CreateVolumesFromImageTest-946342167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-6bae29a3-622d-489d-9690-25523f01fc1e {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:28:59 devstack sudo[99753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-6bae29a3-622d-489d-9690-25523f01fc1e Nov 06 15:28:59 devstack sudo[99753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:28:59 devstack sudo[99753]: pam_unix(sudo:session): session closed for user root Nov 06 15:28:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a86413c0-2ac9-4f3a-a854-2466fd0d44d8 tempest-CreateVolumesFromImageTest-946342167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-6bae29a3-622d-489d-9690-25523f01fc1e" returned: 0 in 0.471s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:28:59 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-a86413c0-2ac9-4f3a-a854-2466fd0d44d8 tempest-CreateVolumesFromImageTest-946342167 None] <== create_volume: return (1131ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:28:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a86413c0-2ac9-4f3a-a854-2466fd0d44d8 tempest-CreateVolumesFromImageTest-946342167 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.134s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:28:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-fe2b98b6-6edb-45bc-a066-5a209873e909 tempest-CreateVolumesFromImageTest-946342167 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.267s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:28:59 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-fe2b98b6-6edb-45bc-a066-5a209873e909 tempest-CreateVolumesFromImageTest-946342167 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:28:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-446065212',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28b0664b-6e54-47d5-abe1-3f58c1fe7ae9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79dc869aa03f4fbc86739bc68dfc7eda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:28:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:28:57Z,use_quota=True,user_id='9dda65a285a4410fade8a01459c0b384',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:28:59 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-fe2b98b6-6edb-45bc-a066-5a209873e909 tempest-CreateVolumesFromImageTest-946342167 None] Creating volume 28b0664b-6e54-47d5-abe1-3f58c1fe7ae9 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:28:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-fe2b98b6-6edb-45bc-a066-5a209873e909 tempest-CreateVolumesFromImageTest-946342167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:28:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-fe2b98b6-6edb-45bc-a066-5a209873e909 tempest-CreateVolumesFromImageTest-946342167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:28:59 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-fe2b98b6-6edb-45bc-a066-5a209873e909 tempest-CreateVolumesFromImageTest-946342167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:28:59 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-fe2b98b6-6edb-45bc-a066-5a209873e909 tempest-CreateVolumesFromImageTest-946342167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:28:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-fe2b98b6-6edb-45bc-a066-5a209873e909 tempest-CreateVolumesFromImageTest-946342167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:28:59 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-fe2b98b6-6edb-45bc-a066-5a209873e909 tempest-CreateVolumesFromImageTest-946342167 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:28:59 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-fe2b98b6-6edb-45bc-a066-5a209873e909 tempest-CreateVolumesFromImageTest-946342167 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:28:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-fe2b98b6-6edb-45bc-a066-5a209873e909 tempest-CreateVolumesFromImageTest-946342167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-28b0664b-6e54-47d5-abe1-3f58c1fe7ae9 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:28:59 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a86413c0-2ac9-4f3a-a854-2466fd0d44d8 tempest-CreateVolumesFromImageTest-946342167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65e771eb-3acb-43d9-ad06-e6a20b45267e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6bae29a3-622d-489d-9690-25523f01fc1e', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:28:59 devstack sudo[99759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-28b0664b-6e54-47d5-abe1-3f58c1fe7ae9 1073741824 Nov 06 15:28:59 devstack sudo[99759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:28:59 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a86413c0-2ac9-4f3a-a854-2466fd0d44d8 tempest-CreateVolumesFromImageTest-946342167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52100f66-c88e-44a4-9ec4-7515207cea31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:28:59 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-a86413c0-2ac9-4f3a-a854-2466fd0d44d8 tempest-CreateVolumesFromImageTest-946342167 None] Volume volume-6bae29a3-622d-489d-9690-25523f01fc1e (6bae29a3-622d-489d-9690-25523f01fc1e): created successfully Nov 06 15:28:59 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a86413c0-2ac9-4f3a-a854-2466fd0d44d8 tempest-CreateVolumesFromImageTest-946342167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52100f66-c88e-44a4-9ec4-7515207cea31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:28:59 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a86413c0-2ac9-4f3a-a854-2466fd0d44d8 tempest-CreateVolumesFromImageTest-946342167 None] Flow 'volume_create_manager' (5e6a2276-dac4-4bf0-a877-eb9db7d655cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:28:59 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-a86413c0-2ac9-4f3a-a854-2466fd0d44d8 tempest-CreateVolumesFromImageTest-946342167 None] Created volume successfully. Nov 06 15:29:00 devstack sudo[99759]: pam_unix(sudo:session): session closed for user root Nov 06 15:29:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-fe2b98b6-6edb-45bc-a066-5a209873e909 tempest-CreateVolumesFromImageTest-946342167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-28b0664b-6e54-47d5-abe1-3f58c1fe7ae9 1073741824" returned: 0 in 0.956s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:29:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-fe2b98b6-6edb-45bc-a066-5a209873e909 tempest-CreateVolumesFromImageTest-946342167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-28b0664b-6e54-47d5-abe1-3f58c1fe7ae9 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:29:00 devstack sudo[99781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-28b0664b-6e54-47d5-abe1-3f58c1fe7ae9 Nov 06 15:29:00 devstack sudo[99781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:29:01 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-960cfca2-7dd0-4ab7-b8b6-47a5d0419b0c tempest-VolumesMetadataTest-1791802125 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:29:01 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-960cfca2-7dd0-4ab7-b8b6-47a5d0419b0c tempest-VolumesMetadataTest-1791802125 None] Flow 'volume_create_manager' (7527d690-5934-4fb3-8f86-6a3848050653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:29:01 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-960cfca2-7dd0-4ab7-b8b6-47a5d0419b0c tempest-VolumesMetadataTest-1791802125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60777836-d16e-4db6-95e9-e697d375cce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:29:01 devstack sudo[99781]: pam_unix(sudo:session): session closed for user root Nov 06 15:29:01 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-960cfca2-7dd0-4ab7-b8b6-47a5d0419b0c tempest-VolumesMetadataTest-1791802125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60777836-d16e-4db6-95e9-e697d375cce0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:29:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1768330904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24b67cb1-6ef9-41e7-b5b3-fde8be7f6722,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15842d62b82b4916bdd8ab1acb92e491',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:29:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:29:01Z,use_quota=True,user_id='5e4a0d77f32348338517687c7a9808b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:29:01 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-960cfca2-7dd0-4ab7-b8b6-47a5d0419b0c tempest-VolumesMetadataTest-1791802125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (191877eb-68c0-43e8-a696-5a160770b5e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:29:01 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-960cfca2-7dd0-4ab7-b8b6-47a5d0419b0c tempest-VolumesMetadataTest-1791802125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (191877eb-68c0-43e8-a696-5a160770b5e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:29:01 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-960cfca2-7dd0-4ab7-b8b6-47a5d0419b0c tempest-VolumesMetadataTest-1791802125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (073d3eca-b54f-490f-b29a-ff56ffe18601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:29:01 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-960cfca2-7dd0-4ab7-b8b6-47a5d0419b0c tempest-VolumesMetadataTest-1791802125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (073d3eca-b54f-490f-b29a-ff56ffe18601) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24b67cb1-6ef9-41e7-b5b3-fde8be7f6722', 'volume_name': 'volume-24b67cb1-6ef9-41e7-b5b3-fde8be7f6722', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:29:01 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-960cfca2-7dd0-4ab7-b8b6-47a5d0419b0c tempest-VolumesMetadataTest-1791802125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85fc0d53-8640-4ea7-8abe-c14bcc6e3900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:29:01 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-960cfca2-7dd0-4ab7-b8b6-47a5d0419b0c tempest-VolumesMetadataTest-1791802125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85fc0d53-8640-4ea7-8abe-c14bcc6e3900) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:29:01 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-960cfca2-7dd0-4ab7-b8b6-47a5d0419b0c tempest-VolumesMetadataTest-1791802125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3698ebb5-3db5-4e10-aa40-f393e342e71e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:29:01 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-960cfca2-7dd0-4ab7-b8b6-47a5d0419b0c tempest-VolumesMetadataTest-1791802125 None] Volume 24b67cb1-6ef9-41e7-b5b3-fde8be7f6722: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24b67cb1-6ef9-41e7-b5b3-fde8be7f6722', 'volume_size': 1} Nov 06 15:29:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-960cfca2-7dd0-4ab7-b8b6-47a5d0419b0c tempest-VolumesMetadataTest-1791802125 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:29:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-fe2b98b6-6edb-45bc-a066-5a209873e909 tempest-CreateVolumesFromImageTest-946342167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-28b0664b-6e54-47d5-abe1-3f58c1fe7ae9" returned: 0 in 0.515s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:29:01 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-fe2b98b6-6edb-45bc-a066-5a209873e909 tempest-CreateVolumesFromImageTest-946342167 None] <== create_volume: return (1569ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:29:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-fe2b98b6-6edb-45bc-a066-5a209873e909 tempest-CreateVolumesFromImageTest-946342167 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.572s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:29:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-960cfca2-7dd0-4ab7-b8b6-47a5d0419b0c tempest-VolumesMetadataTest-1791802125 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:29:01 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-960cfca2-7dd0-4ab7-b8b6-47a5d0419b0c tempest-VolumesMetadataTest-1791802125 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:29:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1768330904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24b67cb1-6ef9-41e7-b5b3-fde8be7f6722,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15842d62b82b4916bdd8ab1acb92e491',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:29:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:29:01Z,use_quota=True,user_id='5e4a0d77f32348338517687c7a9808b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:29:01 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-960cfca2-7dd0-4ab7-b8b6-47a5d0419b0c tempest-VolumesMetadataTest-1791802125 None] Creating volume 24b67cb1-6ef9-41e7-b5b3-fde8be7f6722 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:29:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-960cfca2-7dd0-4ab7-b8b6-47a5d0419b0c tempest-VolumesMetadataTest-1791802125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:29:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-960cfca2-7dd0-4ab7-b8b6-47a5d0419b0c tempest-VolumesMetadataTest-1791802125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:29:01 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-960cfca2-7dd0-4ab7-b8b6-47a5d0419b0c tempest-VolumesMetadataTest-1791802125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:29:01 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-960cfca2-7dd0-4ab7-b8b6-47a5d0419b0c tempest-VolumesMetadataTest-1791802125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:29:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-960cfca2-7dd0-4ab7-b8b6-47a5d0419b0c tempest-VolumesMetadataTest-1791802125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:29:01 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-960cfca2-7dd0-4ab7-b8b6-47a5d0419b0c tempest-VolumesMetadataTest-1791802125 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:29:01 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-960cfca2-7dd0-4ab7-b8b6-47a5d0419b0c tempest-VolumesMetadataTest-1791802125 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:29:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-960cfca2-7dd0-4ab7-b8b6-47a5d0419b0c tempest-VolumesMetadataTest-1791802125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-24b67cb1-6ef9-41e7-b5b3-fde8be7f6722 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:29:01 devstack sudo[99790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-24b67cb1-6ef9-41e7-b5b3-fde8be7f6722 1073741824 Nov 06 15:29:01 devstack sudo[99790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:29:01 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fe2b98b6-6edb-45bc-a066-5a209873e909 tempest-CreateVolumesFromImageTest-946342167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2af9396-6449-4067-a74b-70da0beaee2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28b0664b-6e54-47d5-abe1-3f58c1fe7ae9', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:29:01 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fe2b98b6-6edb-45bc-a066-5a209873e909 tempest-CreateVolumesFromImageTest-946342167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76a0a960-e637-42de-894b-e97517a8b1e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:29:01 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-fe2b98b6-6edb-45bc-a066-5a209873e909 tempest-CreateVolumesFromImageTest-946342167 None] Volume volume-28b0664b-6e54-47d5-abe1-3f58c1fe7ae9 (28b0664b-6e54-47d5-abe1-3f58c1fe7ae9): created successfully Nov 06 15:29:01 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fe2b98b6-6edb-45bc-a066-5a209873e909 tempest-CreateVolumesFromImageTest-946342167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76a0a960-e637-42de-894b-e97517a8b1e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:29:01 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fe2b98b6-6edb-45bc-a066-5a209873e909 tempest-CreateVolumesFromImageTest-946342167 None] Flow 'volume_create_manager' (ee4ee9eb-d18e-4321-b35a-4b9e7a455e56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:29:01 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-fe2b98b6-6edb-45bc-a066-5a209873e909 tempest-CreateVolumesFromImageTest-946342167 None] Created volume successfully. Nov 06 15:29:02 devstack sudo[99790]: pam_unix(sudo:session): session closed for user root Nov 06 15:29:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-960cfca2-7dd0-4ab7-b8b6-47a5d0419b0c tempest-VolumesMetadataTest-1791802125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-24b67cb1-6ef9-41e7-b5b3-fde8be7f6722 1073741824" returned: 0 in 0.612s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:29:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-960cfca2-7dd0-4ab7-b8b6-47a5d0419b0c tempest-VolumesMetadataTest-1791802125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-24b67cb1-6ef9-41e7-b5b3-fde8be7f6722 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:29:02 devstack sudo[99796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-24b67cb1-6ef9-41e7-b5b3-fde8be7f6722 Nov 06 15:29:02 devstack sudo[99796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:29:02 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6b2a6511-ef11-4d85-a122-45daa3472f78 tempest-CreateVolumesFromImageTest-946342167 None] Acquiring lock "cinder-28b0664b-6e54-47d5-abe1-3f58c1fe7ae9-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:29:02 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6b2a6511-ef11-4d85-a122-45daa3472f78 tempest-CreateVolumesFromImageTest-946342167 None] Lock "cinder-28b0664b-6e54-47d5-abe1-3f58c1fe7ae9-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:29:02 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6b2a6511-ef11-4d85-a122-45daa3472f78 tempest-CreateVolumesFromImageTest-946342167 None] Acquiring lock "cinder-quobyte-28b0664b-6e54-47d5-abe1-3f58c1fe7ae9" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:29:02 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6b2a6511-ef11-4d85-a122-45daa3472f78 tempest-CreateVolumesFromImageTest-946342167 None] Lock "cinder-quobyte-28b0664b-6e54-47d5-abe1-3f58c1fe7ae9" acquired by "delete_volume" :: waited 0.028s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:29:02 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[af570958-862a-4033-acab-5d32dc8d4d37]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:29:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6b2a6511-ef11-4d85-a122-45daa3472f78 tempest-CreateVolumesFromImageTest-946342167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-28b0664b-6e54-47d5-abe1-3f58c1fe7ae9 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:29:02 devstack sudo[99796]: pam_unix(sudo:session): session closed for user root Nov 06 15:29:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-960cfca2-7dd0-4ab7-b8b6-47a5d0419b0c tempest-VolumesMetadataTest-1791802125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-24b67cb1-6ef9-41e7-b5b3-fde8be7f6722" returned: 0 in 0.387s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:29:02 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-960cfca2-7dd0-4ab7-b8b6-47a5d0419b0c tempest-VolumesMetadataTest-1791802125 None] <== create_volume: return (1048ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:29:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-960cfca2-7dd0-4ab7-b8b6-47a5d0419b0c tempest-VolumesMetadataTest-1791802125 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.053s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:29:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-960cfca2-7dd0-4ab7-b8b6-47a5d0419b0c tempest-VolumesMetadataTest-1791802125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3698ebb5-3db5-4e10-aa40-f393e342e71e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24b67cb1-6ef9-41e7-b5b3-fde8be7f6722', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:29:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-960cfca2-7dd0-4ab7-b8b6-47a5d0419b0c tempest-VolumesMetadataTest-1791802125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70d92d03-54ed-4a32-a1b7-960ee99f7141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:29:02 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-960cfca2-7dd0-4ab7-b8b6-47a5d0419b0c tempest-VolumesMetadataTest-1791802125 None] Volume volume-24b67cb1-6ef9-41e7-b5b3-fde8be7f6722 (24b67cb1-6ef9-41e7-b5b3-fde8be7f6722): created successfully Nov 06 15:29:02 devstack sudo[99799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-28b0664b-6e54-47d5-abe1-3f58c1fe7ae9 Nov 06 15:29:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-960cfca2-7dd0-4ab7-b8b6-47a5d0419b0c tempest-VolumesMetadataTest-1791802125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70d92d03-54ed-4a32-a1b7-960ee99f7141) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:29:02 devstack sudo[99799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:29:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-960cfca2-7dd0-4ab7-b8b6-47a5d0419b0c tempest-VolumesMetadataTest-1791802125 None] Flow 'volume_create_manager' (7527d690-5934-4fb3-8f86-6a3848050653) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:29:02 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-960cfca2-7dd0-4ab7-b8b6-47a5d0419b0c tempest-VolumesMetadataTest-1791802125 None] Created volume successfully. Nov 06 15:29:02 devstack sudo[99799]: pam_unix(sudo:session): session closed for user root Nov 06 15:29:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6b2a6511-ef11-4d85-a122-45daa3472f78 tempest-CreateVolumesFromImageTest-946342167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-28b0664b-6e54-47d5-abe1-3f58c1fe7ae9" returned: 0 in 0.503s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:29:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6b2a6511-ef11-4d85-a122-45daa3472f78 tempest-CreateVolumesFromImageTest-946342167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-28b0664b-6e54-47d5-abe1-3f58c1fe7ae9 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:29:02 devstack sudo[99805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-28b0664b-6e54-47d5-abe1-3f58c1fe7ae9 Nov 06 15:29:02 devstack sudo[99805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:29:03 devstack sudo[99805]: pam_unix(sudo:session): session closed for user root Nov 06 15:29:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6b2a6511-ef11-4d85-a122-45daa3472f78 tempest-CreateVolumesFromImageTest-946342167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-28b0664b-6e54-47d5-abe1-3f58c1fe7ae9" returned: 0 in 0.394s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:29:03 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6b2a6511-ef11-4d85-a122-45daa3472f78 tempest-CreateVolumesFromImageTest-946342167 None] Lock "cinder-quobyte-28b0664b-6e54-47d5-abe1-3f58c1fe7ae9" released by "delete_volume" :: held 0.994s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:29:03 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-6b2a6511-ef11-4d85-a122-45daa3472f78 tempest-CreateVolumesFromImageTest-946342167 None] Created reservations ['c3c4aeff-fc86-4942-a956-421c016208df', '3809a70a-cb46-42b2-8fc2-88125fd8ca33', '083f084e-d9b6-43f4-9f8b-0991edab8cac', 'dbcda86d-74d5-47b6-896c-d57ed8322216'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:29:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6b2a6511-ef11-4d85-a122-45daa3472f78 tempest-CreateVolumesFromImageTest-946342167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:29:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6b2a6511-ef11-4d85-a122-45daa3472f78 tempest-CreateVolumesFromImageTest-946342167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:29:03 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-6b2a6511-ef11-4d85-a122-45daa3472f78 tempest-CreateVolumesFromImageTest-946342167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:29:03 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-6b2a6511-ef11-4d85-a122-45daa3472f78 tempest-CreateVolumesFromImageTest-946342167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:29:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6b2a6511-ef11-4d85-a122-45daa3472f78 tempest-CreateVolumesFromImageTest-946342167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:29:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6b2a6511-ef11-4d85-a122-45daa3472f78 tempest-CreateVolumesFromImageTest-946342167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:29:03 devstack sudo[99856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:29:03 devstack sudo[99856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:29:04 devstack sudo[99856]: pam_unix(sudo:session): session closed for user root Nov 06 15:29:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6b2a6511-ef11-4d85-a122-45daa3472f78 tempest-CreateVolumesFromImageTest-946342167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.504s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:29:04 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-6b2a6511-ef11-4d85-a122-45daa3472f78 tempest-CreateVolumesFromImageTest-946342167 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:29:04 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-6b2a6511-ef11-4d85-a122-45daa3472f78 tempest-CreateVolumesFromImageTest-946342167 None] Deleted volume successfully. Nov 06 15:29:04 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6b2a6511-ef11-4d85-a122-45daa3472f78 tempest-CreateVolumesFromImageTest-946342167 None] Lock "cinder-28b0664b-6e54-47d5-abe1-3f58c1fe7ae9-delete_volume" released by "delete_volume" :: held 1.963s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:29:04 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-207e63c6-3847-4f86-8d1e-f53731572de4 tempest-CreateVolumesFromImageTest-946342167 None] Acquiring lock "cinder-6bae29a3-622d-489d-9690-25523f01fc1e-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:29:04 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-207e63c6-3847-4f86-8d1e-f53731572de4 tempest-CreateVolumesFromImageTest-946342167 None] Lock "cinder-6bae29a3-622d-489d-9690-25523f01fc1e-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:29:04 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-207e63c6-3847-4f86-8d1e-f53731572de4 tempest-CreateVolumesFromImageTest-946342167 None] Acquiring lock "cinder-quobyte-6bae29a3-622d-489d-9690-25523f01fc1e" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:29:04 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-207e63c6-3847-4f86-8d1e-f53731572de4 tempest-CreateVolumesFromImageTest-946342167 None] Lock "cinder-quobyte-6bae29a3-622d-489d-9690-25523f01fc1e" acquired by "delete_volume" :: waited 0.046s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:29:04 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bf934e6-0e7f-4985-b8da-47a4220060eb]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:29:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-207e63c6-3847-4f86-8d1e-f53731572de4 tempest-CreateVolumesFromImageTest-946342167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-6bae29a3-622d-489d-9690-25523f01fc1e {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:29:04 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-94b24fd3-96e5-4066-8031-28c6eea150c1 tempest-VolumesMetadataTest-1791802125 None] Acquiring lock "cinder-24b67cb1-6ef9-41e7-b5b3-fde8be7f6722-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:29:05 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-94b24fd3-96e5-4066-8031-28c6eea150c1 tempest-VolumesMetadataTest-1791802125 None] Lock "cinder-24b67cb1-6ef9-41e7-b5b3-fde8be7f6722-delete_volume" acquired by "delete_volume" :: waited 0.083s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:29:05 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-94b24fd3-96e5-4066-8031-28c6eea150c1 tempest-VolumesMetadataTest-1791802125 None] Acquiring lock "cinder-quobyte-24b67cb1-6ef9-41e7-b5b3-fde8be7f6722" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:29:05 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-94b24fd3-96e5-4066-8031-28c6eea150c1 tempest-VolumesMetadataTest-1791802125 None] Lock "cinder-quobyte-24b67cb1-6ef9-41e7-b5b3-fde8be7f6722" acquired by "delete_volume" :: waited 0.032s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:29:05 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[4720b593-9dc6-4827-b4b1-9ef3d3f83068]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:29:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-94b24fd3-96e5-4066-8031-28c6eea150c1 tempest-VolumesMetadataTest-1791802125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-24b67cb1-6ef9-41e7-b5b3-fde8be7f6722 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:29:05 devstack sudo[99894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-6bae29a3-622d-489d-9690-25523f01fc1e Nov 06 15:29:05 devstack sudo[99894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:29:05 devstack sudo[99905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-24b67cb1-6ef9-41e7-b5b3-fde8be7f6722 Nov 06 15:29:05 devstack sudo[99905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:29:05 devstack sudo[99894]: pam_unix(sudo:session): session closed for user root Nov 06 15:29:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-207e63c6-3847-4f86-8d1e-f53731572de4 tempest-CreateVolumesFromImageTest-946342167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-6bae29a3-622d-489d-9690-25523f01fc1e" returned: 0 in 0.842s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:29:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-207e63c6-3847-4f86-8d1e-f53731572de4 tempest-CreateVolumesFromImageTest-946342167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-6bae29a3-622d-489d-9690-25523f01fc1e {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:29:05 devstack sudo[99916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-6bae29a3-622d-489d-9690-25523f01fc1e Nov 06 15:29:05 devstack sudo[99916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:29:05 devstack sudo[99905]: pam_unix(sudo:session): session closed for user root Nov 06 15:29:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-94b24fd3-96e5-4066-8031-28c6eea150c1 tempest-VolumesMetadataTest-1791802125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-24b67cb1-6ef9-41e7-b5b3-fde8be7f6722" returned: 0 in 0.665s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:29:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-94b24fd3-96e5-4066-8031-28c6eea150c1 tempest-VolumesMetadataTest-1791802125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-24b67cb1-6ef9-41e7-b5b3-fde8be7f6722 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:29:05 devstack sudo[99919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-24b67cb1-6ef9-41e7-b5b3-fde8be7f6722 Nov 06 15:29:05 devstack sudo[99919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:29:06 devstack sudo[99916]: pam_unix(sudo:session): session closed for user root Nov 06 15:29:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-207e63c6-3847-4f86-8d1e-f53731572de4 tempest-CreateVolumesFromImageTest-946342167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-6bae29a3-622d-489d-9690-25523f01fc1e" returned: 0 in 0.355s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:29:06 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-207e63c6-3847-4f86-8d1e-f53731572de4 tempest-CreateVolumesFromImageTest-946342167 None] Lock "cinder-quobyte-6bae29a3-622d-489d-9690-25523f01fc1e" released by "delete_volume" :: held 1.286s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:29:06 devstack sudo[99919]: pam_unix(sudo:session): session closed for user root Nov 06 15:29:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-94b24fd3-96e5-4066-8031-28c6eea150c1 tempest-VolumesMetadataTest-1791802125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-24b67cb1-6ef9-41e7-b5b3-fde8be7f6722" returned: 0 in 0.348s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:29:06 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-94b24fd3-96e5-4066-8031-28c6eea150c1 tempest-VolumesMetadataTest-1791802125 None] Lock "cinder-quobyte-24b67cb1-6ef9-41e7-b5b3-fde8be7f6722" released by "delete_volume" :: held 1.127s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:29:06 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-207e63c6-3847-4f86-8d1e-f53731572de4 tempest-CreateVolumesFromImageTest-946342167 None] Created reservations ['d47f27a5-9189-4c84-a3cd-75b5b68340d4', 'fc1c6f68-d956-4f48-950f-4bf9138e0301', '3dcc1f2c-6b3e-4277-a777-8fd55ab765d2', 'e414131a-e1cd-4274-b0e8-3fc0f10b4e1a'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:29:06 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-94b24fd3-96e5-4066-8031-28c6eea150c1 tempest-VolumesMetadataTest-1791802125 None] Created reservations ['11da68b8-e071-497e-873a-68c0a5c1bbcf', '4dde1915-f490-48ce-b033-d3ffac79e4a2', 'a8c89b0e-590b-48cc-9a3a-481bf10bee3b', '4ba83a31-7e4f-4100-bf13-d8fbf1cabd95'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:29:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-207e63c6-3847-4f86-8d1e-f53731572de4 tempest-CreateVolumesFromImageTest-946342167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:29:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-207e63c6-3847-4f86-8d1e-f53731572de4 tempest-CreateVolumesFromImageTest-946342167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:29:06 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-207e63c6-3847-4f86-8d1e-f53731572de4 tempest-CreateVolumesFromImageTest-946342167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:29:06 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-207e63c6-3847-4f86-8d1e-f53731572de4 tempest-CreateVolumesFromImageTest-946342167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:29:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-207e63c6-3847-4f86-8d1e-f53731572de4 tempest-CreateVolumesFromImageTest-946342167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:29:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-207e63c6-3847-4f86-8d1e-f53731572de4 tempest-CreateVolumesFromImageTest-946342167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:29:06 devstack sudo[99923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:29:06 devstack sudo[99923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:29:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-94b24fd3-96e5-4066-8031-28c6eea150c1 tempest-VolumesMetadataTest-1791802125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:29:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-94b24fd3-96e5-4066-8031-28c6eea150c1 tempest-VolumesMetadataTest-1791802125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:29:06 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-94b24fd3-96e5-4066-8031-28c6eea150c1 tempest-VolumesMetadataTest-1791802125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:29:06 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-94b24fd3-96e5-4066-8031-28c6eea150c1 tempest-VolumesMetadataTest-1791802125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:29:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-94b24fd3-96e5-4066-8031-28c6eea150c1 tempest-VolumesMetadataTest-1791802125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:29:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-94b24fd3-96e5-4066-8031-28c6eea150c1 tempest-VolumesMetadataTest-1791802125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:29:06 devstack sudo[99927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:29:06 devstack sudo[99927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:29:07 devstack sudo[99923]: pam_unix(sudo:session): session closed for user root Nov 06 15:29:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-207e63c6-3847-4f86-8d1e-f53731572de4 tempest-CreateVolumesFromImageTest-946342167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.583s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:29:07 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-207e63c6-3847-4f86-8d1e-f53731572de4 tempest-CreateVolumesFromImageTest-946342167 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:29:07 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-207e63c6-3847-4f86-8d1e-f53731572de4 tempest-CreateVolumesFromImageTest-946342167 None] Deleted volume successfully. Nov 06 15:29:07 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-207e63c6-3847-4f86-8d1e-f53731572de4 tempest-CreateVolumesFromImageTest-946342167 None] Lock "cinder-6bae29a3-622d-489d-9690-25523f01fc1e-delete_volume" released by "delete_volume" :: held 2.301s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:29:07 devstack sudo[99927]: pam_unix(sudo:session): session closed for user root Nov 06 15:29:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-94b24fd3-96e5-4066-8031-28c6eea150c1 tempest-VolumesMetadataTest-1791802125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.655s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:29:07 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-94b24fd3-96e5-4066-8031-28c6eea150c1 tempest-VolumesMetadataTest-1791802125 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:29:07 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-94b24fd3-96e5-4066-8031-28c6eea150c1 tempest-VolumesMetadataTest-1791802125 None] Deleted volume successfully. Nov 06 15:29:07 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-94b24fd3-96e5-4066-8031-28c6eea150c1 tempest-VolumesMetadataTest-1791802125 None] Lock "cinder-24b67cb1-6ef9-41e7-b5b3-fde8be7f6722-delete_volume" released by "delete_volume" :: held 2.140s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:29:07 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-65cac10c-a4c5-40c3-98ae-a6daea4bf259 tempest-CreateVolumesFromImageTest-946342167 None] Acquiring lock "cinder-9a2e3021-025b-4012-a8e1-6e4952451cb7-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:29:07 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-65cac10c-a4c5-40c3-98ae-a6daea4bf259 tempest-CreateVolumesFromImageTest-946342167 None] Lock "cinder-9a2e3021-025b-4012-a8e1-6e4952451cb7-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:29:07 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-65cac10c-a4c5-40c3-98ae-a6daea4bf259 tempest-CreateVolumesFromImageTest-946342167 None] Acquiring lock "cinder-quobyte-9a2e3021-025b-4012-a8e1-6e4952451cb7" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:29:07 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-65cac10c-a4c5-40c3-98ae-a6daea4bf259 tempest-CreateVolumesFromImageTest-946342167 None] Lock "cinder-quobyte-9a2e3021-025b-4012-a8e1-6e4952451cb7" acquired by "delete_volume" :: waited 0.024s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:29:07 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[521b4a50-ea62-499b-bd85-7622a3676889]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:29:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-65cac10c-a4c5-40c3-98ae-a6daea4bf259 tempest-CreateVolumesFromImageTest-946342167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-9a2e3021-025b-4012-a8e1-6e4952451cb7 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:29:07 devstack sudo[99931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-9a2e3021-025b-4012-a8e1-6e4952451cb7 Nov 06 15:29:07 devstack sudo[99931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:29:08 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 15:29:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:29:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:29:08 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:29:08 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:29:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:29:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:29:08 devstack sudo[99936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:29:08 devstack sudo[99936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:29:08 devstack sudo[99931]: pam_unix(sudo:session): session closed for user root Nov 06 15:29:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-65cac10c-a4c5-40c3-98ae-a6daea4bf259 tempest-CreateVolumesFromImageTest-946342167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-9a2e3021-025b-4012-a8e1-6e4952451cb7" returned: 0 in 0.888s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:29:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-65cac10c-a4c5-40c3-98ae-a6daea4bf259 tempest-CreateVolumesFromImageTest-946342167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-9a2e3021-025b-4012-a8e1-6e4952451cb7 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:29:08 devstack sudo[99939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-9a2e3021-025b-4012-a8e1-6e4952451cb7 Nov 06 15:29:08 devstack sudo[99939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:29:08 devstack sudo[99936]: pam_unix(sudo:session): session closed for user root Nov 06 15:29:08 devstack sudo[99939]: pam_unix(sudo:session): session closed for user root Nov 06 15:29:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.746s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:29:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-65cac10c-a4c5-40c3-98ae-a6daea4bf259 tempest-CreateVolumesFromImageTest-946342167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-9a2e3021-025b-4012-a8e1-6e4952451cb7" returned: 0 in 0.467s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:29:08 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:29:08 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Running periodic task VolumeManager._thread_info {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 15:29:08 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] thread count: 28 {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 15:29:08 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] thread info: [<_MainThread(MainThread, started 140011251929216)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 06 15:29:08 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-65cac10c-a4c5-40c3-98ae-a6daea4bf259 tempest-CreateVolumesFromImageTest-946342167 None] Lock "cinder-quobyte-9a2e3021-025b-4012-a8e1-6e4952451cb7" released by "delete_volume" :: held 1.475s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:29:09 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-65cac10c-a4c5-40c3-98ae-a6daea4bf259 tempest-CreateVolumesFromImageTest-946342167 None] Created reservations ['61b23d4c-10d1-40bd-b071-7ebaa6ce8e92', '32a5c09e-5abf-442c-805c-43541a15080c', 'ccb450db-2860-4c9b-8c68-d764e54fac01', '923a40b5-8ee7-44d6-b971-e7600bb600d9'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:29:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-65cac10c-a4c5-40c3-98ae-a6daea4bf259 tempest-CreateVolumesFromImageTest-946342167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:29:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-65cac10c-a4c5-40c3-98ae-a6daea4bf259 tempest-CreateVolumesFromImageTest-946342167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:29:09 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-65cac10c-a4c5-40c3-98ae-a6daea4bf259 tempest-CreateVolumesFromImageTest-946342167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:29:09 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-65cac10c-a4c5-40c3-98ae-a6daea4bf259 tempest-CreateVolumesFromImageTest-946342167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:29:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-65cac10c-a4c5-40c3-98ae-a6daea4bf259 tempest-CreateVolumesFromImageTest-946342167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:29:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-65cac10c-a4c5-40c3-98ae-a6daea4bf259 tempest-CreateVolumesFromImageTest-946342167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:29:09 devstack sudo[99943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:29:09 devstack sudo[99943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:29:09 devstack sudo[99943]: pam_unix(sudo:session): session closed for user root Nov 06 15:29:09 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-74bb047c-a80f-4909-8391-47b236b8789a tempest-CreateVolumesFromImageTest-946342167 None] Acquiring lock "cinder-85c7c06b-c000-4da5-b1fa-5ef08d5224e6-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:29:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-65cac10c-a4c5-40c3-98ae-a6daea4bf259 tempest-CreateVolumesFromImageTest-946342167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.584s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:29:09 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-65cac10c-a4c5-40c3-98ae-a6daea4bf259 tempest-CreateVolumesFromImageTest-946342167 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:29:09 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-65cac10c-a4c5-40c3-98ae-a6daea4bf259 tempest-CreateVolumesFromImageTest-946342167 None] Deleted volume successfully. Nov 06 15:29:09 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-74bb047c-a80f-4909-8391-47b236b8789a tempest-CreateVolumesFromImageTest-946342167 None] Lock "cinder-85c7c06b-c000-4da5-b1fa-5ef08d5224e6-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:29:09 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-65cac10c-a4c5-40c3-98ae-a6daea4bf259 tempest-CreateVolumesFromImageTest-946342167 None] Lock "cinder-9a2e3021-025b-4012-a8e1-6e4952451cb7-delete_volume" released by "delete_volume" :: held 2.603s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:29:09 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-74bb047c-a80f-4909-8391-47b236b8789a tempest-CreateVolumesFromImageTest-946342167 None] Acquiring lock "cinder-quobyte-85c7c06b-c000-4da5-b1fa-5ef08d5224e6" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:29:09 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-74bb047c-a80f-4909-8391-47b236b8789a tempest-CreateVolumesFromImageTest-946342167 None] Lock "cinder-quobyte-85c7c06b-c000-4da5-b1fa-5ef08d5224e6" acquired by "delete_volume" :: waited 0.025s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:29:09 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[8682e2af-a250-4efa-98ab-65f7ca14668e]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:29:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-74bb047c-a80f-4909-8391-47b236b8789a tempest-CreateVolumesFromImageTest-946342167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-85c7c06b-c000-4da5-b1fa-5ef08d5224e6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:29:10 devstack sudo[99947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-85c7c06b-c000-4da5-b1fa-5ef08d5224e6 Nov 06 15:29:10 devstack sudo[99947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:29:10 devstack sudo[99947]: pam_unix(sudo:session): session closed for user root Nov 06 15:29:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-74bb047c-a80f-4909-8391-47b236b8789a tempest-CreateVolumesFromImageTest-946342167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-85c7c06b-c000-4da5-b1fa-5ef08d5224e6" returned: 0 in 0.558s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:29:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-74bb047c-a80f-4909-8391-47b236b8789a tempest-CreateVolumesFromImageTest-946342167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-85c7c06b-c000-4da5-b1fa-5ef08d5224e6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:29:10 devstack sudo[99954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-85c7c06b-c000-4da5-b1fa-5ef08d5224e6 Nov 06 15:29:10 devstack sudo[99954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:29:10 devstack sudo[99954]: pam_unix(sudo:session): session closed for user root Nov 06 15:29:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-74bb047c-a80f-4909-8391-47b236b8789a tempest-CreateVolumesFromImageTest-946342167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-85c7c06b-c000-4da5-b1fa-5ef08d5224e6" returned: 0 in 0.406s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:29:10 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-74bb047c-a80f-4909-8391-47b236b8789a tempest-CreateVolumesFromImageTest-946342167 None] Lock "cinder-quobyte-85c7c06b-c000-4da5-b1fa-5ef08d5224e6" released by "delete_volume" :: held 1.059s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:29:11 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-74bb047c-a80f-4909-8391-47b236b8789a tempest-CreateVolumesFromImageTest-946342167 None] Created reservations ['a3f149df-88e5-4901-be13-02229505c157', '07780bfc-4125-4678-a4a3-20ca114e5cbb', 'fa953872-0625-4769-bce9-fa42477cd8ab', 'e6bbc9e6-b1cb-4edc-991e-45709eeb6ccf'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:29:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-74bb047c-a80f-4909-8391-47b236b8789a tempest-CreateVolumesFromImageTest-946342167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:29:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-74bb047c-a80f-4909-8391-47b236b8789a tempest-CreateVolumesFromImageTest-946342167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:29:11 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-74bb047c-a80f-4909-8391-47b236b8789a tempest-CreateVolumesFromImageTest-946342167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:29:11 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-74bb047c-a80f-4909-8391-47b236b8789a tempest-CreateVolumesFromImageTest-946342167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:29:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-74bb047c-a80f-4909-8391-47b236b8789a tempest-CreateVolumesFromImageTest-946342167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:29:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-74bb047c-a80f-4909-8391-47b236b8789a tempest-CreateVolumesFromImageTest-946342167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:29:11 devstack sudo[99957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:29:11 devstack sudo[99957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:29:11 devstack sudo[99957]: pam_unix(sudo:session): session closed for user root Nov 06 15:29:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-74bb047c-a80f-4909-8391-47b236b8789a tempest-CreateVolumesFromImageTest-946342167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.321s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:29:11 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-74bb047c-a80f-4909-8391-47b236b8789a tempest-CreateVolumesFromImageTest-946342167 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:29:11 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-74bb047c-a80f-4909-8391-47b236b8789a tempest-CreateVolumesFromImageTest-946342167 None] Deleted volume successfully. Nov 06 15:29:11 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-74bb047c-a80f-4909-8391-47b236b8789a tempest-CreateVolumesFromImageTest-946342167 None] Lock "cinder-85c7c06b-c000-4da5-b1fa-5ef08d5224e6-delete_volume" released by "delete_volume" :: held 1.770s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:29:12 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a84b83cc-60d7-4cd2-92ad-5beabd58c87d tempest-CreateVolumesFromImageTest-946342167 None] Acquiring lock "cinder-072f9bad-ffb7-44a8-bbfa-d58fb18ddfbb-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:29:12 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a84b83cc-60d7-4cd2-92ad-5beabd58c87d tempest-CreateVolumesFromImageTest-946342167 None] Lock "cinder-072f9bad-ffb7-44a8-bbfa-d58fb18ddfbb-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:29:12 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a84b83cc-60d7-4cd2-92ad-5beabd58c87d tempest-CreateVolumesFromImageTest-946342167 None] Acquiring lock "cinder-quobyte-072f9bad-ffb7-44a8-bbfa-d58fb18ddfbb" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:29:12 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a84b83cc-60d7-4cd2-92ad-5beabd58c87d tempest-CreateVolumesFromImageTest-946342167 None] Lock "cinder-quobyte-072f9bad-ffb7-44a8-bbfa-d58fb18ddfbb" acquired by "delete_volume" :: waited 0.020s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:29:12 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[0260a512-236e-4440-bf0f-166529637729]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:29:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a84b83cc-60d7-4cd2-92ad-5beabd58c87d tempest-CreateVolumesFromImageTest-946342167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-072f9bad-ffb7-44a8-bbfa-d58fb18ddfbb {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:29:12 devstack sudo[99960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-072f9bad-ffb7-44a8-bbfa-d58fb18ddfbb Nov 06 15:29:12 devstack sudo[99960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:29:12 devstack sudo[99960]: pam_unix(sudo:session): session closed for user root Nov 06 15:29:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a84b83cc-60d7-4cd2-92ad-5beabd58c87d tempest-CreateVolumesFromImageTest-946342167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-072f9bad-ffb7-44a8-bbfa-d58fb18ddfbb" returned: 0 in 0.453s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:29:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a84b83cc-60d7-4cd2-92ad-5beabd58c87d tempest-CreateVolumesFromImageTest-946342167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-072f9bad-ffb7-44a8-bbfa-d58fb18ddfbb {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:29:12 devstack sudo[99965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-072f9bad-ffb7-44a8-bbfa-d58fb18ddfbb Nov 06 15:29:12 devstack sudo[99965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:29:13 devstack sudo[99965]: pam_unix(sudo:session): session closed for user root Nov 06 15:29:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a84b83cc-60d7-4cd2-92ad-5beabd58c87d tempest-CreateVolumesFromImageTest-946342167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-072f9bad-ffb7-44a8-bbfa-d58fb18ddfbb" returned: 0 in 0.268s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:29:13 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a84b83cc-60d7-4cd2-92ad-5beabd58c87d tempest-CreateVolumesFromImageTest-946342167 None] Lock "cinder-quobyte-072f9bad-ffb7-44a8-bbfa-d58fb18ddfbb" released by "delete_volume" :: held 0.776s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:29:13 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-a84b83cc-60d7-4cd2-92ad-5beabd58c87d tempest-CreateVolumesFromImageTest-946342167 None] Created reservations ['25622155-4c6b-46d2-91da-e3651b54fb5d', '1c247f55-7ffb-41b9-be37-62ba1940b6c4', '71361360-acd2-4948-8919-adcee4308cb0', 'e070bd03-e576-47ad-ada0-86c0ed1a9bb1'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:29:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a84b83cc-60d7-4cd2-92ad-5beabd58c87d tempest-CreateVolumesFromImageTest-946342167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:29:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a84b83cc-60d7-4cd2-92ad-5beabd58c87d tempest-CreateVolumesFromImageTest-946342167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:29:13 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-a84b83cc-60d7-4cd2-92ad-5beabd58c87d tempest-CreateVolumesFromImageTest-946342167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:29:13 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-a84b83cc-60d7-4cd2-92ad-5beabd58c87d tempest-CreateVolumesFromImageTest-946342167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:29:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a84b83cc-60d7-4cd2-92ad-5beabd58c87d tempest-CreateVolumesFromImageTest-946342167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:29:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a84b83cc-60d7-4cd2-92ad-5beabd58c87d tempest-CreateVolumesFromImageTest-946342167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:29:13 devstack sudo[99968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:29:13 devstack sudo[99968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:29:13 devstack sudo[99968]: pam_unix(sudo:session): session closed for user root Nov 06 15:29:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a84b83cc-60d7-4cd2-92ad-5beabd58c87d tempest-CreateVolumesFromImageTest-946342167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.612s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:29:13 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-a84b83cc-60d7-4cd2-92ad-5beabd58c87d tempest-CreateVolumesFromImageTest-946342167 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:29:13 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-a84b83cc-60d7-4cd2-92ad-5beabd58c87d tempest-CreateVolumesFromImageTest-946342167 None] Deleted volume successfully. Nov 06 15:29:13 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a84b83cc-60d7-4cd2-92ad-5beabd58c87d tempest-CreateVolumesFromImageTest-946342167 None] Lock "cinder-072f9bad-ffb7-44a8-bbfa-d58fb18ddfbb-delete_volume" released by "delete_volume" :: held 1.731s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:29:14 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-7371ebad-05fc-452f-b705-59a294379aef tempest-VolumesCloneNegativeTest-796881877 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:29:14 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7371ebad-05fc-452f-b705-59a294379aef tempest-VolumesCloneNegativeTest-796881877 None] Flow 'volume_create_manager' (5c04528b-b4dc-4f27-a911-c978752f4b91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:29:14 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7371ebad-05fc-452f-b705-59a294379aef tempest-VolumesCloneNegativeTest-796881877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f6d1ec1-231d-4042-a62a-f908be42a9c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:29:14 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7371ebad-05fc-452f-b705-59a294379aef tempest-VolumesCloneNegativeTest-796881877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f6d1ec1-231d-4042-a62a-f908be42a9c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:29:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1902117382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=282e7b52-7bc2-4715-8954-806a5511f6e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a010a14caa344238954b12d14f23d66d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:29:14Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:29:14Z,use_quota=True,user_id='d39a4be334d849fe9d7d2253520bd76c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:29:14 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7371ebad-05fc-452f-b705-59a294379aef tempest-VolumesCloneNegativeTest-796881877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95e9a596-dcfe-452f-9c23-7a7e4c9d710f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:29:14 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7371ebad-05fc-452f-b705-59a294379aef tempest-VolumesCloneNegativeTest-796881877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95e9a596-dcfe-452f-9c23-7a7e4c9d710f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:29:14 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7371ebad-05fc-452f-b705-59a294379aef tempest-VolumesCloneNegativeTest-796881877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3bec565-da2d-49ae-81be-7ad871cbe635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:29:14 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7371ebad-05fc-452f-b705-59a294379aef tempest-VolumesCloneNegativeTest-796881877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3bec565-da2d-49ae-81be-7ad871cbe635) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '282e7b52-7bc2-4715-8954-806a5511f6e7', 'volume_name': 'volume-282e7b52-7bc2-4715-8954-806a5511f6e7', 'volume_size': 2}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:29:14 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7371ebad-05fc-452f-b705-59a294379aef tempest-VolumesCloneNegativeTest-796881877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d31314be-f33b-4f8e-a312-b230427cb059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:29:14 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7371ebad-05fc-452f-b705-59a294379aef tempest-VolumesCloneNegativeTest-796881877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d31314be-f33b-4f8e-a312-b230427cb059) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:29:14 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7371ebad-05fc-452f-b705-59a294379aef tempest-VolumesCloneNegativeTest-796881877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fed8c80-405b-4663-a152-f78c2e550e7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:29:14 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-7371ebad-05fc-452f-b705-59a294379aef tempest-VolumesCloneNegativeTest-796881877 None] Volume 282e7b52-7bc2-4715-8954-806a5511f6e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-282e7b52-7bc2-4715-8954-806a5511f6e7', 'volume_size': 2} Nov 06 15:29:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7371ebad-05fc-452f-b705-59a294379aef tempest-VolumesCloneNegativeTest-796881877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:29:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7371ebad-05fc-452f-b705-59a294379aef tempest-VolumesCloneNegativeTest-796881877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:29:14 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-7371ebad-05fc-452f-b705-59a294379aef tempest-VolumesCloneNegativeTest-796881877 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:29:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1902117382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=282e7b52-7bc2-4715-8954-806a5511f6e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a010a14caa344238954b12d14f23d66d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:29:14Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:29:14Z,use_quota=True,user_id='d39a4be334d849fe9d7d2253520bd76c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:29:14 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-7371ebad-05fc-452f-b705-59a294379aef tempest-VolumesCloneNegativeTest-796881877 None] Creating volume 282e7b52-7bc2-4715-8954-806a5511f6e7 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:29:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7371ebad-05fc-452f-b705-59a294379aef tempest-VolumesCloneNegativeTest-796881877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:29:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7371ebad-05fc-452f-b705-59a294379aef tempest-VolumesCloneNegativeTest-796881877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:29:14 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-7371ebad-05fc-452f-b705-59a294379aef tempest-VolumesCloneNegativeTest-796881877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:29:14 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-7371ebad-05fc-452f-b705-59a294379aef tempest-VolumesCloneNegativeTest-796881877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:29:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7371ebad-05fc-452f-b705-59a294379aef tempest-VolumesCloneNegativeTest-796881877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:29:14 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-7371ebad-05fc-452f-b705-59a294379aef tempest-VolumesCloneNegativeTest-796881877 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:29:14 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-7371ebad-05fc-452f-b705-59a294379aef tempest-VolumesCloneNegativeTest-796881877 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:29:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7371ebad-05fc-452f-b705-59a294379aef tempest-VolumesCloneNegativeTest-796881877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-282e7b52-7bc2-4715-8954-806a5511f6e7 2147483648 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:29:14 devstack sudo[99971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-282e7b52-7bc2-4715-8954-806a5511f6e7 2147483648 Nov 06 15:29:14 devstack sudo[99971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:29:15 devstack sudo[99971]: pam_unix(sudo:session): session closed for user root Nov 06 15:29:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7371ebad-05fc-452f-b705-59a294379aef tempest-VolumesCloneNegativeTest-796881877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-282e7b52-7bc2-4715-8954-806a5511f6e7 2147483648" returned: 0 in 0.649s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:29:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7371ebad-05fc-452f-b705-59a294379aef tempest-VolumesCloneNegativeTest-796881877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-282e7b52-7bc2-4715-8954-806a5511f6e7 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:29:15 devstack sudo[99978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-282e7b52-7bc2-4715-8954-806a5511f6e7 Nov 06 15:29:15 devstack sudo[99978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:29:15 devstack sudo[99978]: pam_unix(sudo:session): session closed for user root Nov 06 15:29:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7371ebad-05fc-452f-b705-59a294379aef tempest-VolumesCloneNegativeTest-796881877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-282e7b52-7bc2-4715-8954-806a5511f6e7" returned: 0 in 0.345s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:29:15 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-7371ebad-05fc-452f-b705-59a294379aef tempest-VolumesCloneNegativeTest-796881877 None] <== create_volume: return (1094ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:29:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7371ebad-05fc-452f-b705-59a294379aef tempest-VolumesCloneNegativeTest-796881877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.098s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:29:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7371ebad-05fc-452f-b705-59a294379aef tempest-VolumesCloneNegativeTest-796881877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fed8c80-405b-4663-a152-f78c2e550e7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-282e7b52-7bc2-4715-8954-806a5511f6e7', 'volume_size': 2}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:29:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7371ebad-05fc-452f-b705-59a294379aef tempest-VolumesCloneNegativeTest-796881877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62ac674a-40be-426f-b98f-a3b3579e2fb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:29:15 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-7371ebad-05fc-452f-b705-59a294379aef tempest-VolumesCloneNegativeTest-796881877 None] Volume volume-282e7b52-7bc2-4715-8954-806a5511f6e7 (282e7b52-7bc2-4715-8954-806a5511f6e7): created successfully Nov 06 15:29:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7371ebad-05fc-452f-b705-59a294379aef tempest-VolumesCloneNegativeTest-796881877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62ac674a-40be-426f-b98f-a3b3579e2fb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:29:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7371ebad-05fc-452f-b705-59a294379aef tempest-VolumesCloneNegativeTest-796881877 None] Flow 'volume_create_manager' (5c04528b-b4dc-4f27-a911-c978752f4b91) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:29:15 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-7371ebad-05fc-452f-b705-59a294379aef tempest-VolumesCloneNegativeTest-796881877 None] Created volume successfully. Nov 06 15:29:16 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-1eec8f0d-b594-4452-8de0-20a6b04f1bef tempest-VolumesCloneNegativeTest-796881877 None] Acquiring lock "cinder-282e7b52-7bc2-4715-8954-806a5511f6e7-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:29:16 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-1eec8f0d-b594-4452-8de0-20a6b04f1bef tempest-VolumesCloneNegativeTest-796881877 None] Lock "cinder-282e7b52-7bc2-4715-8954-806a5511f6e7-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:29:16 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-1eec8f0d-b594-4452-8de0-20a6b04f1bef tempest-VolumesCloneNegativeTest-796881877 None] Acquiring lock "cinder-quobyte-282e7b52-7bc2-4715-8954-806a5511f6e7" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:29:16 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-1eec8f0d-b594-4452-8de0-20a6b04f1bef tempest-VolumesCloneNegativeTest-796881877 None] Lock "cinder-quobyte-282e7b52-7bc2-4715-8954-806a5511f6e7" acquired by "delete_volume" :: waited 0.021s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:29:16 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2076b81-b34e-4b6e-981f-371d96ff58ac]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:29:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1eec8f0d-b594-4452-8de0-20a6b04f1bef tempest-VolumesCloneNegativeTest-796881877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-282e7b52-7bc2-4715-8954-806a5511f6e7 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:29:16 devstack sudo[99982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-282e7b52-7bc2-4715-8954-806a5511f6e7 Nov 06 15:29:16 devstack sudo[99982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:29:17 devstack sudo[99982]: pam_unix(sudo:session): session closed for user root Nov 06 15:29:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1eec8f0d-b594-4452-8de0-20a6b04f1bef tempest-VolumesCloneNegativeTest-796881877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-282e7b52-7bc2-4715-8954-806a5511f6e7" returned: 0 in 0.600s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:29:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1eec8f0d-b594-4452-8de0-20a6b04f1bef tempest-VolumesCloneNegativeTest-796881877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-282e7b52-7bc2-4715-8954-806a5511f6e7 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:29:17 devstack sudo[99987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-282e7b52-7bc2-4715-8954-806a5511f6e7 Nov 06 15:29:17 devstack sudo[99987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:29:17 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b62369a-ac6a-457b-9faf-833bdc9c38dd tempest-VolumeDependencyTests-619800573 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:29:17 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1b62369a-ac6a-457b-9faf-833bdc9c38dd tempest-VolumeDependencyTests-619800573 None] Flow 'volume_create_manager' (20c66250-dcee-41ef-a91a-5d2970137fc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:29:17 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1b62369a-ac6a-457b-9faf-833bdc9c38dd tempest-VolumeDependencyTests-619800573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3e953c7-d52b-4d38-9250-c65d102ec99e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:29:17 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1b62369a-ac6a-457b-9faf-833bdc9c38dd tempest-VolumeDependencyTests-619800573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3e953c7-d52b-4d38-9250-c65d102ec99e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:29:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-58577485',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49e6edfd-6223-43f6-ab78-78a114f0372d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b8b08d46ebc4788bdfafa3221b1e105',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:29:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:29:17Z,use_quota=True,user_id='45b1debc660741c2a2ea2bead94859ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:29:17 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1b62369a-ac6a-457b-9faf-833bdc9c38dd tempest-VolumeDependencyTests-619800573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76b93699-a762-4643-a7fa-0176a05851e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:29:17 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1b62369a-ac6a-457b-9faf-833bdc9c38dd tempest-VolumeDependencyTests-619800573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76b93699-a762-4643-a7fa-0176a05851e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:29:17 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1b62369a-ac6a-457b-9faf-833bdc9c38dd tempest-VolumeDependencyTests-619800573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a9e64af-e9b3-444c-a4b5-121549ef6e96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:29:17 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1b62369a-ac6a-457b-9faf-833bdc9c38dd tempest-VolumeDependencyTests-619800573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a9e64af-e9b3-444c-a4b5-121549ef6e96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49e6edfd-6223-43f6-ab78-78a114f0372d', 'volume_name': 'volume-49e6edfd-6223-43f6-ab78-78a114f0372d', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:29:17 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1b62369a-ac6a-457b-9faf-833bdc9c38dd tempest-VolumeDependencyTests-619800573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a11ea77-dd84-4389-8db2-c0da6dff2431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:29:17 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1b62369a-ac6a-457b-9faf-833bdc9c38dd tempest-VolumeDependencyTests-619800573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a11ea77-dd84-4389-8db2-c0da6dff2431) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:29:17 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1b62369a-ac6a-457b-9faf-833bdc9c38dd tempest-VolumeDependencyTests-619800573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79ed6edc-c8d4-4d7e-9de5-89b6cfc8ec3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:29:17 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-1b62369a-ac6a-457b-9faf-833bdc9c38dd tempest-VolumeDependencyTests-619800573 None] Volume 49e6edfd-6223-43f6-ab78-78a114f0372d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49e6edfd-6223-43f6-ab78-78a114f0372d', 'volume_size': 1} Nov 06 15:29:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1b62369a-ac6a-457b-9faf-833bdc9c38dd tempest-VolumeDependencyTests-619800573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:29:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1b62369a-ac6a-457b-9faf-833bdc9c38dd tempest-VolumeDependencyTests-619800573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:29:17 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1b62369a-ac6a-457b-9faf-833bdc9c38dd tempest-VolumeDependencyTests-619800573 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:29:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-58577485',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49e6edfd-6223-43f6-ab78-78a114f0372d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b8b08d46ebc4788bdfafa3221b1e105',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:29:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:29:17Z,use_quota=True,user_id='45b1debc660741c2a2ea2bead94859ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:29:17 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-1b62369a-ac6a-457b-9faf-833bdc9c38dd tempest-VolumeDependencyTests-619800573 None] Creating volume 49e6edfd-6223-43f6-ab78-78a114f0372d {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:29:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1b62369a-ac6a-457b-9faf-833bdc9c38dd tempest-VolumeDependencyTests-619800573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:29:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1b62369a-ac6a-457b-9faf-833bdc9c38dd tempest-VolumeDependencyTests-619800573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:29:17 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1b62369a-ac6a-457b-9faf-833bdc9c38dd tempest-VolumeDependencyTests-619800573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:29:17 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1b62369a-ac6a-457b-9faf-833bdc9c38dd tempest-VolumeDependencyTests-619800573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:29:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1b62369a-ac6a-457b-9faf-833bdc9c38dd tempest-VolumeDependencyTests-619800573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:29:17 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1b62369a-ac6a-457b-9faf-833bdc9c38dd tempest-VolumeDependencyTests-619800573 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:29:17 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-1b62369a-ac6a-457b-9faf-833bdc9c38dd tempest-VolumeDependencyTests-619800573 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:29:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1b62369a-ac6a-457b-9faf-833bdc9c38dd tempest-VolumeDependencyTests-619800573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-49e6edfd-6223-43f6-ab78-78a114f0372d 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:29:17 devstack sudo[99987]: pam_unix(sudo:session): session closed for user root Nov 06 15:29:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1eec8f0d-b594-4452-8de0-20a6b04f1bef tempest-VolumesCloneNegativeTest-796881877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-282e7b52-7bc2-4715-8954-806a5511f6e7" returned: 0 in 0.306s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:29:17 devstack sudo[99990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-49e6edfd-6223-43f6-ab78-78a114f0372d 1073741824 Nov 06 15:29:17 devstack sudo[99990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:29:17 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-1eec8f0d-b594-4452-8de0-20a6b04f1bef tempest-VolumesCloneNegativeTest-796881877 None] Lock "cinder-quobyte-282e7b52-7bc2-4715-8954-806a5511f6e7" released by "delete_volume" :: held 0.978s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:29:17 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-1eec8f0d-b594-4452-8de0-20a6b04f1bef tempest-VolumesCloneNegativeTest-796881877 None] Created reservations ['36e2a289-01e2-4f68-b9d3-0de079112915', '165d2b56-7083-4bbb-ad92-bc6ad9a74f2c', '744676bf-d08d-45d3-b655-ad88e97f79de', 'ab8f73a6-7a15-44fc-93fb-0169dd8c6429'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:29:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1eec8f0d-b594-4452-8de0-20a6b04f1bef tempest-VolumesCloneNegativeTest-796881877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:29:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1eec8f0d-b594-4452-8de0-20a6b04f1bef tempest-VolumesCloneNegativeTest-796881877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:29:17 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1eec8f0d-b594-4452-8de0-20a6b04f1bef tempest-VolumesCloneNegativeTest-796881877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:29:17 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1eec8f0d-b594-4452-8de0-20a6b04f1bef tempest-VolumesCloneNegativeTest-796881877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:29:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1eec8f0d-b594-4452-8de0-20a6b04f1bef tempest-VolumesCloneNegativeTest-796881877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:29:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1eec8f0d-b594-4452-8de0-20a6b04f1bef tempest-VolumesCloneNegativeTest-796881877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:29:17 devstack sudo[99992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:29:17 devstack sudo[99992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:29:18 devstack sudo[99992]: pam_unix(sudo:session): session closed for user root Nov 06 15:29:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1eec8f0d-b594-4452-8de0-20a6b04f1bef tempest-VolumesCloneNegativeTest-796881877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.340s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:29:18 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-1eec8f0d-b594-4452-8de0-20a6b04f1bef tempest-VolumesCloneNegativeTest-796881877 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:29:18 devstack sudo[99990]: pam_unix(sudo:session): session closed for user root Nov 06 15:29:18 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-1eec8f0d-b594-4452-8de0-20a6b04f1bef tempest-VolumesCloneNegativeTest-796881877 None] Deleted volume successfully. Nov 06 15:29:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1b62369a-ac6a-457b-9faf-833bdc9c38dd tempest-VolumeDependencyTests-619800573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-49e6edfd-6223-43f6-ab78-78a114f0372d 1073741824" returned: 0 in 0.600s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:29:18 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-1eec8f0d-b594-4452-8de0-20a6b04f1bef tempest-VolumesCloneNegativeTest-796881877 None] Lock "cinder-282e7b52-7bc2-4715-8954-806a5511f6e7-delete_volume" released by "delete_volume" :: held 1.664s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:29:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1b62369a-ac6a-457b-9faf-833bdc9c38dd tempest-VolumeDependencyTests-619800573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-49e6edfd-6223-43f6-ab78-78a114f0372d {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:29:18 devstack sudo[99999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-49e6edfd-6223-43f6-ab78-78a114f0372d Nov 06 15:29:18 devstack sudo[99999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:29:18 devstack sudo[99999]: pam_unix(sudo:session): session closed for user root Nov 06 15:29:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1b62369a-ac6a-457b-9faf-833bdc9c38dd tempest-VolumeDependencyTests-619800573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-49e6edfd-6223-43f6-ab78-78a114f0372d" returned: 0 in 0.266s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:29:18 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1b62369a-ac6a-457b-9faf-833bdc9c38dd tempest-VolumeDependencyTests-619800573 None] <== create_volume: return (939ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:29:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1b62369a-ac6a-457b-9faf-833bdc9c38dd tempest-VolumeDependencyTests-619800573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.943s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:29:18 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1b62369a-ac6a-457b-9faf-833bdc9c38dd tempest-VolumeDependencyTests-619800573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79ed6edc-c8d4-4d7e-9de5-89b6cfc8ec3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49e6edfd-6223-43f6-ab78-78a114f0372d', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:29:18 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1b62369a-ac6a-457b-9faf-833bdc9c38dd tempest-VolumeDependencyTests-619800573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d4db798-5792-4d9e-8a4c-6da8a38c2e48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:29:18 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-1b62369a-ac6a-457b-9faf-833bdc9c38dd tempest-VolumeDependencyTests-619800573 None] Volume volume-49e6edfd-6223-43f6-ab78-78a114f0372d (49e6edfd-6223-43f6-ab78-78a114f0372d): created successfully Nov 06 15:29:18 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1b62369a-ac6a-457b-9faf-833bdc9c38dd tempest-VolumeDependencyTests-619800573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d4db798-5792-4d9e-8a4c-6da8a38c2e48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:29:18 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1b62369a-ac6a-457b-9faf-833bdc9c38dd tempest-VolumeDependencyTests-619800573 None] Flow 'volume_create_manager' (20c66250-dcee-41ef-a91a-5d2970137fc2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:29:18 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-1b62369a-ac6a-457b-9faf-833bdc9c38dd tempest-VolumeDependencyTests-619800573 None] Created volume successfully. Nov 06 15:29:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-2546c119-64f5-4760-a79c-c8447660e9b0 tempest-VolumeDependencyTests-619800573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:29:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-2546c119-64f5-4760-a79c-c8447660e9b0 tempest-VolumeDependencyTests-619800573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:29:19 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-2546c119-64f5-4760-a79c-c8447660e9b0 tempest-VolumeDependencyTests-619800573 None] Creating offline snapshot eaf27717-7385-43f5-ba79-9a93c3723ac0 of volume 49e6edfd-6223-43f6-ab78-78a114f0372d {{(pid=87132) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 15:29:19 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[528ae145-c5be-4ab3-8e60-fdc1a390f1d4]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:29:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2546c119-64f5-4760-a79c-c8447660e9b0 tempest-VolumeDependencyTests-619800573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-49e6edfd-6223-43f6-ab78-78a114f0372d {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:29:19 devstack sudo[100032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-49e6edfd-6223-43f6-ab78-78a114f0372d Nov 06 15:29:19 devstack sudo[100032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:29:20 devstack sudo[100032]: pam_unix(sudo:session): session closed for user root Nov 06 15:29:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2546c119-64f5-4760-a79c-c8447660e9b0 tempest-VolumeDependencyTests-619800573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-49e6edfd-6223-43f6-ab78-78a114f0372d" returned: 0 in 0.473s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:29:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2546c119-64f5-4760-a79c-c8447660e9b0 tempest-VolumeDependencyTests-619800573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-49e6edfd-6223-43f6-ab78-78a114f0372d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-49e6edfd-6223-43f6-ab78-78a114f0372d.eaf27717-7385-43f5-ba79-9a93c3723ac0 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:29:20 devstack sudo[100037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-49e6edfd-6223-43f6-ab78-78a114f0372d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-49e6edfd-6223-43f6-ab78-78a114f0372d.eaf27717-7385-43f5-ba79-9a93c3723ac0 1G Nov 06 15:29:20 devstack sudo[100037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:29:20 devstack sudo[100037]: pam_unix(sudo:session): session closed for user root Nov 06 15:29:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2546c119-64f5-4760-a79c-c8447660e9b0 tempest-VolumeDependencyTests-619800573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-49e6edfd-6223-43f6-ab78-78a114f0372d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-49e6edfd-6223-43f6-ab78-78a114f0372d.eaf27717-7385-43f5-ba79-9a93c3723ac0 1G" returned: 0 in 0.568s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:29:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2546c119-64f5-4760-a79c-c8447660e9b0 tempest-VolumeDependencyTests-619800573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-49e6edfd-6223-43f6-ab78-78a114f0372d -F qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-49e6edfd-6223-43f6-ab78-78a114f0372d.eaf27717-7385-43f5-ba79-9a93c3723ac0 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:29:20 devstack sudo[100058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-49e6edfd-6223-43f6-ab78-78a114f0372d -F qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-49e6edfd-6223-43f6-ab78-78a114f0372d.eaf27717-7385-43f5-ba79-9a93c3723ac0 Nov 06 15:29:20 devstack sudo[100058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:29:21 devstack sudo[100058]: pam_unix(sudo:session): session closed for user root Nov 06 15:29:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2546c119-64f5-4760-a79c-c8447660e9b0 tempest-VolumeDependencyTests-619800573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-49e6edfd-6223-43f6-ab78-78a114f0372d -F qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-49e6edfd-6223-43f6-ab78-78a114f0372d.eaf27717-7385-43f5-ba79-9a93c3723ac0" returned: 0 in 0.337s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:29:21 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-2546c119-64f5-4760-a79c-c8447660e9b0 tempest-VolumeDependencyTests-619800573 None] /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-49e6edfd-6223-43f6-ab78-78a114f0372d.eaf27717-7385-43f5-ba79-9a93c3723ac0 is being set with open permissions: ugo+rw Nov 06 15:29:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2546c119-64f5-4760-a79c-c8447660e9b0 tempest-VolumeDependencyTests-619800573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-49e6edfd-6223-43f6-ab78-78a114f0372d.eaf27717-7385-43f5-ba79-9a93c3723ac0 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:29:21 devstack sudo[100063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-49e6edfd-6223-43f6-ab78-78a114f0372d.eaf27717-7385-43f5-ba79-9a93c3723ac0 Nov 06 15:29:21 devstack sudo[100063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:29:21 devstack sudo[100063]: pam_unix(sudo:session): session closed for user root Nov 06 15:29:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2546c119-64f5-4760-a79c-c8447660e9b0 tempest-VolumeDependencyTests-619800573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-49e6edfd-6223-43f6-ab78-78a114f0372d.eaf27717-7385-43f5-ba79-9a93c3723ac0" returned: 0 in 0.278s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:29:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2546c119-64f5-4760-a79c-c8447660e9b0 tempest-VolumeDependencyTests-619800573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-49e6edfd-6223-43f6-ab78-78a114f0372d.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:29:21 devstack sudo[100066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-49e6edfd-6223-43f6-ab78-78a114f0372d.info Nov 06 15:29:21 devstack sudo[100066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:29:21 devstack sudo[100066]: pam_unix(sudo:session): session closed for user root Nov 06 15:29:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2546c119-64f5-4760-a79c-c8447660e9b0 tempest-VolumeDependencyTests-619800573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-49e6edfd-6223-43f6-ab78-78a114f0372d.info" returned: 0 in 0.259s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:29:21 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-2546c119-64f5-4760-a79c-c8447660e9b0 tempest-VolumeDependencyTests-619800573 None] /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-49e6edfd-6223-43f6-ab78-78a114f0372d.info is being set with open permissions: ugo+rw Nov 06 15:29:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2546c119-64f5-4760-a79c-c8447660e9b0 tempest-VolumeDependencyTests-619800573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-49e6edfd-6223-43f6-ab78-78a114f0372d.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:29:21 devstack sudo[100069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-49e6edfd-6223-43f6-ab78-78a114f0372d.info Nov 06 15:29:21 devstack sudo[100069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:29:22 devstack sudo[100069]: pam_unix(sudo:session): session closed for user root Nov 06 15:29:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2546c119-64f5-4760-a79c-c8447660e9b0 tempest-VolumeDependencyTests-619800573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-49e6edfd-6223-43f6-ab78-78a114f0372d.info" returned: 0 in 0.248s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:29:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-2546c119-64f5-4760-a79c-c8447660e9b0 tempest-VolumeDependencyTests-619800573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.280s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:29:22 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-2546c119-64f5-4760-a79c-c8447660e9b0 tempest-VolumeDependencyTests-619800573 None] Create snapshot completed successfully Nov 06 15:29:22 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-323ee0d9-d4af-4194-bf04-d64e443e52f7 tempest-VolumesListTestJSON-937097860 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:29:22 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-323ee0d9-d4af-4194-bf04-d64e443e52f7 tempest-VolumesListTestJSON-937097860 None] Flow 'volume_create_manager' (41ca86cc-52b7-4a02-9449-a7ff7e461eb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:29:22 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-323ee0d9-d4af-4194-bf04-d64e443e52f7 tempest-VolumesListTestJSON-937097860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bfb331a-eed8-4321-84ba-02e8a00a99d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:29:22 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-323ee0d9-d4af-4194-bf04-d64e443e52f7 tempest-VolumesListTestJSON-937097860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bfb331a-eed8-4321-84ba-02e8a00a99d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:29:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1182701539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6c1e146-d851-4f8b-8a5d-215b3d8df5a8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='61e5f81b0664475d93fb566de149d6b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:29:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:29:23Z,use_quota=True,user_id='4403e8beb0b04104a29b9f68a1767efc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:29:22 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-323ee0d9-d4af-4194-bf04-d64e443e52f7 tempest-VolumesListTestJSON-937097860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea2ad292-5f79-4107-ac3b-fd2dca9bcb9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:29:22 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-323ee0d9-d4af-4194-bf04-d64e443e52f7 tempest-VolumesListTestJSON-937097860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea2ad292-5f79-4107-ac3b-fd2dca9bcb9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:29:23 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-323ee0d9-d4af-4194-bf04-d64e443e52f7 tempest-VolumesListTestJSON-937097860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5eea187-9fe9-41b9-9b76-e54507ffde7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:29:23 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-323ee0d9-d4af-4194-bf04-d64e443e52f7 tempest-VolumesListTestJSON-937097860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5eea187-9fe9-41b9-9b76-e54507ffde7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6c1e146-d851-4f8b-8a5d-215b3d8df5a8', 'volume_name': 'volume-e6c1e146-d851-4f8b-8a5d-215b3d8df5a8', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:29:23 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-323ee0d9-d4af-4194-bf04-d64e443e52f7 tempest-VolumesListTestJSON-937097860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab9169b2-15b6-490d-89ac-fa0a24eab934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:29:23 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-323ee0d9-d4af-4194-bf04-d64e443e52f7 tempest-VolumesListTestJSON-937097860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab9169b2-15b6-490d-89ac-fa0a24eab934) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:29:23 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-323ee0d9-d4af-4194-bf04-d64e443e52f7 tempest-VolumesListTestJSON-937097860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62a8b8f8-480b-4a98-b5b6-5ddff79cd15b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:29:23 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-323ee0d9-d4af-4194-bf04-d64e443e52f7 tempest-VolumesListTestJSON-937097860 None] Volume e6c1e146-d851-4f8b-8a5d-215b3d8df5a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6c1e146-d851-4f8b-8a5d-215b3d8df5a8', 'volume_size': 1} Nov 06 15:29:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-323ee0d9-d4af-4194-bf04-d64e443e52f7 tempest-VolumesListTestJSON-937097860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:29:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-323ee0d9-d4af-4194-bf04-d64e443e52f7 tempest-VolumesListTestJSON-937097860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:29:23 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-323ee0d9-d4af-4194-bf04-d64e443e52f7 tempest-VolumesListTestJSON-937097860 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:29:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1182701539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6c1e146-d851-4f8b-8a5d-215b3d8df5a8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='61e5f81b0664475d93fb566de149d6b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:29:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:29:23Z,use_quota=True,user_id='4403e8beb0b04104a29b9f68a1767efc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:29:23 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-323ee0d9-d4af-4194-bf04-d64e443e52f7 tempest-VolumesListTestJSON-937097860 None] Creating volume e6c1e146-d851-4f8b-8a5d-215b3d8df5a8 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:29:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-323ee0d9-d4af-4194-bf04-d64e443e52f7 tempest-VolumesListTestJSON-937097860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:29:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-323ee0d9-d4af-4194-bf04-d64e443e52f7 tempest-VolumesListTestJSON-937097860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:29:23 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-323ee0d9-d4af-4194-bf04-d64e443e52f7 tempest-VolumesListTestJSON-937097860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:29:23 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-323ee0d9-d4af-4194-bf04-d64e443e52f7 tempest-VolumesListTestJSON-937097860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:29:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-323ee0d9-d4af-4194-bf04-d64e443e52f7 tempest-VolumesListTestJSON-937097860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:29:23 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-323ee0d9-d4af-4194-bf04-d64e443e52f7 tempest-VolumesListTestJSON-937097860 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:29:23 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-323ee0d9-d4af-4194-bf04-d64e443e52f7 tempest-VolumesListTestJSON-937097860 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:29:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-323ee0d9-d4af-4194-bf04-d64e443e52f7 tempest-VolumesListTestJSON-937097860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-e6c1e146-d851-4f8b-8a5d-215b3d8df5a8 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:29:23 devstack sudo[100072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-e6c1e146-d851-4f8b-8a5d-215b3d8df5a8 1073741824 Nov 06 15:29:23 devstack sudo[100072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:29:23 devstack sudo[100072]: pam_unix(sudo:session): session closed for user root Nov 06 15:29:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-323ee0d9-d4af-4194-bf04-d64e443e52f7 tempest-VolumesListTestJSON-937097860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-e6c1e146-d851-4f8b-8a5d-215b3d8df5a8 1073741824" returned: 0 in 0.454s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:29:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-323ee0d9-d4af-4194-bf04-d64e443e52f7 tempest-VolumesListTestJSON-937097860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-e6c1e146-d851-4f8b-8a5d-215b3d8df5a8 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:29:23 devstack sudo[100078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-e6c1e146-d851-4f8b-8a5d-215b3d8df5a8 Nov 06 15:29:23 devstack sudo[100078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:29:23 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d52acb7-f471-4c0f-9d13-115d81af4e9e tempest-VolumeDependencyTests-619800573 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:29:23 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7d52acb7-f471-4c0f-9d13-115d81af4e9e tempest-VolumeDependencyTests-619800573 None] Flow 'volume_create_manager' (a223b588-ac77-421b-bca7-bc3c1e9e769b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:29:23 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7d52acb7-f471-4c0f-9d13-115d81af4e9e tempest-VolumeDependencyTests-619800573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8973dfc-ed7a-4300-a9d1-d9edc27317a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:29:23 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7d52acb7-f471-4c0f-9d13-115d81af4e9e tempest-VolumeDependencyTests-619800573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8973dfc-ed7a-4300-a9d1-d9edc27317a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:29:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-399901136',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0814099-27b3-40f6-98a1-de6efe46ec93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b8b08d46ebc4788bdfafa3221b1e105',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:29:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=eaf27717-7385-43f5-ba79-9a93c3723ac0,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:29:24Z,use_quota=True,user_id='45b1debc660741c2a2ea2bead94859ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:29:23 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7d52acb7-f471-4c0f-9d13-115d81af4e9e tempest-VolumeDependencyTests-619800573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (beec30d0-025b-4385-aeba-b0701d4de060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:29:23 devstack sudo[100078]: pam_unix(sudo:session): session closed for user root Nov 06 15:29:23 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7d52acb7-f471-4c0f-9d13-115d81af4e9e tempest-VolumeDependencyTests-619800573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (beec30d0-025b-4385-aeba-b0701d4de060) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:29:23 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7d52acb7-f471-4c0f-9d13-115d81af4e9e tempest-VolumeDependencyTests-619800573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04ec192d-3d27-464e-8b31-e7f54d1bd950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:29:23 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7d52acb7-f471-4c0f-9d13-115d81af4e9e tempest-VolumeDependencyTests-619800573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04ec192d-3d27-464e-8b31-e7f54d1bd950) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd0814099-27b3-40f6-98a1-de6efe46ec93', 'volume_name': 'volume-d0814099-27b3-40f6-98a1-de6efe46ec93', 'volume_size': 1, 'snapshot_id': 'eaf27717-7385-43f5-ba79-9a93c3723ac0'}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:29:23 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7d52acb7-f471-4c0f-9d13-115d81af4e9e tempest-VolumeDependencyTests-619800573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4f3c7f2-4641-4d5b-bfc6-eb5f1e612057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:29:23 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7d52acb7-f471-4c0f-9d13-115d81af4e9e tempest-VolumeDependencyTests-619800573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4f3c7f2-4641-4d5b-bfc6-eb5f1e612057) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:29:23 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7d52acb7-f471-4c0f-9d13-115d81af4e9e tempest-VolumeDependencyTests-619800573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84ded3a1-5de2-4027-8eba-ff271edd2b98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:29:23 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-7d52acb7-f471-4c0f-9d13-115d81af4e9e tempest-VolumeDependencyTests-619800573 None] Volume d0814099-27b3-40f6-98a1-de6efe46ec93: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d0814099-27b3-40f6-98a1-de6efe46ec93', 'volume_size': 1, 'snapshot_id': 'eaf27717-7385-43f5-ba79-9a93c3723ac0'} Nov 06 15:29:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-323ee0d9-d4af-4194-bf04-d64e443e52f7 tempest-VolumesListTestJSON-937097860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-e6c1e146-d851-4f8b-8a5d-215b3d8df5a8" returned: 0 in 0.279s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:29:23 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-323ee0d9-d4af-4194-bf04-d64e443e52f7 tempest-VolumesListTestJSON-937097860 None] <== create_volume: return (786ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:29:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-323ee0d9-d4af-4194-bf04-d64e443e52f7 tempest-VolumesListTestJSON-937097860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.789s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:29:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7d52acb7-f471-4c0f-9d13-115d81af4e9e tempest-VolumeDependencyTests-619800573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:29:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7d52acb7-f471-4c0f-9d13-115d81af4e9e tempest-VolumeDependencyTests-619800573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:29:23 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-7d52acb7-f471-4c0f-9d13-115d81af4e9e tempest-VolumeDependencyTests-619800573 None] Acquiring lock "cinder-quobyte-eaf27717-7385-43f5-ba79-9a93c3723ac0-d0814099-27b3-40f6-98a1-de6efe46ec93" by "_create_volume_from_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:29:23 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-323ee0d9-d4af-4194-bf04-d64e443e52f7 tempest-VolumesListTestJSON-937097860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62a8b8f8-480b-4a98-b5b6-5ddff79cd15b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6c1e146-d851-4f8b-8a5d-215b3d8df5a8', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:29:23 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-323ee0d9-d4af-4194-bf04-d64e443e52f7 tempest-VolumesListTestJSON-937097860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98359683-d1eb-4cea-ac11-cb40d3eb32bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:29:23 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-7d52acb7-f471-4c0f-9d13-115d81af4e9e tempest-VolumeDependencyTests-619800573 None] Lock "cinder-quobyte-eaf27717-7385-43f5-ba79-9a93c3723ac0-d0814099-27b3-40f6-98a1-de6efe46ec93" acquired by "_create_volume_from_snapshot" :: waited 0.024s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:29:23 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-7d52acb7-f471-4c0f-9d13-115d81af4e9e tempest-VolumeDependencyTests-619800573 None] Creating volume d0814099-27b3-40f6-98a1-de6efe46ec93 from snapshot eaf27717-7385-43f5-ba79-9a93c3723ac0 {{(pid=87132) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 06 15:29:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7d52acb7-f471-4c0f-9d13-115d81af4e9e tempest-VolumeDependencyTests-619800573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:29:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7d52acb7-f471-4c0f-9d13-115d81af4e9e tempest-VolumeDependencyTests-619800573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:29:23 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-7d52acb7-f471-4c0f-9d13-115d81af4e9e tempest-VolumeDependencyTests-619800573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:29:23 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-7d52acb7-f471-4c0f-9d13-115d81af4e9e tempest-VolumeDependencyTests-619800573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:29:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7d52acb7-f471-4c0f-9d13-115d81af4e9e tempest-VolumeDependencyTests-619800573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:29:23 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-7d52acb7-f471-4c0f-9d13-115d81af4e9e tempest-VolumeDependencyTests-619800573 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:29:23 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-7d52acb7-f471-4c0f-9d13-115d81af4e9e tempest-VolumeDependencyTests-619800573 None] Acquiring lock "cinder-quobyte-d0814099-27b3-40f6-98a1-de6efe46ec93" by "_copy_volume_from_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:29:23 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-323ee0d9-d4af-4194-bf04-d64e443e52f7 tempest-VolumesListTestJSON-937097860 None] Volume volume-e6c1e146-d851-4f8b-8a5d-215b3d8df5a8 (e6c1e146-d851-4f8b-8a5d-215b3d8df5a8): created successfully Nov 06 15:29:23 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-323ee0d9-d4af-4194-bf04-d64e443e52f7 tempest-VolumesListTestJSON-937097860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98359683-d1eb-4cea-ac11-cb40d3eb32bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:29:23 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-323ee0d9-d4af-4194-bf04-d64e443e52f7 tempest-VolumesListTestJSON-937097860 None] Flow 'volume_create_manager' (41ca86cc-52b7-4a02-9449-a7ff7e461eb0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:29:23 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-7d52acb7-f471-4c0f-9d13-115d81af4e9e tempest-VolumeDependencyTests-619800573 None] Lock "cinder-quobyte-d0814099-27b3-40f6-98a1-de6efe46ec93" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:29:23 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-7d52acb7-f471-4c0f-9d13-115d81af4e9e tempest-VolumeDependencyTests-619800573 None] snapshot: eaf27717-7385-43f5-ba79-9a93c3723ac0, volume: d0814099-27b3-40f6-98a1-de6efe46ec93, {{(pid=87132) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 06 15:29:23 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-323ee0d9-d4af-4194-bf04-d64e443e52f7 tempest-VolumesListTestJSON-937097860 None] Created volume successfully. Nov 06 15:29:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7d52acb7-f471-4c0f-9d13-115d81af4e9e tempest-VolumeDependencyTests-619800573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:29:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7d52acb7-f471-4c0f-9d13-115d81af4e9e tempest-VolumeDependencyTests-619800573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:29:23 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-7d52acb7-f471-4c0f-9d13-115d81af4e9e tempest-VolumeDependencyTests-619800573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:29:23 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-7d52acb7-f471-4c0f-9d13-115d81af4e9e tempest-VolumeDependencyTests-619800573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:29:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7d52acb7-f471-4c0f-9d13-115d81af4e9e tempest-VolumeDependencyTests-619800573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:29:23 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[749f0aa7-ae67-4ddc-9a89-5690387dfbee]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:29:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7d52acb7-f471-4c0f-9d13-115d81af4e9e tempest-VolumeDependencyTests-619800573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-49e6edfd-6223-43f6-ab78-78a114f0372d.eaf27717-7385-43f5-ba79-9a93c3723ac0 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:29:24 devstack sudo[100081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-49e6edfd-6223-43f6-ab78-78a114f0372d.eaf27717-7385-43f5-ba79-9a93c3723ac0 Nov 06 15:29:24 devstack sudo[100081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:29:24 devstack sudo[100081]: pam_unix(sudo:session): session closed for user root Nov 06 15:29:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7d52acb7-f471-4c0f-9d13-115d81af4e9e tempest-VolumeDependencyTests-619800573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-49e6edfd-6223-43f6-ab78-78a114f0372d.eaf27717-7385-43f5-ba79-9a93c3723ac0" returned: 0 in 0.386s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:29:24 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-7d52acb7-f471-4c0f-9d13-115d81af4e9e tempest-VolumeDependencyTests-619800573 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-49e6edfd-6223-43f6-ab78-78a114f0372d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 15:29:24 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[b804c220-a822-4164-8ea1-dd1766b4518a]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:29:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7d52acb7-f471-4c0f-9d13-115d81af4e9e tempest-VolumeDependencyTests-619800573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-49e6edfd-6223-43f6-ab78-78a114f0372d {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:29:24 devstack sudo[100086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-49e6edfd-6223-43f6-ab78-78a114f0372d Nov 06 15:29:24 devstack sudo[100086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:29:24 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-639b030b-9ba6-4f6f-86bb-49fc4f0c44e5 tempest-VolumesListTestJSON-937097860 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:29:24 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-639b030b-9ba6-4f6f-86bb-49fc4f0c44e5 tempest-VolumesListTestJSON-937097860 None] Flow 'volume_create_manager' (b9db2d96-3458-4f51-aaad-86216465077b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:29:24 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-639b030b-9ba6-4f6f-86bb-49fc4f0c44e5 tempest-VolumesListTestJSON-937097860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b0f7bad-9632-4754-a22f-99d19c73d089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:29:24 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-639b030b-9ba6-4f6f-86bb-49fc4f0c44e5 tempest-VolumesListTestJSON-937097860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b0f7bad-9632-4754-a22f-99d19c73d089) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:29:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-183899104',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38310655-1cce-406b-b1b9-b76d2727df75,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='61e5f81b0664475d93fb566de149d6b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:29:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:29:24Z,use_quota=True,user_id='4403e8beb0b04104a29b9f68a1767efc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:29:24 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-639b030b-9ba6-4f6f-86bb-49fc4f0c44e5 tempest-VolumesListTestJSON-937097860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80d37c7a-2d43-4500-ba26-236733bbc9c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:29:24 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-639b030b-9ba6-4f6f-86bb-49fc4f0c44e5 tempest-VolumesListTestJSON-937097860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80d37c7a-2d43-4500-ba26-236733bbc9c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:29:24 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-639b030b-9ba6-4f6f-86bb-49fc4f0c44e5 tempest-VolumesListTestJSON-937097860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b882f84a-c00d-4125-8c7f-b32326c1393e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:29:24 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-639b030b-9ba6-4f6f-86bb-49fc4f0c44e5 tempest-VolumesListTestJSON-937097860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b882f84a-c00d-4125-8c7f-b32326c1393e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38310655-1cce-406b-b1b9-b76d2727df75', 'volume_name': 'volume-38310655-1cce-406b-b1b9-b76d2727df75', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:29:24 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-639b030b-9ba6-4f6f-86bb-49fc4f0c44e5 tempest-VolumesListTestJSON-937097860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (229677f7-efb6-4169-8bf5-626d7e68afb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:29:24 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-639b030b-9ba6-4f6f-86bb-49fc4f0c44e5 tempest-VolumesListTestJSON-937097860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (229677f7-efb6-4169-8bf5-626d7e68afb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:29:24 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-639b030b-9ba6-4f6f-86bb-49fc4f0c44e5 tempest-VolumesListTestJSON-937097860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2be84943-be6c-42c3-8ea6-786b547adc7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:29:24 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-639b030b-9ba6-4f6f-86bb-49fc4f0c44e5 tempest-VolumesListTestJSON-937097860 None] Volume 38310655-1cce-406b-b1b9-b76d2727df75: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38310655-1cce-406b-b1b9-b76d2727df75', 'volume_size': 1} Nov 06 15:29:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-639b030b-9ba6-4f6f-86bb-49fc4f0c44e5 tempest-VolumesListTestJSON-937097860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:29:24 devstack sudo[100086]: pam_unix(sudo:session): session closed for user root Nov 06 15:29:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7d52acb7-f471-4c0f-9d13-115d81af4e9e tempest-VolumeDependencyTests-619800573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-49e6edfd-6223-43f6-ab78-78a114f0372d" returned: 0 in 0.360s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:29:24 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-7d52acb7-f471-4c0f-9d13-115d81af4e9e tempest-VolumeDependencyTests-619800573 None] will copy from snapshot at /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-49e6edfd-6223-43f6-ab78-78a114f0372d {{(pid=87132) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 06 15:29:24 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-7d52acb7-f471-4c0f-9d13-115d81af4e9e tempest-VolumeDependencyTests-619800573 None] Creating direct copy from snapshot {{(pid=87132) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 06 15:29:24 devstack cinder-volume[87132]: DEBUG cinder.utils [None req-7d52acb7-f471-4c0f-9d13-115d81af4e9e tempest-VolumeDependencyTests-619800573 None] Path /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d0814099-27b3-40f6-98a1-de6efe46ec93 not found in is_blk_device check {{(pid=87132) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 06 15:29:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7d52acb7-f471-4c0f-9d13-115d81af4e9e tempest-VolumeDependencyTests-619800573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-49e6edfd-6223-43f6-ab78-78a114f0372d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d0814099-27b3-40f6-98a1-de6efe46ec93 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:29:24 devstack sudo[100091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-49e6edfd-6223-43f6-ab78-78a114f0372d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d0814099-27b3-40f6-98a1-de6efe46ec93 Nov 06 15:29:24 devstack sudo[100091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:29:30 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-e345f0fa-f494-46f9-95e1-c4492d0d6d08 tempest-AttachVolumeTestJSON-1915243344 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:29:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e345f0fa-f494-46f9-95e1-c4492d0d6d08 tempest-AttachVolumeTestJSON-1915243344 None] Flow 'volume_create_manager' (606b7c12-9e78-410b-b181-33ff24ac8727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:29:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e345f0fa-f494-46f9-95e1-c4492d0d6d08 tempest-AttachVolumeTestJSON-1915243344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46ff731f-4519-41ae-a380-ca74f5f0ff67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:29:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e345f0fa-f494-46f9-95e1-c4492d0d6d08 tempest-AttachVolumeTestJSON-1915243344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46ff731f-4519-41ae-a380-ca74f5f0ff67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:29:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-627409908',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70c403ec-d483-495c-a303-68873958faa4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df60c116e43e4612a2d71379e4f5f302',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:29:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:29:31Z,use_quota=True,user_id='4314c5201ae84b138adcec47db5e56fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:29:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e345f0fa-f494-46f9-95e1-c4492d0d6d08 tempest-AttachVolumeTestJSON-1915243344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c64c1714-0757-4bff-82c1-3ad3437fd0fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:29:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e345f0fa-f494-46f9-95e1-c4492d0d6d08 tempest-AttachVolumeTestJSON-1915243344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c64c1714-0757-4bff-82c1-3ad3437fd0fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:29:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e345f0fa-f494-46f9-95e1-c4492d0d6d08 tempest-AttachVolumeTestJSON-1915243344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb0a840d-0fb7-41cb-9c81-66c04e3e53cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:29:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e345f0fa-f494-46f9-95e1-c4492d0d6d08 tempest-AttachVolumeTestJSON-1915243344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb0a840d-0fb7-41cb-9c81-66c04e3e53cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70c403ec-d483-495c-a303-68873958faa4', 'volume_name': 'volume-70c403ec-d483-495c-a303-68873958faa4', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:29:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e345f0fa-f494-46f9-95e1-c4492d0d6d08 tempest-AttachVolumeTestJSON-1915243344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2746959d-2ea9-46c7-a4ab-91f2bb7d1778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:29:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e345f0fa-f494-46f9-95e1-c4492d0d6d08 tempest-AttachVolumeTestJSON-1915243344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2746959d-2ea9-46c7-a4ab-91f2bb7d1778) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:29:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e345f0fa-f494-46f9-95e1-c4492d0d6d08 tempest-AttachVolumeTestJSON-1915243344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9e0b4de-14f8-47de-9408-f949946df5e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:29:31 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-e345f0fa-f494-46f9-95e1-c4492d0d6d08 tempest-AttachVolumeTestJSON-1915243344 None] Volume 70c403ec-d483-495c-a303-68873958faa4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70c403ec-d483-495c-a303-68873958faa4', 'volume_size': 1} Nov 06 15:29:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e345f0fa-f494-46f9-95e1-c4492d0d6d08 tempest-AttachVolumeTestJSON-1915243344 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:29:32 devstack sudo[100091]: pam_unix(sudo:session): session closed for user root Nov 06 15:29:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7d52acb7-f471-4c0f-9d13-115d81af4e9e tempest-VolumeDependencyTests-619800573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-49e6edfd-6223-43f6-ab78-78a114f0372d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d0814099-27b3-40f6-98a1-de6efe46ec93" returned: 0 in 7.686s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:29:32 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-7d52acb7-f471-4c0f-9d13-115d81af4e9e tempest-VolumeDependencyTests-619800573 None] Image conversion details: src /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-49e6edfd-6223-43f6-ab78-78a114f0372d, size 1024.00 MB, duration 7.69 sec, destination /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d0814099-27b3-40f6-98a1-de6efe46ec93 {{(pid=87132) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 06 15:29:32 devstack cinder-volume[87132]: INFO cinder.image.image_utils [None req-7d52acb7-f471-4c0f-9d13-115d81af4e9e tempest-VolumeDependencyTests-619800573 None] Converted 1024.00 MB image at 133.21 MB/s Nov 06 15:29:32 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-7d52acb7-f471-4c0f-9d13-115d81af4e9e tempest-VolumeDependencyTests-619800573 None] /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d0814099-27b3-40f6-98a1-de6efe46ec93 is being set with open permissions: ugo+rw Nov 06 15:29:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7d52acb7-f471-4c0f-9d13-115d81af4e9e tempest-VolumeDependencyTests-619800573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d0814099-27b3-40f6-98a1-de6efe46ec93 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:29:32 devstack sudo[100114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d0814099-27b3-40f6-98a1-de6efe46ec93 Nov 06 15:29:32 devstack sudo[100114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:29:32 devstack sudo[100114]: pam_unix(sudo:session): session closed for user root Nov 06 15:29:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7d52acb7-f471-4c0f-9d13-115d81af4e9e tempest-VolumeDependencyTests-619800573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d0814099-27b3-40f6-98a1-de6efe46ec93" returned: 0 in 0.315s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:29:32 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-7d52acb7-f471-4c0f-9d13-115d81af4e9e tempest-VolumeDependencyTests-619800573 None] Lock "cinder-quobyte-d0814099-27b3-40f6-98a1-de6efe46ec93" released by "_copy_volume_from_snapshot" :: held 8.851s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:29:32 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-7d52acb7-f471-4c0f-9d13-115d81af4e9e tempest-VolumeDependencyTests-619800573 None] Lock "cinder-quobyte-eaf27717-7385-43f5-ba79-9a93c3723ac0-d0814099-27b3-40f6-98a1-de6efe46ec93" released by "_create_volume_from_snapshot" :: held 8.935s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:29:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7d52acb7-f471-4c0f-9d13-115d81af4e9e tempest-VolumeDependencyTests-619800573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.961s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:29:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-639b030b-9ba6-4f6f-86bb-49fc4f0c44e5 tempest-VolumesListTestJSON-937097860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.192s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:29:32 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-639b030b-9ba6-4f6f-86bb-49fc4f0c44e5 tempest-VolumesListTestJSON-937097860 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:29:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-183899104',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38310655-1cce-406b-b1b9-b76d2727df75,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='61e5f81b0664475d93fb566de149d6b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:29:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:29:24Z,use_quota=True,user_id='4403e8beb0b04104a29b9f68a1767efc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:29:32 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-639b030b-9ba6-4f6f-86bb-49fc4f0c44e5 tempest-VolumesListTestJSON-937097860 None] Creating volume 38310655-1cce-406b-b1b9-b76d2727df75 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:29:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-639b030b-9ba6-4f6f-86bb-49fc4f0c44e5 tempest-VolumesListTestJSON-937097860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:29:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-639b030b-9ba6-4f6f-86bb-49fc4f0c44e5 tempest-VolumesListTestJSON-937097860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:29:32 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-639b030b-9ba6-4f6f-86bb-49fc4f0c44e5 tempest-VolumesListTestJSON-937097860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:29:32 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-639b030b-9ba6-4f6f-86bb-49fc4f0c44e5 tempest-VolumesListTestJSON-937097860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:29:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-639b030b-9ba6-4f6f-86bb-49fc4f0c44e5 tempest-VolumesListTestJSON-937097860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:29:32 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-639b030b-9ba6-4f6f-86bb-49fc4f0c44e5 tempest-VolumesListTestJSON-937097860 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:29:32 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-639b030b-9ba6-4f6f-86bb-49fc4f0c44e5 tempest-VolumesListTestJSON-937097860 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:29:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-639b030b-9ba6-4f6f-86bb-49fc4f0c44e5 tempest-VolumesListTestJSON-937097860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-38310655-1cce-406b-b1b9-b76d2727df75 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:29:32 devstack sudo[100117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-38310655-1cce-406b-b1b9-b76d2727df75 1073741824 Nov 06 15:29:32 devstack sudo[100117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:29:32 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7d52acb7-f471-4c0f-9d13-115d81af4e9e tempest-VolumeDependencyTests-619800573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84ded3a1-5de2-4027-8eba-ff271edd2b98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0814099-27b3-40f6-98a1-de6efe46ec93', 'volume_size': 1, 'snapshot_id': 'eaf27717-7385-43f5-ba79-9a93c3723ac0'}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:29:32 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7d52acb7-f471-4c0f-9d13-115d81af4e9e tempest-VolumeDependencyTests-619800573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf9ac848-7c23-44b0-a74a-c5c2de1b27f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:29:32 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-7d52acb7-f471-4c0f-9d13-115d81af4e9e tempest-VolumeDependencyTests-619800573 None] Volume volume-d0814099-27b3-40f6-98a1-de6efe46ec93 (d0814099-27b3-40f6-98a1-de6efe46ec93): created successfully Nov 06 15:29:32 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7d52acb7-f471-4c0f-9d13-115d81af4e9e tempest-VolumeDependencyTests-619800573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf9ac848-7c23-44b0-a74a-c5c2de1b27f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:29:32 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7d52acb7-f471-4c0f-9d13-115d81af4e9e tempest-VolumeDependencyTests-619800573 None] Flow 'volume_create_manager' (a223b588-ac77-421b-bca7-bc3c1e9e769b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:29:32 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-7d52acb7-f471-4c0f-9d13-115d81af4e9e tempest-VolumeDependencyTests-619800573 None] Created volume successfully. Nov 06 15:29:33 devstack sudo[100117]: pam_unix(sudo:session): session closed for user root Nov 06 15:29:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-639b030b-9ba6-4f6f-86bb-49fc4f0c44e5 tempest-VolumesListTestJSON-937097860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-38310655-1cce-406b-b1b9-b76d2727df75 1073741824" returned: 0 in 0.494s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:29:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-639b030b-9ba6-4f6f-86bb-49fc4f0c44e5 tempest-VolumesListTestJSON-937097860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-38310655-1cce-406b-b1b9-b76d2727df75 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:29:33 devstack sudo[100125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-38310655-1cce-406b-b1b9-b76d2727df75 Nov 06 15:29:33 devstack sudo[100125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:29:33 devstack sudo[100125]: pam_unix(sudo:session): session closed for user root Nov 06 15:29:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-639b030b-9ba6-4f6f-86bb-49fc4f0c44e5 tempest-VolumesListTestJSON-937097860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-38310655-1cce-406b-b1b9-b76d2727df75" returned: 0 in 0.312s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:29:33 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-639b030b-9ba6-4f6f-86bb-49fc4f0c44e5 tempest-VolumesListTestJSON-937097860 None] <== create_volume: return (850ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:29:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-639b030b-9ba6-4f6f-86bb-49fc4f0c44e5 tempest-VolumesListTestJSON-937097860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.855s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:29:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e345f0fa-f494-46f9-95e1-c4492d0d6d08 tempest-AttachVolumeTestJSON-1915243344 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.547s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:29:33 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e345f0fa-f494-46f9-95e1-c4492d0d6d08 tempest-AttachVolumeTestJSON-1915243344 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:29:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-627409908',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70c403ec-d483-495c-a303-68873958faa4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df60c116e43e4612a2d71379e4f5f302',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:29:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:29:31Z,use_quota=True,user_id='4314c5201ae84b138adcec47db5e56fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:29:33 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-e345f0fa-f494-46f9-95e1-c4492d0d6d08 tempest-AttachVolumeTestJSON-1915243344 None] Creating volume 70c403ec-d483-495c-a303-68873958faa4 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:29:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e345f0fa-f494-46f9-95e1-c4492d0d6d08 tempest-AttachVolumeTestJSON-1915243344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:29:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e345f0fa-f494-46f9-95e1-c4492d0d6d08 tempest-AttachVolumeTestJSON-1915243344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:29:33 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e345f0fa-f494-46f9-95e1-c4492d0d6d08 tempest-AttachVolumeTestJSON-1915243344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:29:33 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e345f0fa-f494-46f9-95e1-c4492d0d6d08 tempest-AttachVolumeTestJSON-1915243344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:29:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e345f0fa-f494-46f9-95e1-c4492d0d6d08 tempest-AttachVolumeTestJSON-1915243344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:29:33 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e345f0fa-f494-46f9-95e1-c4492d0d6d08 tempest-AttachVolumeTestJSON-1915243344 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:29:33 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-e345f0fa-f494-46f9-95e1-c4492d0d6d08 tempest-AttachVolumeTestJSON-1915243344 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:29:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e345f0fa-f494-46f9-95e1-c4492d0d6d08 tempest-AttachVolumeTestJSON-1915243344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-70c403ec-d483-495c-a303-68873958faa4 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:29:33 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-639b030b-9ba6-4f6f-86bb-49fc4f0c44e5 tempest-VolumesListTestJSON-937097860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2be84943-be6c-42c3-8ea6-786b547adc7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38310655-1cce-406b-b1b9-b76d2727df75', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:29:33 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-639b030b-9ba6-4f6f-86bb-49fc4f0c44e5 tempest-VolumesListTestJSON-937097860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecf7873a-02ce-4be6-adad-f12cae5ad7a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:29:33 devstack sudo[100128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-70c403ec-d483-495c-a303-68873958faa4 1073741824 Nov 06 15:29:33 devstack sudo[100128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:29:33 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-639b030b-9ba6-4f6f-86bb-49fc4f0c44e5 tempest-VolumesListTestJSON-937097860 None] Volume volume-38310655-1cce-406b-b1b9-b76d2727df75 (38310655-1cce-406b-b1b9-b76d2727df75): created successfully Nov 06 15:29:33 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-639b030b-9ba6-4f6f-86bb-49fc4f0c44e5 tempest-VolumesListTestJSON-937097860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecf7873a-02ce-4be6-adad-f12cae5ad7a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:29:33 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-639b030b-9ba6-4f6f-86bb-49fc4f0c44e5 tempest-VolumesListTestJSON-937097860 None] Flow 'volume_create_manager' (b9db2d96-3458-4f51-aaad-86216465077b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:29:33 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-eb85ebec-9ed0-4455-a367-03f277bab5ee tempest-VolumeDependencyTests-619800573 None] Acquiring lock "cinder-eaf27717-7385-43f5-ba79-9a93c3723ac0-delete_snapshot" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:29:33 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-639b030b-9ba6-4f6f-86bb-49fc4f0c44e5 tempest-VolumesListTestJSON-937097860 None] Created volume successfully. Nov 06 15:29:33 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-eb85ebec-9ed0-4455-a367-03f277bab5ee tempest-VolumeDependencyTests-619800573 None] Lock "cinder-eaf27717-7385-43f5-ba79-9a93c3723ac0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:29:33 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-eb85ebec-9ed0-4455-a367-03f277bab5ee tempest-VolumeDependencyTests-619800573 None] Acquiring lock "cinder-quobyte-49e6edfd-6223-43f6-ab78-78a114f0372d" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:29:33 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-eb85ebec-9ed0-4455-a367-03f277bab5ee tempest-VolumeDependencyTests-619800573 None] Lock "cinder-quobyte-49e6edfd-6223-43f6-ab78-78a114f0372d" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:29:33 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-eb85ebec-9ed0-4455-a367-03f277bab5ee tempest-VolumeDependencyTests-619800573 None] Acquiring lock "cinder-quobyte-eaf27717-7385-43f5-ba79-9a93c3723ac0" by "_delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:29:33 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-eb85ebec-9ed0-4455-a367-03f277bab5ee tempest-VolumeDependencyTests-619800573 None] Lock "cinder-quobyte-eaf27717-7385-43f5-ba79-9a93c3723ac0" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:29:33 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-eb85ebec-9ed0-4455-a367-03f277bab5ee tempest-VolumeDependencyTests-619800573 None] Deleting offline snapshot eaf27717-7385-43f5-ba79-9a93c3723ac0 of volume 49e6edfd-6223-43f6-ab78-78a114f0372d {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 15:29:33 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-eb85ebec-9ed0-4455-a367-03f277bab5ee tempest-VolumeDependencyTests-619800573 None] snapshot_file for this snap is: volume-49e6edfd-6223-43f6-ab78-78a114f0372d.eaf27717-7385-43f5-ba79-9a93c3723ac0 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 15:29:33 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf26aca0-ef1b-4f33-84f1-9204e92943a6]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:29:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-eb85ebec-9ed0-4455-a367-03f277bab5ee tempest-VolumeDependencyTests-619800573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-49e6edfd-6223-43f6-ab78-78a114f0372d.eaf27717-7385-43f5-ba79-9a93c3723ac0 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:29:34 devstack sudo[100130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-49e6edfd-6223-43f6-ab78-78a114f0372d.eaf27717-7385-43f5-ba79-9a93c3723ac0 Nov 06 15:29:34 devstack sudo[100130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:29:34 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-81f3f5ba-6ad3-4c5e-9792-68d5d09d69e8 req-1fb92a4e-002c-4dda-9af8-adc67a153208 tempest-TestMinimumBasicScenario-695150570 None] Terminate volume connection completed successfully. Nov 06 15:29:34 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-81f3f5ba-6ad3-4c5e-9792-68d5d09d69e8 req-1fb92a4e-002c-4dda-9af8-adc67a153208 tempest-TestMinimumBasicScenario-695150570 None] Deleting attachment 53b39914-32ff-4dde-bdeb-b2ee76f59bb0. {{(pid=87132) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 06 15:29:34 devstack sudo[100128]: pam_unix(sudo:session): session closed for user root Nov 06 15:29:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e345f0fa-f494-46f9-95e1-c4492d0d6d08 tempest-AttachVolumeTestJSON-1915243344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-70c403ec-d483-495c-a303-68873958faa4 1073741824" returned: 0 in 0.619s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:29:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e345f0fa-f494-46f9-95e1-c4492d0d6d08 tempest-AttachVolumeTestJSON-1915243344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-70c403ec-d483-495c-a303-68873958faa4 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:29:34 devstack sudo[100130]: pam_unix(sudo:session): session closed for user root Nov 06 15:29:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-eb85ebec-9ed0-4455-a367-03f277bab5ee tempest-VolumeDependencyTests-619800573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-49e6edfd-6223-43f6-ab78-78a114f0372d.eaf27717-7385-43f5-ba79-9a93c3723ac0" returned: 0 in 0.478s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:29:34 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-eb85ebec-9ed0-4455-a367-03f277bab5ee tempest-VolumeDependencyTests-619800573 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-49e6edfd-6223-43f6-ab78-78a114f0372d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 15:29:34 devstack sudo[100143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-70c403ec-d483-495c-a303-68873958faa4 Nov 06 15:29:34 devstack sudo[100143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:29:34 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[827f9780-d6c0-4e6b-b81c-23d88ced57fd]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:29:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-eb85ebec-9ed0-4455-a367-03f277bab5ee tempest-VolumeDependencyTests-619800573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-49e6edfd-6223-43f6-ab78-78a114f0372d {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:29:34 devstack sudo[100145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-49e6edfd-6223-43f6-ab78-78a114f0372d Nov 06 15:29:34 devstack sudo[100145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:29:34 devstack sudo[100143]: pam_unix(sudo:session): session closed for user root Nov 06 15:29:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e345f0fa-f494-46f9-95e1-c4492d0d6d08 tempest-AttachVolumeTestJSON-1915243344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-70c403ec-d483-495c-a303-68873958faa4" returned: 0 in 0.316s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:29:34 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e345f0fa-f494-46f9-95e1-c4492d0d6d08 tempest-AttachVolumeTestJSON-1915243344 None] <== create_volume: return (1017ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:29:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e345f0fa-f494-46f9-95e1-c4492d0d6d08 tempest-AttachVolumeTestJSON-1915243344 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.030s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:29:34 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e345f0fa-f494-46f9-95e1-c4492d0d6d08 tempest-AttachVolumeTestJSON-1915243344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9e0b4de-14f8-47de-9408-f949946df5e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70c403ec-d483-495c-a303-68873958faa4', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:29:34 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e345f0fa-f494-46f9-95e1-c4492d0d6d08 tempest-AttachVolumeTestJSON-1915243344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8459c1e2-fd0c-4bc0-8519-837f867447d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:29:34 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-e345f0fa-f494-46f9-95e1-c4492d0d6d08 tempest-AttachVolumeTestJSON-1915243344 None] Volume volume-70c403ec-d483-495c-a303-68873958faa4 (70c403ec-d483-495c-a303-68873958faa4): created successfully Nov 06 15:29:34 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e345f0fa-f494-46f9-95e1-c4492d0d6d08 tempest-AttachVolumeTestJSON-1915243344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8459c1e2-fd0c-4bc0-8519-837f867447d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:29:34 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e345f0fa-f494-46f9-95e1-c4492d0d6d08 tempest-AttachVolumeTestJSON-1915243344 None] Flow 'volume_create_manager' (606b7c12-9e78-410b-b181-33ff24ac8727) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:29:34 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-e345f0fa-f494-46f9-95e1-c4492d0d6d08 tempest-AttachVolumeTestJSON-1915243344 None] Created volume successfully. Nov 06 15:29:34 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-5749a22f-9bbd-4c43-bf49-adeeec3d7e30 tempest-TestMinimumBasicScenario-695150570 None] Acquiring lock "cinder-34da549c-cadd-4301-96cf-213722ffa79a-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:29:35 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-5749a22f-9bbd-4c43-bf49-adeeec3d7e30 tempest-TestMinimumBasicScenario-695150570 None] Lock "cinder-34da549c-cadd-4301-96cf-213722ffa79a-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:29:35 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-5749a22f-9bbd-4c43-bf49-adeeec3d7e30 tempest-TestMinimumBasicScenario-695150570 None] Acquiring lock "cinder-quobyte-34da549c-cadd-4301-96cf-213722ffa79a" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:29:35 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-5749a22f-9bbd-4c43-bf49-adeeec3d7e30 tempest-TestMinimumBasicScenario-695150570 None] Lock "cinder-quobyte-34da549c-cadd-4301-96cf-213722ffa79a" acquired by "delete_volume" :: waited 0.021s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:29:35 devstack sudo[100145]: pam_unix(sudo:session): session closed for user root Nov 06 15:29:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-eb85ebec-9ed0-4455-a367-03f277bab5ee tempest-VolumeDependencyTests-619800573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-49e6edfd-6223-43f6-ab78-78a114f0372d" returned: 0 in 0.682s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:29:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-eb85ebec-9ed0-4455-a367-03f277bab5ee tempest-VolumeDependencyTests-619800573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-49e6edfd-6223-43f6-ab78-78a114f0372d.eaf27717-7385-43f5-ba79-9a93c3723ac0 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:29:35 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[25fb8314-1f67-4444-8aaf-30e3a09b53e2]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:29:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5749a22f-9bbd-4c43-bf49-adeeec3d7e30 tempest-TestMinimumBasicScenario-695150570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-34da549c-cadd-4301-96cf-213722ffa79a {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:29:35 devstack sudo[100151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-49e6edfd-6223-43f6-ab78-78a114f0372d.eaf27717-7385-43f5-ba79-9a93c3723ac0 Nov 06 15:29:35 devstack sudo[100151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:29:35 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-3062dfc5-5338-433b-93c8-25e8ad9214fd tempest-VolumesListTestJSON-937097860 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:29:35 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3062dfc5-5338-433b-93c8-25e8ad9214fd tempest-VolumesListTestJSON-937097860 None] Flow 'volume_create_manager' (00bc119a-4ac4-4c20-b401-3d1fe21ee15f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:29:35 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3062dfc5-5338-433b-93c8-25e8ad9214fd tempest-VolumesListTestJSON-937097860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5890d09c-600a-48fb-8f99-781026bcba3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:29:35 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3062dfc5-5338-433b-93c8-25e8ad9214fd tempest-VolumesListTestJSON-937097860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5890d09c-600a-48fb-8f99-781026bcba3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:29:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1786466707',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4449c1ce-eb3b-40bf-8e8e-a50271a715a1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='61e5f81b0664475d93fb566de149d6b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:29:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:29:35Z,use_quota=True,user_id='4403e8beb0b04104a29b9f68a1767efc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:29:35 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3062dfc5-5338-433b-93c8-25e8ad9214fd tempest-VolumesListTestJSON-937097860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2674d493-a8ce-4bfb-b1db-5153141e24c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:29:35 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3062dfc5-5338-433b-93c8-25e8ad9214fd tempest-VolumesListTestJSON-937097860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2674d493-a8ce-4bfb-b1db-5153141e24c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:29:35 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3062dfc5-5338-433b-93c8-25e8ad9214fd tempest-VolumesListTestJSON-937097860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39302a87-14c6-48b6-b7e6-c57bd828c828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:29:35 devstack sudo[100153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-34da549c-cadd-4301-96cf-213722ffa79a Nov 06 15:29:35 devstack sudo[100153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:29:35 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3062dfc5-5338-433b-93c8-25e8ad9214fd tempest-VolumesListTestJSON-937097860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39302a87-14c6-48b6-b7e6-c57bd828c828) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4449c1ce-eb3b-40bf-8e8e-a50271a715a1', 'volume_name': 'volume-4449c1ce-eb3b-40bf-8e8e-a50271a715a1', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:29:35 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3062dfc5-5338-433b-93c8-25e8ad9214fd tempest-VolumesListTestJSON-937097860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bc61dd5-db1b-461b-8444-7929538ba4be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:29:35 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3062dfc5-5338-433b-93c8-25e8ad9214fd tempest-VolumesListTestJSON-937097860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bc61dd5-db1b-461b-8444-7929538ba4be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:29:35 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3062dfc5-5338-433b-93c8-25e8ad9214fd tempest-VolumesListTestJSON-937097860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46990adc-4ec3-43b9-bfd8-4cb9f4cd1ede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:29:35 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-3062dfc5-5338-433b-93c8-25e8ad9214fd tempest-VolumesListTestJSON-937097860 None] Volume 4449c1ce-eb3b-40bf-8e8e-a50271a715a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4449c1ce-eb3b-40bf-8e8e-a50271a715a1', 'volume_size': 1} Nov 06 15:29:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3062dfc5-5338-433b-93c8-25e8ad9214fd tempest-VolumesListTestJSON-937097860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:29:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3062dfc5-5338-433b-93c8-25e8ad9214fd tempest-VolumesListTestJSON-937097860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:29:35 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3062dfc5-5338-433b-93c8-25e8ad9214fd tempest-VolumesListTestJSON-937097860 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:29:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1786466707',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4449c1ce-eb3b-40bf-8e8e-a50271a715a1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='61e5f81b0664475d93fb566de149d6b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:29:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:29:35Z,use_quota=True,user_id='4403e8beb0b04104a29b9f68a1767efc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:29:35 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-3062dfc5-5338-433b-93c8-25e8ad9214fd tempest-VolumesListTestJSON-937097860 None] Creating volume 4449c1ce-eb3b-40bf-8e8e-a50271a715a1 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:29:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3062dfc5-5338-433b-93c8-25e8ad9214fd tempest-VolumesListTestJSON-937097860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:29:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3062dfc5-5338-433b-93c8-25e8ad9214fd tempest-VolumesListTestJSON-937097860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:29:35 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3062dfc5-5338-433b-93c8-25e8ad9214fd tempest-VolumesListTestJSON-937097860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:29:35 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3062dfc5-5338-433b-93c8-25e8ad9214fd tempest-VolumesListTestJSON-937097860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:29:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3062dfc5-5338-433b-93c8-25e8ad9214fd tempest-VolumesListTestJSON-937097860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:29:35 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3062dfc5-5338-433b-93c8-25e8ad9214fd tempest-VolumesListTestJSON-937097860 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:29:35 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-3062dfc5-5338-433b-93c8-25e8ad9214fd tempest-VolumesListTestJSON-937097860 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:29:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3062dfc5-5338-433b-93c8-25e8ad9214fd tempest-VolumesListTestJSON-937097860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-4449c1ce-eb3b-40bf-8e8e-a50271a715a1 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:29:35 devstack sudo[100159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-4449c1ce-eb3b-40bf-8e8e-a50271a715a1 1073741824 Nov 06 15:29:35 devstack sudo[100159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:29:35 devstack sudo[100151]: pam_unix(sudo:session): session closed for user root Nov 06 15:29:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-eb85ebec-9ed0-4455-a367-03f277bab5ee tempest-VolumeDependencyTests-619800573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-49e6edfd-6223-43f6-ab78-78a114f0372d.eaf27717-7385-43f5-ba79-9a93c3723ac0" returned: 0 in 0.402s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:29:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-eb85ebec-9ed0-4455-a367-03f277bab5ee tempest-VolumeDependencyTests-619800573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-49e6edfd-6223-43f6-ab78-78a114f0372d.eaf27717-7385-43f5-ba79-9a93c3723ac0 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:29:35 devstack sudo[100166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-49e6edfd-6223-43f6-ab78-78a114f0372d.eaf27717-7385-43f5-ba79-9a93c3723ac0 Nov 06 15:29:35 devstack sudo[100166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:29:35 devstack sudo[100153]: pam_unix(sudo:session): session closed for user root Nov 06 15:29:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5749a22f-9bbd-4c43-bf49-adeeec3d7e30 tempest-TestMinimumBasicScenario-695150570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-34da549c-cadd-4301-96cf-213722ffa79a" returned: 0 in 0.486s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:29:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5749a22f-9bbd-4c43-bf49-adeeec3d7e30 tempest-TestMinimumBasicScenario-695150570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-34da549c-cadd-4301-96cf-213722ffa79a {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:29:35 devstack sudo[100173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-34da549c-cadd-4301-96cf-213722ffa79a Nov 06 15:29:35 devstack sudo[100173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:29:35 devstack sudo[100166]: pam_unix(sudo:session): session closed for user root Nov 06 15:29:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-eb85ebec-9ed0-4455-a367-03f277bab5ee tempest-VolumeDependencyTests-619800573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-49e6edfd-6223-43f6-ab78-78a114f0372d.eaf27717-7385-43f5-ba79-9a93c3723ac0" returned: 0 in 0.317s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:29:35 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-eb85ebec-9ed0-4455-a367-03f277bab5ee tempest-VolumeDependencyTests-619800573 None] Lock "cinder-quobyte-eaf27717-7385-43f5-ba79-9a93c3723ac0" released by "_delete_snapshot" :: held 2.058s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:29:35 devstack sudo[100159]: pam_unix(sudo:session): session closed for user root Nov 06 15:29:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3062dfc5-5338-433b-93c8-25e8ad9214fd tempest-VolumesListTestJSON-937097860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-4449c1ce-eb3b-40bf-8e8e-a50271a715a1 1073741824" returned: 0 in 0.603s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:29:35 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-eb85ebec-9ed0-4455-a367-03f277bab5ee tempest-VolumeDependencyTests-619800573 None] Lock "cinder-quobyte-49e6edfd-6223-43f6-ab78-78a114f0372d" released by "delete_snapshot" :: held 2.102s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:29:35 devstack sudo[100173]: pam_unix(sudo:session): session closed for user root Nov 06 15:29:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5749a22f-9bbd-4c43-bf49-adeeec3d7e30 tempest-TestMinimumBasicScenario-695150570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-34da549c-cadd-4301-96cf-213722ffa79a" returned: 0 in 0.347s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:29:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3062dfc5-5338-433b-93c8-25e8ad9214fd tempest-VolumesListTestJSON-937097860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-4449c1ce-eb3b-40bf-8e8e-a50271a715a1 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:29:36 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-5749a22f-9bbd-4c43-bf49-adeeec3d7e30 tempest-TestMinimumBasicScenario-695150570 None] Lock "cinder-quobyte-34da549c-cadd-4301-96cf-213722ffa79a" released by "delete_volume" :: held 0.919s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:29:36 devstack sudo[100185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-4449c1ce-eb3b-40bf-8e8e-a50271a715a1 Nov 06 15:29:36 devstack sudo[100185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:29:36 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-eb85ebec-9ed0-4455-a367-03f277bab5ee tempest-VolumeDependencyTests-619800573 None] Created reservations ['b46185e5-4ab4-4c98-9566-e2bf8e3e82b7', '0b81bf79-7755-4416-b0f7-b2df37ed53fd', '123a8563-e572-4e3c-a8c3-d0f1812b5f29', '032f22a0-187a-4610-8ee3-827ac2999cf8'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:29:36 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-5749a22f-9bbd-4c43-bf49-adeeec3d7e30 tempest-TestMinimumBasicScenario-695150570 None] Created reservations ['1e9a479e-d2c2-4d8f-b11f-33c9f9c6f03c', 'd7d8b09c-18aa-449b-b795-9b63330f8560', 'f4c5015a-6e48-4a33-be36-9731595a537d', '03f101ea-51de-4883-89a2-8d3f2ac0ab1c'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:29:36 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-eb85ebec-9ed0-4455-a367-03f277bab5ee tempest-VolumeDependencyTests-619800573 None] Delete snapshot completed successfully. Nov 06 15:29:36 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-eb85ebec-9ed0-4455-a367-03f277bab5ee tempest-VolumeDependencyTests-619800573 None] Lock "cinder-eaf27717-7385-43f5-ba79-9a93c3723ac0-delete_snapshot" released by "delete_snapshot" :: held 2.403s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:29:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5749a22f-9bbd-4c43-bf49-adeeec3d7e30 tempest-TestMinimumBasicScenario-695150570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:29:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5749a22f-9bbd-4c43-bf49-adeeec3d7e30 tempest-TestMinimumBasicScenario-695150570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:29:36 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-5749a22f-9bbd-4c43-bf49-adeeec3d7e30 tempest-TestMinimumBasicScenario-695150570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:29:36 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-5749a22f-9bbd-4c43-bf49-adeeec3d7e30 tempest-TestMinimumBasicScenario-695150570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:29:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5749a22f-9bbd-4c43-bf49-adeeec3d7e30 tempest-TestMinimumBasicScenario-695150570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:29:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5749a22f-9bbd-4c43-bf49-adeeec3d7e30 tempest-TestMinimumBasicScenario-695150570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:29:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-197864f1-776b-40a6-bc88-1b2984f7cd7c req-82d5ad76-49bc-4bb0-b676-6833bfa90712 tempest-AttachVolumeTestJSON-1915243344 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:29:36 devstack sudo[100188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:29:36 devstack sudo[100188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:29:36 devstack sudo[100185]: pam_unix(sudo:session): session closed for user root Nov 06 15:29:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3062dfc5-5338-433b-93c8-25e8ad9214fd tempest-VolumesListTestJSON-937097860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-4449c1ce-eb3b-40bf-8e8e-a50271a715a1" returned: 0 in 0.341s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:29:36 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3062dfc5-5338-433b-93c8-25e8ad9214fd tempest-VolumesListTestJSON-937097860 None] <== create_volume: return (1021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:29:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3062dfc5-5338-433b-93c8-25e8ad9214fd tempest-VolumesListTestJSON-937097860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.024s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:29:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-197864f1-776b-40a6-bc88-1b2984f7cd7c req-82d5ad76-49bc-4bb0-b676-6833bfa90712 tempest-AttachVolumeTestJSON-1915243344 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.072s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:29:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3062dfc5-5338-433b-93c8-25e8ad9214fd tempest-VolumesListTestJSON-937097860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46990adc-4ec3-43b9-bfd8-4cb9f4cd1ede) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4449c1ce-eb3b-40bf-8e8e-a50271a715a1', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:29:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3062dfc5-5338-433b-93c8-25e8ad9214fd tempest-VolumesListTestJSON-937097860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (901072e6-d67b-4136-9df4-942763f0e005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:29:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-197864f1-776b-40a6-bc88-1b2984f7cd7c req-82d5ad76-49bc-4bb0-b676-6833bfa90712 tempest-AttachVolumeTestJSON-1915243344 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.028s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:29:36 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-3062dfc5-5338-433b-93c8-25e8ad9214fd tempest-VolumesListTestJSON-937097860 None] Volume volume-4449c1ce-eb3b-40bf-8e8e-a50271a715a1 (4449c1ce-eb3b-40bf-8e8e-a50271a715a1): created successfully Nov 06 15:29:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3062dfc5-5338-433b-93c8-25e8ad9214fd tempest-VolumesListTestJSON-937097860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (901072e6-d67b-4136-9df4-942763f0e005) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:29:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3062dfc5-5338-433b-93c8-25e8ad9214fd tempest-VolumesListTestJSON-937097860 None] Flow 'volume_create_manager' (00bc119a-4ac4-4c20-b401-3d1fe21ee15f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:29:36 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-3062dfc5-5338-433b-93c8-25e8ad9214fd tempest-VolumesListTestJSON-937097860 None] Created volume successfully. Nov 06 15:29:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-197864f1-776b-40a6-bc88-1b2984f7cd7c req-82d5ad76-49bc-4bb0-b676-6833bfa90712 tempest-AttachVolumeTestJSON-1915243344 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b', 'name': 'volume-70c403ec-d483-495c-a303-68873958faa4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e43d180c-b114-4ccd-8f28-1ddff403cf1e', 'enforce_multipath': True} {{(pid=87132) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 15:29:36 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-197864f1-776b-40a6-bc88-1b2984f7cd7c req-82d5ad76-49bc-4bb0-b676-6833bfa90712 tempest-AttachVolumeTestJSON-1915243344 None] attachment_update completed successfully. Nov 06 15:29:36 devstack sudo[100188]: pam_unix(sudo:session): session closed for user root Nov 06 15:29:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5749a22f-9bbd-4c43-bf49-adeeec3d7e30 tempest-TestMinimumBasicScenario-695150570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.261s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:29:36 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-5749a22f-9bbd-4c43-bf49-adeeec3d7e30 tempest-TestMinimumBasicScenario-695150570 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:29:36 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-5749a22f-9bbd-4c43-bf49-adeeec3d7e30 tempest-TestMinimumBasicScenario-695150570 None] Deleted volume successfully. Nov 06 15:29:36 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-5749a22f-9bbd-4c43-bf49-adeeec3d7e30 tempest-TestMinimumBasicScenario-695150570 None] Lock "cinder-34da549c-cadd-4301-96cf-213722ffa79a-delete_volume" released by "delete_volume" :: held 1.525s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:29:36 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a8febf4a-0abd-49eb-a2a6-5915461d4ac6 tempest-VolumeDependencyTests-619800573 None] Acquiring lock "cinder-49e6edfd-6223-43f6-ab78-78a114f0372d-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:29:36 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a8febf4a-0abd-49eb-a2a6-5915461d4ac6 tempest-VolumeDependencyTests-619800573 None] Lock "cinder-49e6edfd-6223-43f6-ab78-78a114f0372d-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:29:37 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a8febf4a-0abd-49eb-a2a6-5915461d4ac6 tempest-VolumeDependencyTests-619800573 None] Acquiring lock "cinder-quobyte-49e6edfd-6223-43f6-ab78-78a114f0372d" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:29:37 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a8febf4a-0abd-49eb-a2a6-5915461d4ac6 tempest-VolumeDependencyTests-619800573 None] Lock "cinder-quobyte-49e6edfd-6223-43f6-ab78-78a114f0372d" acquired by "delete_volume" :: waited 0.020s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:29:37 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[389fc1f2-b674-43ad-8c85-1a21ac5eefaa]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:29:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a8febf4a-0abd-49eb-a2a6-5915461d4ac6 tempest-VolumeDependencyTests-619800573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-49e6edfd-6223-43f6-ab78-78a114f0372d {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:29:37 devstack sudo[100606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-49e6edfd-6223-43f6-ab78-78a114f0372d Nov 06 15:29:37 devstack sudo[100606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:29:37 devstack sudo[100606]: pam_unix(sudo:session): session closed for user root Nov 06 15:29:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a8febf4a-0abd-49eb-a2a6-5915461d4ac6 tempest-VolumeDependencyTests-619800573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-49e6edfd-6223-43f6-ab78-78a114f0372d" returned: 0 in 0.485s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:29:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a8febf4a-0abd-49eb-a2a6-5915461d4ac6 tempest-VolumeDependencyTests-619800573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-49e6edfd-6223-43f6-ab78-78a114f0372d {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:29:37 devstack sudo[100611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-49e6edfd-6223-43f6-ab78-78a114f0372d Nov 06 15:29:37 devstack sudo[100611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:29:38 devstack sudo[100611]: pam_unix(sudo:session): session closed for user root Nov 06 15:29:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a8febf4a-0abd-49eb-a2a6-5915461d4ac6 tempest-VolumeDependencyTests-619800573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-49e6edfd-6223-43f6-ab78-78a114f0372d" returned: 0 in 0.436s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:29:38 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a8febf4a-0abd-49eb-a2a6-5915461d4ac6 tempest-VolumeDependencyTests-619800573 None] Lock "cinder-quobyte-49e6edfd-6223-43f6-ab78-78a114f0372d" released by "delete_volume" :: held 1.058s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:29:38 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-a8febf4a-0abd-49eb-a2a6-5915461d4ac6 tempest-VolumeDependencyTests-619800573 None] Created reservations ['741c89e1-4af5-491d-8d44-97fac8cc6a96', '12c61c97-6f3e-45ab-84c3-62b1eefec0c9', 'b06d753d-738a-4aa4-8d37-9373066de250', '53d5ff9b-19f1-4c80-aa15-cc2f8b514182'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:29:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a8febf4a-0abd-49eb-a2a6-5915461d4ac6 tempest-VolumeDependencyTests-619800573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:29:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a8febf4a-0abd-49eb-a2a6-5915461d4ac6 tempest-VolumeDependencyTests-619800573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:29:38 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-a8febf4a-0abd-49eb-a2a6-5915461d4ac6 tempest-VolumeDependencyTests-619800573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:29:38 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-a8febf4a-0abd-49eb-a2a6-5915461d4ac6 tempest-VolumeDependencyTests-619800573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:29:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a8febf4a-0abd-49eb-a2a6-5915461d4ac6 tempest-VolumeDependencyTests-619800573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:29:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a8febf4a-0abd-49eb-a2a6-5915461d4ac6 tempest-VolumeDependencyTests-619800573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:29:38 devstack sudo[100636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:29:38 devstack sudo[100636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:29:38 devstack sudo[100636]: pam_unix(sudo:session): session closed for user root Nov 06 15:29:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a8febf4a-0abd-49eb-a2a6-5915461d4ac6 tempest-VolumeDependencyTests-619800573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.325s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:29:38 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-a8febf4a-0abd-49eb-a2a6-5915461d4ac6 tempest-VolumeDependencyTests-619800573 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:29:38 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-a8febf4a-0abd-49eb-a2a6-5915461d4ac6 tempest-VolumeDependencyTests-619800573 None] Deleted volume successfully. Nov 06 15:29:38 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a8febf4a-0abd-49eb-a2a6-5915461d4ac6 tempest-VolumeDependencyTests-619800573 None] Lock "cinder-49e6edfd-6223-43f6-ab78-78a114f0372d-delete_volume" released by "delete_volume" :: held 1.772s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:29:39 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ee6048c-beb9-42fb-a7f1-038573ed88a2 tempest-AttachVolumeTestJSON-1915243344 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:29:39 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6ee6048c-beb9-42fb-a7f1-038573ed88a2 tempest-AttachVolumeTestJSON-1915243344 None] Flow 'volume_create_manager' (49bc146f-3a95-4032-afb5-fa0451a3b0b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:29:39 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6ee6048c-beb9-42fb-a7f1-038573ed88a2 tempest-AttachVolumeTestJSON-1915243344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (558f591d-ca63-44c6-a3ca-bd7f3080c7f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:29:39 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6ee6048c-beb9-42fb-a7f1-038573ed88a2 tempest-AttachVolumeTestJSON-1915243344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (558f591d-ca63-44c6-a3ca-bd7f3080c7f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:29:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-450239928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66c0bf64-ea68-4f38-8875-29f34629c84e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df60c116e43e4612a2d71379e4f5f302',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:29:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:29:39Z,use_quota=True,user_id='4314c5201ae84b138adcec47db5e56fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:29:39 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6ee6048c-beb9-42fb-a7f1-038573ed88a2 tempest-AttachVolumeTestJSON-1915243344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8e69301-b172-4aba-b3f7-5d26ccab75ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:29:39 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6ee6048c-beb9-42fb-a7f1-038573ed88a2 tempest-AttachVolumeTestJSON-1915243344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8e69301-b172-4aba-b3f7-5d26ccab75ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:29:39 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6ee6048c-beb9-42fb-a7f1-038573ed88a2 tempest-AttachVolumeTestJSON-1915243344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06528b82-b1d3-4d46-85c0-7b009fc1d849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:29:39 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6ee6048c-beb9-42fb-a7f1-038573ed88a2 tempest-AttachVolumeTestJSON-1915243344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06528b82-b1d3-4d46-85c0-7b009fc1d849) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66c0bf64-ea68-4f38-8875-29f34629c84e', 'volume_name': 'volume-66c0bf64-ea68-4f38-8875-29f34629c84e', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:29:39 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6ee6048c-beb9-42fb-a7f1-038573ed88a2 tempest-AttachVolumeTestJSON-1915243344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28fd9c66-3f55-40ed-b638-630281d605ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:29:39 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6ee6048c-beb9-42fb-a7f1-038573ed88a2 tempest-AttachVolumeTestJSON-1915243344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28fd9c66-3f55-40ed-b638-630281d605ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:29:39 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6ee6048c-beb9-42fb-a7f1-038573ed88a2 tempest-AttachVolumeTestJSON-1915243344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (276b7d68-a430-4fa2-9117-a659604533f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:29:39 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-6ee6048c-beb9-42fb-a7f1-038573ed88a2 tempest-AttachVolumeTestJSON-1915243344 None] Volume 66c0bf64-ea68-4f38-8875-29f34629c84e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66c0bf64-ea68-4f38-8875-29f34629c84e', 'volume_size': 1} Nov 06 15:29:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6ee6048c-beb9-42fb-a7f1-038573ed88a2 tempest-AttachVolumeTestJSON-1915243344 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:29:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6ee6048c-beb9-42fb-a7f1-038573ed88a2 tempest-AttachVolumeTestJSON-1915243344 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:29:39 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-6ee6048c-beb9-42fb-a7f1-038573ed88a2 tempest-AttachVolumeTestJSON-1915243344 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:29:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-450239928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66c0bf64-ea68-4f38-8875-29f34629c84e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df60c116e43e4612a2d71379e4f5f302',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:29:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:29:39Z,use_quota=True,user_id='4314c5201ae84b138adcec47db5e56fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:29:39 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-6ee6048c-beb9-42fb-a7f1-038573ed88a2 tempest-AttachVolumeTestJSON-1915243344 None] Creating volume 66c0bf64-ea68-4f38-8875-29f34629c84e {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:29:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6ee6048c-beb9-42fb-a7f1-038573ed88a2 tempest-AttachVolumeTestJSON-1915243344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:29:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6ee6048c-beb9-42fb-a7f1-038573ed88a2 tempest-AttachVolumeTestJSON-1915243344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:29:39 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-6ee6048c-beb9-42fb-a7f1-038573ed88a2 tempest-AttachVolumeTestJSON-1915243344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:29:39 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-6ee6048c-beb9-42fb-a7f1-038573ed88a2 tempest-AttachVolumeTestJSON-1915243344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:29:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6ee6048c-beb9-42fb-a7f1-038573ed88a2 tempest-AttachVolumeTestJSON-1915243344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:29:39 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-6ee6048c-beb9-42fb-a7f1-038573ed88a2 tempest-AttachVolumeTestJSON-1915243344 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:29:39 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-6ee6048c-beb9-42fb-a7f1-038573ed88a2 tempest-AttachVolumeTestJSON-1915243344 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:29:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6ee6048c-beb9-42fb-a7f1-038573ed88a2 tempest-AttachVolumeTestJSON-1915243344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-66c0bf64-ea68-4f38-8875-29f34629c84e 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:29:39 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6a51b187-5b1d-486d-bd95-01da3254afa4 tempest-VolumeDependencyTests-619800573 None] Acquiring lock "cinder-d0814099-27b3-40f6-98a1-de6efe46ec93-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:29:39 devstack sudo[100640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-66c0bf64-ea68-4f38-8875-29f34629c84e 1073741824 Nov 06 15:29:39 devstack sudo[100640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:29:39 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6a51b187-5b1d-486d-bd95-01da3254afa4 tempest-VolumeDependencyTests-619800573 None] Lock "cinder-d0814099-27b3-40f6-98a1-de6efe46ec93-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:29:39 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6a51b187-5b1d-486d-bd95-01da3254afa4 tempest-VolumeDependencyTests-619800573 None] Acquiring lock "cinder-quobyte-d0814099-27b3-40f6-98a1-de6efe46ec93" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:29:39 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6a51b187-5b1d-486d-bd95-01da3254afa4 tempest-VolumeDependencyTests-619800573 None] Lock "cinder-quobyte-d0814099-27b3-40f6-98a1-de6efe46ec93" acquired by "delete_volume" :: waited 0.024s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:29:39 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[576c9e3c-5a41-4e7c-b607-6670216c6d34]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:29:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6a51b187-5b1d-486d-bd95-01da3254afa4 tempest-VolumeDependencyTests-619800573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d0814099-27b3-40f6-98a1-de6efe46ec93 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:29:39 devstack sudo[100643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d0814099-27b3-40f6-98a1-de6efe46ec93 Nov 06 15:29:39 devstack sudo[100643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:29:40 devstack sudo[100640]: pam_unix(sudo:session): session closed for user root Nov 06 15:29:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6ee6048c-beb9-42fb-a7f1-038573ed88a2 tempest-AttachVolumeTestJSON-1915243344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-66c0bf64-ea68-4f38-8875-29f34629c84e 1073741824" returned: 0 in 0.631s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:29:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6ee6048c-beb9-42fb-a7f1-038573ed88a2 tempest-AttachVolumeTestJSON-1915243344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-66c0bf64-ea68-4f38-8875-29f34629c84e {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:29:40 devstack sudo[100643]: pam_unix(sudo:session): session closed for user root Nov 06 15:29:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6a51b187-5b1d-486d-bd95-01da3254afa4 tempest-VolumeDependencyTests-619800573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d0814099-27b3-40f6-98a1-de6efe46ec93" returned: 0 in 0.516s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:29:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6a51b187-5b1d-486d-bd95-01da3254afa4 tempest-VolumeDependencyTests-619800573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d0814099-27b3-40f6-98a1-de6efe46ec93 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:29:40 devstack sudo[100652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-66c0bf64-ea68-4f38-8875-29f34629c84e Nov 06 15:29:40 devstack sudo[100652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:29:40 devstack sudo[100653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d0814099-27b3-40f6-98a1-de6efe46ec93 Nov 06 15:29:40 devstack sudo[100653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:29:40 devstack sudo[100653]: pam_unix(sudo:session): session closed for user root Nov 06 15:29:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6a51b187-5b1d-486d-bd95-01da3254afa4 tempest-VolumeDependencyTests-619800573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d0814099-27b3-40f6-98a1-de6efe46ec93" returned: 0 in 0.298s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:29:40 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6a51b187-5b1d-486d-bd95-01da3254afa4 tempest-VolumeDependencyTests-619800573 None] Lock "cinder-quobyte-d0814099-27b3-40f6-98a1-de6efe46ec93" released by "delete_volume" :: held 0.902s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:29:40 devstack sudo[100652]: pam_unix(sudo:session): session closed for user root Nov 06 15:29:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6ee6048c-beb9-42fb-a7f1-038573ed88a2 tempest-AttachVolumeTestJSON-1915243344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-66c0bf64-ea68-4f38-8875-29f34629c84e" returned: 0 in 0.387s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:29:40 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-6ee6048c-beb9-42fb-a7f1-038573ed88a2 tempest-AttachVolumeTestJSON-1915243344 None] <== create_volume: return (1091ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:29:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6ee6048c-beb9-42fb-a7f1-038573ed88a2 tempest-AttachVolumeTestJSON-1915243344 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.095s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:29:40 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6ee6048c-beb9-42fb-a7f1-038573ed88a2 tempest-AttachVolumeTestJSON-1915243344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (276b7d68-a430-4fa2-9117-a659604533f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66c0bf64-ea68-4f38-8875-29f34629c84e', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:29:40 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6ee6048c-beb9-42fb-a7f1-038573ed88a2 tempest-AttachVolumeTestJSON-1915243344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e233b70-7f26-4c83-80d8-07018b0f2473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:29:40 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-6ee6048c-beb9-42fb-a7f1-038573ed88a2 tempest-AttachVolumeTestJSON-1915243344 None] Volume volume-66c0bf64-ea68-4f38-8875-29f34629c84e (66c0bf64-ea68-4f38-8875-29f34629c84e): created successfully Nov 06 15:29:40 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6ee6048c-beb9-42fb-a7f1-038573ed88a2 tempest-AttachVolumeTestJSON-1915243344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e233b70-7f26-4c83-80d8-07018b0f2473) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:29:40 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6ee6048c-beb9-42fb-a7f1-038573ed88a2 tempest-AttachVolumeTestJSON-1915243344 None] Flow 'volume_create_manager' (49bc146f-3a95-4032-afb5-fa0451a3b0b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:29:40 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-6ee6048c-beb9-42fb-a7f1-038573ed88a2 tempest-AttachVolumeTestJSON-1915243344 None] Created volume successfully. Nov 06 15:29:40 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-6a51b187-5b1d-486d-bd95-01da3254afa4 tempest-VolumeDependencyTests-619800573 None] Created reservations ['bf01af39-b2be-40b3-abc4-2ed9bde62d94', '34256928-430e-4084-b727-a20df7875cb7', '68670bf6-7ada-4591-b629-761fb23b0ccb', '66f42045-4e2e-409c-a214-273087c235d9'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:29:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6a51b187-5b1d-486d-bd95-01da3254afa4 tempest-VolumeDependencyTests-619800573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:29:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6a51b187-5b1d-486d-bd95-01da3254afa4 tempest-VolumeDependencyTests-619800573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:29:40 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-6a51b187-5b1d-486d-bd95-01da3254afa4 tempest-VolumeDependencyTests-619800573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:29:40 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-6a51b187-5b1d-486d-bd95-01da3254afa4 tempest-VolumeDependencyTests-619800573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:29:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6a51b187-5b1d-486d-bd95-01da3254afa4 tempest-VolumeDependencyTests-619800573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:29:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6a51b187-5b1d-486d-bd95-01da3254afa4 tempest-VolumeDependencyTests-619800573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:29:40 devstack sudo[100658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:29:40 devstack sudo[100658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:29:40 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-315a55a8-dbd2-4d5e-96f5-92b534450519 tempest-VolumesListTestJSON-937097860 None] Acquiring lock "cinder-4449c1ce-eb3b-40bf-8e8e-a50271a715a1-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:29:40 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-315a55a8-dbd2-4d5e-96f5-92b534450519 tempest-VolumesListTestJSON-937097860 None] Lock "cinder-4449c1ce-eb3b-40bf-8e8e-a50271a715a1-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:29:40 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-315a55a8-dbd2-4d5e-96f5-92b534450519 tempest-VolumesListTestJSON-937097860 None] Acquiring lock "cinder-quobyte-4449c1ce-eb3b-40bf-8e8e-a50271a715a1" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:29:40 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-315a55a8-dbd2-4d5e-96f5-92b534450519 tempest-VolumesListTestJSON-937097860 None] Lock "cinder-quobyte-4449c1ce-eb3b-40bf-8e8e-a50271a715a1" acquired by "delete_volume" :: waited 0.016s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:29:40 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[02c94046-066f-4888-aa86-ab4448fa9e0e]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:29:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-315a55a8-dbd2-4d5e-96f5-92b534450519 tempest-VolumesListTestJSON-937097860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-4449c1ce-eb3b-40bf-8e8e-a50271a715a1 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:29:40 devstack sudo[100658]: pam_unix(sudo:session): session closed for user root Nov 06 15:29:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6a51b187-5b1d-486d-bd95-01da3254afa4 tempest-VolumeDependencyTests-619800573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.327s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:29:41 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-6a51b187-5b1d-486d-bd95-01da3254afa4 tempest-VolumeDependencyTests-619800573 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:29:41 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-6a51b187-5b1d-486d-bd95-01da3254afa4 tempest-VolumeDependencyTests-619800573 None] Deleted volume successfully. Nov 06 15:29:41 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6a51b187-5b1d-486d-bd95-01da3254afa4 tempest-VolumeDependencyTests-619800573 None] Lock "cinder-d0814099-27b3-40f6-98a1-de6efe46ec93-delete_volume" released by "delete_volume" :: held 1.591s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:29:41 devstack sudo[100660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-4449c1ce-eb3b-40bf-8e8e-a50271a715a1 Nov 06 15:29:41 devstack sudo[100660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:29:41 devstack sudo[100660]: pam_unix(sudo:session): session closed for user root Nov 06 15:29:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-315a55a8-dbd2-4d5e-96f5-92b534450519 tempest-VolumesListTestJSON-937097860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-4449c1ce-eb3b-40bf-8e8e-a50271a715a1" returned: 0 in 0.436s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:29:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-315a55a8-dbd2-4d5e-96f5-92b534450519 tempest-VolumesListTestJSON-937097860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-4449c1ce-eb3b-40bf-8e8e-a50271a715a1 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:29:41 devstack sudo[100668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-4449c1ce-eb3b-40bf-8e8e-a50271a715a1 Nov 06 15:29:41 devstack sudo[100668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:29:41 devstack sudo[100668]: pam_unix(sudo:session): session closed for user root Nov 06 15:29:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-315a55a8-dbd2-4d5e-96f5-92b534450519 tempest-VolumesListTestJSON-937097860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-4449c1ce-eb3b-40bf-8e8e-a50271a715a1" returned: 0 in 0.362s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:29:41 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-315a55a8-dbd2-4d5e-96f5-92b534450519 tempest-VolumesListTestJSON-937097860 None] Lock "cinder-quobyte-4449c1ce-eb3b-40bf-8e8e-a50271a715a1" released by "delete_volume" :: held 0.858s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:29:41 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-315a55a8-dbd2-4d5e-96f5-92b534450519 tempest-VolumesListTestJSON-937097860 None] Created reservations ['d7f84150-842b-4593-9ec3-1f11b64c94b9', '0518e0de-591f-4eb6-8ce7-15330e2a45d8', 'e97dfb62-1679-4779-aa83-9f4a7c929bae', '5dcbd7e9-0b04-4511-9793-5081ef13d2f6'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:29:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-315a55a8-dbd2-4d5e-96f5-92b534450519 tempest-VolumesListTestJSON-937097860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:29:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-315a55a8-dbd2-4d5e-96f5-92b534450519 tempest-VolumesListTestJSON-937097860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:29:41 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-315a55a8-dbd2-4d5e-96f5-92b534450519 tempest-VolumesListTestJSON-937097860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:29:41 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-315a55a8-dbd2-4d5e-96f5-92b534450519 tempest-VolumesListTestJSON-937097860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:29:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-315a55a8-dbd2-4d5e-96f5-92b534450519 tempest-VolumesListTestJSON-937097860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:29:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-315a55a8-dbd2-4d5e-96f5-92b534450519 tempest-VolumesListTestJSON-937097860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:29:41 devstack sudo[100672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:29:41 devstack sudo[100672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:29:42 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-ad308ee1-3fe7-420f-933a-cf2bf1586597 tempest-VolumesListTestJSON-937097860 None] Acquiring lock "cinder-38310655-1cce-406b-b1b9-b76d2727df75-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:29:42 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-ad308ee1-3fe7-420f-933a-cf2bf1586597 tempest-VolumesListTestJSON-937097860 None] Lock "cinder-38310655-1cce-406b-b1b9-b76d2727df75-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:29:42 devstack sudo[100672]: pam_unix(sudo:session): session closed for user root Nov 06 15:29:42 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-ad308ee1-3fe7-420f-933a-cf2bf1586597 tempest-VolumesListTestJSON-937097860 None] Acquiring lock "cinder-quobyte-38310655-1cce-406b-b1b9-b76d2727df75" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:29:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-315a55a8-dbd2-4d5e-96f5-92b534450519 tempest-VolumesListTestJSON-937097860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.326s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:29:42 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-315a55a8-dbd2-4d5e-96f5-92b534450519 tempest-VolumesListTestJSON-937097860 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:29:42 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-315a55a8-dbd2-4d5e-96f5-92b534450519 tempest-VolumesListTestJSON-937097860 None] Deleted volume successfully. Nov 06 15:29:42 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-ad308ee1-3fe7-420f-933a-cf2bf1586597 tempest-VolumesListTestJSON-937097860 None] Lock "cinder-quobyte-38310655-1cce-406b-b1b9-b76d2727df75" acquired by "delete_volume" :: waited 0.030s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:29:42 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-315a55a8-dbd2-4d5e-96f5-92b534450519 tempest-VolumesListTestJSON-937097860 None] Lock "cinder-4449c1ce-eb3b-40bf-8e8e-a50271a715a1-delete_volume" released by "delete_volume" :: held 1.550s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:29:42 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dc6364e-24d1-415e-8460-c7b7e5f74b2b]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:29:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ad308ee1-3fe7-420f-933a-cf2bf1586597 tempest-VolumesListTestJSON-937097860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-38310655-1cce-406b-b1b9-b76d2727df75 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:29:42 devstack sudo[100680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-38310655-1cce-406b-b1b9-b76d2727df75 Nov 06 15:29:42 devstack sudo[100680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:29:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-78d00f33-4bc7-4478-a6bc-0d8d58920f7d req-aac5eea8-7758-4f6b-8e52-975a4625b921 tempest-AttachVolumeTestJSON-1915243344 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:29:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-78d00f33-4bc7-4478-a6bc-0d8d58920f7d req-aac5eea8-7758-4f6b-8e52-975a4625b921 tempest-AttachVolumeTestJSON-1915243344 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:29:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-78d00f33-4bc7-4478-a6bc-0d8d58920f7d req-aac5eea8-7758-4f6b-8e52-975a4625b921 tempest-AttachVolumeTestJSON-1915243344 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:29:42 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-78d00f33-4bc7-4478-a6bc-0d8d58920f7d req-aac5eea8-7758-4f6b-8e52-975a4625b921 tempest-AttachVolumeTestJSON-1915243344 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b', 'name': 'volume-66c0bf64-ea68-4f38-8875-29f34629c84e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6a448494-0bcf-4eeb-9e42-99a80721742a', 'enforce_multipath': True} {{(pid=87132) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 15:29:42 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-78d00f33-4bc7-4478-a6bc-0d8d58920f7d req-aac5eea8-7758-4f6b-8e52-975a4625b921 tempest-AttachVolumeTestJSON-1915243344 None] attachment_update completed successfully. Nov 06 15:29:42 devstack sudo[100680]: pam_unix(sudo:session): session closed for user root Nov 06 15:29:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ad308ee1-3fe7-420f-933a-cf2bf1586597 tempest-VolumesListTestJSON-937097860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-38310655-1cce-406b-b1b9-b76d2727df75" returned: 0 in 0.576s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:29:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ad308ee1-3fe7-420f-933a-cf2bf1586597 tempest-VolumesListTestJSON-937097860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-38310655-1cce-406b-b1b9-b76d2727df75 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:29:42 devstack sudo[100691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-38310655-1cce-406b-b1b9-b76d2727df75 Nov 06 15:29:42 devstack sudo[100691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:29:43 devstack sudo[100691]: pam_unix(sudo:session): session closed for user root Nov 06 15:29:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ad308ee1-3fe7-420f-933a-cf2bf1586597 tempest-VolumesListTestJSON-937097860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-38310655-1cce-406b-b1b9-b76d2727df75" returned: 0 in 0.416s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:29:43 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-ad308ee1-3fe7-420f-933a-cf2bf1586597 tempest-VolumesListTestJSON-937097860 None] Lock "cinder-quobyte-38310655-1cce-406b-b1b9-b76d2727df75" released by "delete_volume" :: held 1.078s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:29:43 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-ad308ee1-3fe7-420f-933a-cf2bf1586597 tempest-VolumesListTestJSON-937097860 None] Created reservations ['800a055d-cf5a-4520-b722-03291cc65ca7', '3f607750-f0b3-44a4-9a2d-5b372da3674a', '4419f448-7f2d-4341-8f01-46311ac34919', 'c137cfe9-559a-4f5b-8840-988b1858a3a4'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:29:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ad308ee1-3fe7-420f-933a-cf2bf1586597 tempest-VolumesListTestJSON-937097860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:29:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ad308ee1-3fe7-420f-933a-cf2bf1586597 tempest-VolumesListTestJSON-937097860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:29:43 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-ad308ee1-3fe7-420f-933a-cf2bf1586597 tempest-VolumesListTestJSON-937097860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:29:43 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-ad308ee1-3fe7-420f-933a-cf2bf1586597 tempest-VolumesListTestJSON-937097860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:29:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ad308ee1-3fe7-420f-933a-cf2bf1586597 tempest-VolumesListTestJSON-937097860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:29:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ad308ee1-3fe7-420f-933a-cf2bf1586597 tempest-VolumesListTestJSON-937097860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:29:43 devstack sudo[100695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:29:43 devstack sudo[100695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:29:43 devstack sudo[100695]: pam_unix(sudo:session): session closed for user root Nov 06 15:29:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ad308ee1-3fe7-420f-933a-cf2bf1586597 tempest-VolumesListTestJSON-937097860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.291s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:29:43 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-ad308ee1-3fe7-420f-933a-cf2bf1586597 tempest-VolumesListTestJSON-937097860 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:29:43 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-ad308ee1-3fe7-420f-933a-cf2bf1586597 tempest-VolumesListTestJSON-937097860 None] Deleted volume successfully. Nov 06 15:29:43 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-ad308ee1-3fe7-420f-933a-cf2bf1586597 tempest-VolumesListTestJSON-937097860 None] Lock "cinder-38310655-1cce-406b-b1b9-b76d2727df75-delete_volume" released by "delete_volume" :: held 1.702s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:29:44 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-36f8e764-fa1c-4900-8088-ff09a8222ac3 tempest-VolumesListTestJSON-937097860 None] Acquiring lock "cinder-e6c1e146-d851-4f8b-8a5d-215b3d8df5a8-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:29:44 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-36f8e764-fa1c-4900-8088-ff09a8222ac3 tempest-VolumesListTestJSON-937097860 None] Lock "cinder-e6c1e146-d851-4f8b-8a5d-215b3d8df5a8-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:29:44 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-36f8e764-fa1c-4900-8088-ff09a8222ac3 tempest-VolumesListTestJSON-937097860 None] Acquiring lock "cinder-quobyte-e6c1e146-d851-4f8b-8a5d-215b3d8df5a8" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:29:44 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-36f8e764-fa1c-4900-8088-ff09a8222ac3 tempest-VolumesListTestJSON-937097860 None] Lock "cinder-quobyte-e6c1e146-d851-4f8b-8a5d-215b3d8df5a8" acquired by "delete_volume" :: waited 0.034s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:29:44 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[0411ac50-17bb-4ef4-981e-f62408fa8b2d]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:29:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-36f8e764-fa1c-4900-8088-ff09a8222ac3 tempest-VolumesListTestJSON-937097860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-e6c1e146-d851-4f8b-8a5d-215b3d8df5a8 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:29:44 devstack sudo[100700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-e6c1e146-d851-4f8b-8a5d-215b3d8df5a8 Nov 06 15:29:44 devstack sudo[100700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:29:45 devstack sudo[100700]: pam_unix(sudo:session): session closed for user root Nov 06 15:29:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-36f8e764-fa1c-4900-8088-ff09a8222ac3 tempest-VolumesListTestJSON-937097860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-e6c1e146-d851-4f8b-8a5d-215b3d8df5a8" returned: 0 in 0.502s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:29:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-36f8e764-fa1c-4900-8088-ff09a8222ac3 tempest-VolumesListTestJSON-937097860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-e6c1e146-d851-4f8b-8a5d-215b3d8df5a8 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:29:45 devstack sudo[100705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-e6c1e146-d851-4f8b-8a5d-215b3d8df5a8 Nov 06 15:29:45 devstack sudo[100705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:29:45 devstack sudo[100705]: pam_unix(sudo:session): session closed for user root Nov 06 15:29:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-36f8e764-fa1c-4900-8088-ff09a8222ac3 tempest-VolumesListTestJSON-937097860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-e6c1e146-d851-4f8b-8a5d-215b3d8df5a8" returned: 0 in 0.290s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:29:45 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-69c74592-9d18-4dd9-9eac-0f016153ad65 req-05bf9588-af22-4806-aa73-a27c18b10121 tempest-AttachVolumeTestJSON-1915243344 None] Terminate volume connection completed successfully. Nov 06 15:29:45 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-69c74592-9d18-4dd9-9eac-0f016153ad65 req-05bf9588-af22-4806-aa73-a27c18b10121 tempest-AttachVolumeTestJSON-1915243344 None] Deleting attachment e43d180c-b114-4ccd-8f28-1ddff403cf1e. {{(pid=87132) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 06 15:29:45 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-36f8e764-fa1c-4900-8088-ff09a8222ac3 tempest-VolumesListTestJSON-937097860 None] Lock "cinder-quobyte-e6c1e146-d851-4f8b-8a5d-215b3d8df5a8" released by "delete_volume" :: held 0.872s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:29:45 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-36f8e764-fa1c-4900-8088-ff09a8222ac3 tempest-VolumesListTestJSON-937097860 None] Created reservations ['589dac1c-67e7-48a6-b8e7-90d9fded9604', '7508dc84-6ad6-40ad-8f82-c4612abe2f54', 'ebdd9864-7af4-4ca9-9db3-c84e36f025cf', 'b1cfc998-257f-4e7d-af6e-1695a6d35581'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:29:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-36f8e764-fa1c-4900-8088-ff09a8222ac3 tempest-VolumesListTestJSON-937097860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:29:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-36f8e764-fa1c-4900-8088-ff09a8222ac3 tempest-VolumesListTestJSON-937097860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:29:45 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-36f8e764-fa1c-4900-8088-ff09a8222ac3 tempest-VolumesListTestJSON-937097860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:29:45 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-36f8e764-fa1c-4900-8088-ff09a8222ac3 tempest-VolumesListTestJSON-937097860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:29:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-36f8e764-fa1c-4900-8088-ff09a8222ac3 tempest-VolumesListTestJSON-937097860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:29:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-36f8e764-fa1c-4900-8088-ff09a8222ac3 tempest-VolumesListTestJSON-937097860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:29:45 devstack sudo[100711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:29:45 devstack sudo[100711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:29:46 devstack sudo[100711]: pam_unix(sudo:session): session closed for user root Nov 06 15:29:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-36f8e764-fa1c-4900-8088-ff09a8222ac3 tempest-VolumesListTestJSON-937097860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.485s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:29:46 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-36f8e764-fa1c-4900-8088-ff09a8222ac3 tempest-VolumesListTestJSON-937097860 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:29:46 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-36f8e764-fa1c-4900-8088-ff09a8222ac3 tempest-VolumesListTestJSON-937097860 None] Deleted volume successfully. Nov 06 15:29:46 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-36f8e764-fa1c-4900-8088-ff09a8222ac3 tempest-VolumesListTestJSON-937097860 None] Lock "cinder-e6c1e146-d851-4f8b-8a5d-215b3d8df5a8-delete_volume" released by "delete_volume" :: held 1.668s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:29:47 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:SELECT=138,cinder:UPDATE=183,cinder:INSERT=38,cinder:DELETE=14 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 15:29:47 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:SELECT=136,cinder:UPDATE=178,cinder:INSERT=46,cinder:DELETE=17 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 15:29:47 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-352dcccd-c436-4d74-8226-e6c1b25e8597 req-d1dccae4-91b6-4d53-bd60-44e2b6962a4d tempest-AttachVolumeTestJSON-1915243344 None] Terminate volume connection completed successfully. Nov 06 15:29:47 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-352dcccd-c436-4d74-8226-e6c1b25e8597 req-d1dccae4-91b6-4d53-bd60-44e2b6962a4d tempest-AttachVolumeTestJSON-1915243344 None] Deleting attachment 6a448494-0bcf-4eeb-9e42-99a80721742a. {{(pid=87132) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 06 15:29:53 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-ccc034e7-fea9-48fc-ae17-06300a9373da tempest-AttachVolumeTestJSON-1915243344 None] Acquiring lock "cinder-66c0bf64-ea68-4f38-8875-29f34629c84e-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:29:53 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-ccc034e7-fea9-48fc-ae17-06300a9373da tempest-AttachVolumeTestJSON-1915243344 None] Lock "cinder-66c0bf64-ea68-4f38-8875-29f34629c84e-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:29:53 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-ccc034e7-fea9-48fc-ae17-06300a9373da tempest-AttachVolumeTestJSON-1915243344 None] Acquiring lock "cinder-quobyte-66c0bf64-ea68-4f38-8875-29f34629c84e" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:29:53 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-ccc034e7-fea9-48fc-ae17-06300a9373da tempest-AttachVolumeTestJSON-1915243344 None] Lock "cinder-quobyte-66c0bf64-ea68-4f38-8875-29f34629c84e" acquired by "delete_volume" :: waited 0.026s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:29:53 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1e2fb03-08cc-4ac1-aa02-e7ccd1130777]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:29:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ccc034e7-fea9-48fc-ae17-06300a9373da tempest-AttachVolumeTestJSON-1915243344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-66c0bf64-ea68-4f38-8875-29f34629c84e {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:29:53 devstack sudo[100770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-66c0bf64-ea68-4f38-8875-29f34629c84e Nov 06 15:29:53 devstack sudo[100770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:29:54 devstack sudo[100770]: pam_unix(sudo:session): session closed for user root Nov 06 15:29:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ccc034e7-fea9-48fc-ae17-06300a9373da tempest-AttachVolumeTestJSON-1915243344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-66c0bf64-ea68-4f38-8875-29f34629c84e" returned: 0 in 0.409s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:29:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ccc034e7-fea9-48fc-ae17-06300a9373da tempest-AttachVolumeTestJSON-1915243344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-66c0bf64-ea68-4f38-8875-29f34629c84e {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:29:54 devstack sudo[100775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-66c0bf64-ea68-4f38-8875-29f34629c84e Nov 06 15:29:54 devstack sudo[100775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:29:54 devstack sudo[100775]: pam_unix(sudo:session): session closed for user root Nov 06 15:29:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ccc034e7-fea9-48fc-ae17-06300a9373da tempest-AttachVolumeTestJSON-1915243344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-66c0bf64-ea68-4f38-8875-29f34629c84e" returned: 0 in 0.331s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:29:54 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-ccc034e7-fea9-48fc-ae17-06300a9373da tempest-AttachVolumeTestJSON-1915243344 None] Lock "cinder-quobyte-66c0bf64-ea68-4f38-8875-29f34629c84e" released by "delete_volume" :: held 0.812s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:29:54 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-ccc034e7-fea9-48fc-ae17-06300a9373da tempest-AttachVolumeTestJSON-1915243344 None] Created reservations ['7fbfde7b-3ce2-4a59-8af9-e2c01ed13bd9', '4a2c2bb9-9990-483b-8859-411c53289e5b', 'd0b33b67-99b5-4193-aaf3-f75be81e6f85', '403b05ac-e4a2-4ae2-9063-a3ccebd4fd82'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:29:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ccc034e7-fea9-48fc-ae17-06300a9373da tempest-AttachVolumeTestJSON-1915243344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:29:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ccc034e7-fea9-48fc-ae17-06300a9373da tempest-AttachVolumeTestJSON-1915243344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:29:54 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-ccc034e7-fea9-48fc-ae17-06300a9373da tempest-AttachVolumeTestJSON-1915243344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:29:54 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-ccc034e7-fea9-48fc-ae17-06300a9373da tempest-AttachVolumeTestJSON-1915243344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:29:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ccc034e7-fea9-48fc-ae17-06300a9373da tempest-AttachVolumeTestJSON-1915243344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:29:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ccc034e7-fea9-48fc-ae17-06300a9373da tempest-AttachVolumeTestJSON-1915243344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:29:54 devstack sudo[100778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:29:54 devstack sudo[100778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:29:54 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-87b214e8-364e-4b6b-966e-e2af24724514 tempest-AttachVolumeTestJSON-1915243344 None] Acquiring lock "cinder-70c403ec-d483-495c-a303-68873958faa4-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:29:54 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-87b214e8-364e-4b6b-966e-e2af24724514 tempest-AttachVolumeTestJSON-1915243344 None] Lock "cinder-70c403ec-d483-495c-a303-68873958faa4-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:29:55 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-87b214e8-364e-4b6b-966e-e2af24724514 tempest-AttachVolumeTestJSON-1915243344 None] Acquiring lock "cinder-quobyte-70c403ec-d483-495c-a303-68873958faa4" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:29:55 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-87b214e8-364e-4b6b-966e-e2af24724514 tempest-AttachVolumeTestJSON-1915243344 None] Lock "cinder-quobyte-70c403ec-d483-495c-a303-68873958faa4" acquired by "delete_volume" :: waited 0.022s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:29:55 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[cab7317d-15c3-4541-8628-1f70b9acf496]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:29:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-87b214e8-364e-4b6b-966e-e2af24724514 tempest-AttachVolumeTestJSON-1915243344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-70c403ec-d483-495c-a303-68873958faa4 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:29:55 devstack sudo[100778]: pam_unix(sudo:session): session closed for user root Nov 06 15:29:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ccc034e7-fea9-48fc-ae17-06300a9373da tempest-AttachVolumeTestJSON-1915243344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.364s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:29:55 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-ccc034e7-fea9-48fc-ae17-06300a9373da tempest-AttachVolumeTestJSON-1915243344 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:29:55 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-ccc034e7-fea9-48fc-ae17-06300a9373da tempest-AttachVolumeTestJSON-1915243344 None] Deleted volume successfully. Nov 06 15:29:55 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-ccc034e7-fea9-48fc-ae17-06300a9373da tempest-AttachVolumeTestJSON-1915243344 None] Lock "cinder-66c0bf64-ea68-4f38-8875-29f34629c84e-delete_volume" released by "delete_volume" :: held 1.476s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:29:55 devstack sudo[100781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-70c403ec-d483-495c-a303-68873958faa4 Nov 06 15:29:55 devstack sudo[100781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:29:55 devstack sudo[100781]: pam_unix(sudo:session): session closed for user root Nov 06 15:29:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-87b214e8-364e-4b6b-966e-e2af24724514 tempest-AttachVolumeTestJSON-1915243344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-70c403ec-d483-495c-a303-68873958faa4" returned: 0 in 0.502s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:29:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-87b214e8-364e-4b6b-966e-e2af24724514 tempest-AttachVolumeTestJSON-1915243344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-70c403ec-d483-495c-a303-68873958faa4 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:29:55 devstack sudo[100788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-70c403ec-d483-495c-a303-68873958faa4 Nov 06 15:29:55 devstack sudo[100788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:29:55 devstack sudo[100788]: pam_unix(sudo:session): session closed for user root Nov 06 15:29:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-87b214e8-364e-4b6b-966e-e2af24724514 tempest-AttachVolumeTestJSON-1915243344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-70c403ec-d483-495c-a303-68873958faa4" returned: 0 in 0.365s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:29:55 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-87b214e8-364e-4b6b-966e-e2af24724514 tempest-AttachVolumeTestJSON-1915243344 None] Lock "cinder-quobyte-70c403ec-d483-495c-a303-68873958faa4" released by "delete_volume" :: held 0.944s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:29:56 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-87b214e8-364e-4b6b-966e-e2af24724514 tempest-AttachVolumeTestJSON-1915243344 None] Created reservations ['45db76db-59b6-4cd1-a578-5ecd6eb58b30', '5e05bcd7-3864-401e-9200-7956a1ed251c', '3539c574-f7e3-4de4-8d70-5475587951b6', 'e582109c-1f7f-4868-b47d-dde46304209c'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:29:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-87b214e8-364e-4b6b-966e-e2af24724514 tempest-AttachVolumeTestJSON-1915243344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:29:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-87b214e8-364e-4b6b-966e-e2af24724514 tempest-AttachVolumeTestJSON-1915243344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:29:56 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-87b214e8-364e-4b6b-966e-e2af24724514 tempest-AttachVolumeTestJSON-1915243344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:29:56 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-87b214e8-364e-4b6b-966e-e2af24724514 tempest-AttachVolumeTestJSON-1915243344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:29:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-87b214e8-364e-4b6b-966e-e2af24724514 tempest-AttachVolumeTestJSON-1915243344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:29:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-87b214e8-364e-4b6b-966e-e2af24724514 tempest-AttachVolumeTestJSON-1915243344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:29:56 devstack sudo[100791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:29:56 devstack sudo[100791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:29:56 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a9023890-797b-4266-a559-34cf4c303fd3 tempest-AttachVolumeTestJSON-1915243344 None] Acquiring lock "cinder-ff32d504-636c-4127-99ea-aa659321c724-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:29:56 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a9023890-797b-4266-a559-34cf4c303fd3 tempest-AttachVolumeTestJSON-1915243344 None] Lock "cinder-ff32d504-636c-4127-99ea-aa659321c724-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:29:56 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a9023890-797b-4266-a559-34cf4c303fd3 tempest-AttachVolumeTestJSON-1915243344 None] Acquiring lock "cinder-quobyte-ff32d504-636c-4127-99ea-aa659321c724" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:29:56 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a9023890-797b-4266-a559-34cf4c303fd3 tempest-AttachVolumeTestJSON-1915243344 None] Lock "cinder-quobyte-ff32d504-636c-4127-99ea-aa659321c724" acquired by "delete_volume" :: waited 0.026s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:29:56 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e1fecd7-b558-4d34-83dd-a37b40e86ddb]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:29:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a9023890-797b-4266-a559-34cf4c303fd3 tempest-AttachVolumeTestJSON-1915243344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ff32d504-636c-4127-99ea-aa659321c724 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:29:56 devstack sudo[100791]: pam_unix(sudo:session): session closed for user root Nov 06 15:29:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-87b214e8-364e-4b6b-966e-e2af24724514 tempest-AttachVolumeTestJSON-1915243344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.506s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:29:56 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-87b214e8-364e-4b6b-966e-e2af24724514 tempest-AttachVolumeTestJSON-1915243344 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:29:56 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-87b214e8-364e-4b6b-966e-e2af24724514 tempest-AttachVolumeTestJSON-1915243344 None] Deleted volume successfully. Nov 06 15:29:56 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-87b214e8-364e-4b6b-966e-e2af24724514 tempest-AttachVolumeTestJSON-1915243344 None] Lock "cinder-70c403ec-d483-495c-a303-68873958faa4-delete_volume" released by "delete_volume" :: held 1.762s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:29:56 devstack sudo[100802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ff32d504-636c-4127-99ea-aa659321c724 Nov 06 15:29:56 devstack sudo[100802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:29:57 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ea8dc6a-ec10-4279-83a4-cc9395a6fde9 tempest-VolumeAndVolumeTypeFromImageTest-726003660 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:29:57 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0ea8dc6a-ec10-4279-83a4-cc9395a6fde9 tempest-VolumeAndVolumeTypeFromImageTest-726003660 None] Flow 'volume_create_manager' (571c0998-1e5e-484d-b6a4-384931f4d2e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:29:57 devstack sudo[100802]: pam_unix(sudo:session): session closed for user root Nov 06 15:29:57 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0ea8dc6a-ec10-4279-83a4-cc9395a6fde9 tempest-VolumeAndVolumeTypeFromImageTest-726003660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8ed962a-1f43-46df-9e92-b972bf1f93e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:29:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a9023890-797b-4266-a559-34cf4c303fd3 tempest-AttachVolumeTestJSON-1915243344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ff32d504-636c-4127-99ea-aa659321c724" returned: 0 in 0.472s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:29:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a9023890-797b-4266-a559-34cf4c303fd3 tempest-AttachVolumeTestJSON-1915243344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ff32d504-636c-4127-99ea-aa659321c724 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:29:57 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0ea8dc6a-ec10-4279-83a4-cc9395a6fde9 tempest-VolumeAndVolumeTypeFromImageTest-726003660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8ed962a-1f43-46df-9e92-b972bf1f93e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:29:57Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d61beb52-89e9-4a92-922f-ee3a97c4326b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0294f3ca0e1a4195a043abbf04dd3833',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:29:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:29:57Z,use_quota=True,user_id='021ab21ff6004b31b85cdc1182caf3fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cf6064fc-972e-4907-99ec-0d6df1c4ceb0),volume_type_id=cf6064fc-972e-4907-99ec-0d6df1c4ceb0)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:29:57 devstack sudo[100833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ff32d504-636c-4127-99ea-aa659321c724 Nov 06 15:29:57 devstack sudo[100833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:29:57 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0ea8dc6a-ec10-4279-83a4-cc9395a6fde9 tempest-VolumeAndVolumeTypeFromImageTest-726003660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51c031c4-d8b4-46e7-a8e7-b2e2e8411a5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:29:57 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0ea8dc6a-ec10-4279-83a4-cc9395a6fde9 tempest-VolumeAndVolumeTypeFromImageTest-726003660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51c031c4-d8b4-46e7-a8e7-b2e2e8411a5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:29:57 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0ea8dc6a-ec10-4279-83a4-cc9395a6fde9 tempest-VolumeAndVolumeTypeFromImageTest-726003660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83644a34-6fa3-421a-af38-27f307c9f54c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:29:57 devstack cinder-volume[87132]: DEBUG cinder.image.glance [None req-0ea8dc6a-ec10-4279-83a4-cc9395a6fde9 tempest-VolumeAndVolumeTypeFromImageTest-726003660 None] Creating Keystone auth plugin from conf {{(pid=87132) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 06 15:29:57 devstack sudo[100833]: pam_unix(sudo:session): session closed for user root Nov 06 15:29:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a9023890-797b-4266-a559-34cf4c303fd3 tempest-AttachVolumeTestJSON-1915243344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ff32d504-636c-4127-99ea-aa659321c724" returned: 0 in 0.346s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:29:57 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a9023890-797b-4266-a559-34cf4c303fd3 tempest-AttachVolumeTestJSON-1915243344 None] Lock "cinder-quobyte-ff32d504-636c-4127-99ea-aa659321c724" released by "delete_volume" :: held 0.880s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:29:57 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-a9023890-797b-4266-a559-34cf4c303fd3 tempest-AttachVolumeTestJSON-1915243344 None] Created reservations ['7758def6-e36f-4c6c-9783-85f18c69691f', '0e88befa-6283-40fc-894a-e64bdac15e04', 'ccd43416-d9d1-45ca-b0a8-d00976b0efb1', 'd5195a05-6887-4f9f-99bf-ad6c3b50dc17'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:29:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a9023890-797b-4266-a559-34cf4c303fd3 tempest-AttachVolumeTestJSON-1915243344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:29:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a9023890-797b-4266-a559-34cf4c303fd3 tempest-AttachVolumeTestJSON-1915243344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:29:57 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-a9023890-797b-4266-a559-34cf4c303fd3 tempest-AttachVolumeTestJSON-1915243344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:29:57 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-a9023890-797b-4266-a559-34cf4c303fd3 tempest-AttachVolumeTestJSON-1915243344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:29:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a9023890-797b-4266-a559-34cf4c303fd3 tempest-AttachVolumeTestJSON-1915243344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:29:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a9023890-797b-4266-a559-34cf4c303fd3 tempest-AttachVolumeTestJSON-1915243344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:29:57 devstack sudo[100844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:29:57 devstack sudo[100844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:29:57 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0ea8dc6a-ec10-4279-83a4-cc9395a6fde9 tempest-VolumeAndVolumeTypeFromImageTest-726003660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83644a34-6fa3-421a-af38-27f307c9f54c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd61beb52-89e9-4a92-922f-ee3a97c4326b', 'volume_name': 'volume-d61beb52-89e9-4a92-922f-ee3a97c4326b', 'volume_size': 1, 'image_id': '6d72f228-0a9f-4663-88ec-6135d4de1ef5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6d72f228-0a9f-4663-88ec-6135d4de1ef5', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '56093ca632a04ec54b61d4e350daec2b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0294f3ca0e1a4195a043abbf04dd3833', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '152439551b3bf4bda19f3fe50180e10f58513b36ee69bfd28633861054eb710f9610d84ab0e6493f7dc582cb46d03e99afba34fb461e59e2aa2ca039a7c93b96', 'id': '6d72f228-0a9f-4663-88ec-6135d4de1ef5', 'created_at': datetime.datetime(2026, 11, 6, 14, 29, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 14, 29, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6d72f228-0a9f-4663-88ec-6135d4de1ef5/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:29:57 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0ea8dc6a-ec10-4279-83a4-cc9395a6fde9 tempest-VolumeAndVolumeTypeFromImageTest-726003660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0124c8a7-5e84-4908-84f7-ba8b777f26dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:29:57 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0ea8dc6a-ec10-4279-83a4-cc9395a6fde9 tempest-VolumeAndVolumeTypeFromImageTest-726003660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0124c8a7-5e84-4908-84f7-ba8b777f26dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:29:57 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0ea8dc6a-ec10-4279-83a4-cc9395a6fde9 tempest-VolumeAndVolumeTypeFromImageTest-726003660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58bd8915-74b2-4c11-816c-a0edbe58acc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:29:57 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-0ea8dc6a-ec10-4279-83a4-cc9395a6fde9 tempest-VolumeAndVolumeTypeFromImageTest-726003660 None] Volume d61beb52-89e9-4a92-922f-ee3a97c4326b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d61beb52-89e9-4a92-922f-ee3a97c4326b', 'volume_size': 1, 'image_id': '6d72f228-0a9f-4663-88ec-6135d4de1ef5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6d72f228-0a9f-4663-88ec-6135d4de1ef5', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '56093ca632a04ec54b61d4e350daec2b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0294f3ca0e1a4195a043abbf04dd3833', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '152439551b3bf4bda19f3fe50180e10f58513b36ee69bfd28633861054eb710f9610d84ab0e6493f7dc582cb46d03e99afba34fb461e59e2aa2ca039a7c93b96', 'id': '6d72f228-0a9f-4663-88ec-6135d4de1ef5', 'created_at': datetime.datetime(2026, 11, 6, 14, 29, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 14, 29, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6d72f228-0a9f-4663-88ec-6135d4de1ef5/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Nov 06 15:29:57 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ea8dc6a-ec10-4279-83a4-cc9395a6fde9 tempest-VolumeAndVolumeTypeFromImageTest-726003660 None] Trying to clone d61beb52-89e9-4a92-922f-ee3a97c4326b from image 6d72f228-0a9f-4663-88ec-6135d4de1ef5 at location (None, [{'url': 'file:///opt/stack/data/glance/images/6d72f228-0a9f-4663-88ec-6135d4de1ef5', 'metadata': {}}]). {{(pid=87132) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 06 15:29:57 devstack sudo[100844]: pam_unix(sudo:session): session closed for user root Nov 06 15:29:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a9023890-797b-4266-a559-34cf4c303fd3 tempest-AttachVolumeTestJSON-1915243344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.338s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:29:57 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-a9023890-797b-4266-a559-34cf4c303fd3 tempest-AttachVolumeTestJSON-1915243344 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:29:57 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-a9023890-797b-4266-a559-34cf4c303fd3 tempest-AttachVolumeTestJSON-1915243344 None] Deleted volume successfully. Nov 06 15:29:58 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a9023890-797b-4266-a559-34cf4c303fd3 tempest-AttachVolumeTestJSON-1915243344 None] Lock "cinder-ff32d504-636c-4127-99ea-aa659321c724-delete_volume" released by "delete_volume" :: held 1.535s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:29:58 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-0ea8dc6a-ec10-4279-83a4-cc9395a6fde9 tempest-VolumeAndVolumeTypeFromImageTest-726003660 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6d72f228-0a9f-4663-88ec-6135d4de1ef5_msjz98z2devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87132) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 06 15:29:58 devstack cinder-volume[87132]: INFO cinder.image.image_utils [None req-0ea8dc6a-ec10-4279-83a4-cc9395a6fde9 tempest-VolumeAndVolumeTypeFromImageTest-726003660 None] Image download 0.00 MB at 0.00 MB/s Nov 06 15:29:58 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcb44a11-f15d-4687-a95c-0e72dfc49732]: (4, 'raw') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:29:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0ea8dc6a-ec10-4279-83a4-cc9395a6fde9 tempest-VolumeAndVolumeTypeFromImageTest-726003660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6d72f228-0a9f-4663-88ec-6135d4de1ef5_msjz98z2devstack@QuobyteHD {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:29:58 devstack sudo[100847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6d72f228-0a9f-4663-88ec-6135d4de1ef5_msjz98z2devstack@QuobyteHD Nov 06 15:29:58 devstack sudo[100847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:29:58 devstack sudo[100847]: pam_unix(sudo:session): session closed for user root Nov 06 15:29:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0ea8dc6a-ec10-4279-83a4-cc9395a6fde9 tempest-VolumeAndVolumeTypeFromImageTest-726003660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6d72f228-0a9f-4663-88ec-6135d4de1ef5_msjz98z2devstack@QuobyteHD" returned: 0 in 0.413s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:29:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0ea8dc6a-ec10-4279-83a4-cc9395a6fde9 tempest-VolumeAndVolumeTypeFromImageTest-726003660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6d72f228-0a9f-4663-88ec-6135d4de1ef5_msjz98z2devstack@QuobyteHD {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:29:58 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-263d71b5-8ef2-446a-ac74-5540b1096cb6 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:29:58 devstack sudo[100851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6d72f228-0a9f-4663-88ec-6135d4de1ef5_msjz98z2devstack@QuobyteHD Nov 06 15:29:58 devstack sudo[100851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:29:58 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-263d71b5-8ef2-446a-ac74-5540b1096cb6 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Flow 'volume_create_manager' (7449c14b-2891-4deb-915b-5f6eacde5098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:29:58 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-263d71b5-8ef2-446a-ac74-5540b1096cb6 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d19689e-2a56-43cd-bb08-117a58c93960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:29:58 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-263d71b5-8ef2-446a-ac74-5540b1096cb6 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d19689e-2a56-43cd-bb08-117a58c93960) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:29:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1308143822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c7faa03-959e-4eff-9e68-10df4f1c4fa5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70c9518470a24c68a7196a66b2c164ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:29:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:29:59Z,use_quota=True,user_id='c257fe343c964084a948ebf655292bec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:29:58 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-263d71b5-8ef2-446a-ac74-5540b1096cb6 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b04fc05f-9cfb-47a0-a9a6-621c6b6203fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:29:58 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-263d71b5-8ef2-446a-ac74-5540b1096cb6 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b04fc05f-9cfb-47a0-a9a6-621c6b6203fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:29:58 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-263d71b5-8ef2-446a-ac74-5540b1096cb6 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3eae1c0-dc9d-4541-aaf5-e81ac2fa7330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:29:58 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-263d71b5-8ef2-446a-ac74-5540b1096cb6 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3eae1c0-dc9d-4541-aaf5-e81ac2fa7330) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c7faa03-959e-4eff-9e68-10df4f1c4fa5', 'volume_name': 'volume-6c7faa03-959e-4eff-9e68-10df4f1c4fa5', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:29:58 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-263d71b5-8ef2-446a-ac74-5540b1096cb6 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9d9ff4a-4dcd-4d5b-a729-3cead32f159e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:29:58 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-263d71b5-8ef2-446a-ac74-5540b1096cb6 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9d9ff4a-4dcd-4d5b-a729-3cead32f159e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:29:58 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-263d71b5-8ef2-446a-ac74-5540b1096cb6 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9aeac48d-3294-406c-a755-860a75d6a21a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:29:58 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-263d71b5-8ef2-446a-ac74-5540b1096cb6 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Volume 6c7faa03-959e-4eff-9e68-10df4f1c4fa5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c7faa03-959e-4eff-9e68-10df4f1c4fa5', 'volume_size': 1} Nov 06 15:29:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-263d71b5-8ef2-446a-ac74-5540b1096cb6 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:29:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-263d71b5-8ef2-446a-ac74-5540b1096cb6 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:29:58 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-263d71b5-8ef2-446a-ac74-5540b1096cb6 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:29:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1308143822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c7faa03-959e-4eff-9e68-10df4f1c4fa5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70c9518470a24c68a7196a66b2c164ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:29:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:29:59Z,use_quota=True,user_id='c257fe343c964084a948ebf655292bec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:29:58 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-263d71b5-8ef2-446a-ac74-5540b1096cb6 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Creating volume 6c7faa03-959e-4eff-9e68-10df4f1c4fa5 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:29:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-263d71b5-8ef2-446a-ac74-5540b1096cb6 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:29:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-263d71b5-8ef2-446a-ac74-5540b1096cb6 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:29:58 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-263d71b5-8ef2-446a-ac74-5540b1096cb6 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:29:58 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-263d71b5-8ef2-446a-ac74-5540b1096cb6 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:29:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-263d71b5-8ef2-446a-ac74-5540b1096cb6 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:29:58 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-263d71b5-8ef2-446a-ac74-5540b1096cb6 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:29:58 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-263d71b5-8ef2-446a-ac74-5540b1096cb6 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:29:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-263d71b5-8ef2-446a-ac74-5540b1096cb6 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-6c7faa03-959e-4eff-9e68-10df4f1c4fa5 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:29:58 devstack sudo[100853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-6c7faa03-959e-4eff-9e68-10df4f1c4fa5 1073741824 Nov 06 15:29:58 devstack sudo[100853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:29:59 devstack sudo[100851]: pam_unix(sudo:session): session closed for user root Nov 06 15:29:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0ea8dc6a-ec10-4279-83a4-cc9395a6fde9 tempest-VolumeAndVolumeTypeFromImageTest-726003660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6d72f228-0a9f-4663-88ec-6135d4de1ef5_msjz98z2devstack@QuobyteHD" returned: 1 in 0.549s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:29:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0ea8dc6a-ec10-4279-83a4-cc9395a6fde9 tempest-VolumeAndVolumeTypeFromImageTest-726003660 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6d72f228-0a9f-4663-88ec-6135d4de1ef5_msjz98z2devstack@QuobyteHD' failed. Not Retrying. {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 15:29:59 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-0ea8dc6a-ec10-4279-83a4-cc9395a6fde9 tempest-VolumeAndVolumeTypeFromImageTest-726003660 None] Temporary image 6d72f228-0a9f-4663-88ec-6135d4de1ef5 is fetched for user 021ab21ff6004b31b85cdc1182caf3fc. {{(pid=87132) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 06 15:29:59 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[26adb1b0-7f85-4aa4-b316-39d512a85f36]: (4, 'raw') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:29:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0ea8dc6a-ec10-4279-83a4-cc9395a6fde9 tempest-VolumeAndVolumeTypeFromImageTest-726003660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6d72f228-0a9f-4663-88ec-6135d4de1ef5_msjz98z2devstack@QuobyteHD {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:29:59 devstack sudo[100861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6d72f228-0a9f-4663-88ec-6135d4de1ef5_msjz98z2devstack@QuobyteHD Nov 06 15:29:59 devstack sudo[100861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:29:59 devstack sudo[100853]: pam_unix(sudo:session): session closed for user root Nov 06 15:29:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-263d71b5-8ef2-446a-ac74-5540b1096cb6 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-6c7faa03-959e-4eff-9e68-10df4f1c4fa5 1073741824" returned: 0 in 0.569s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:29:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-263d71b5-8ef2-446a-ac74-5540b1096cb6 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-6c7faa03-959e-4eff-9e68-10df4f1c4fa5 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:29:59 devstack sudo[100864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-6c7faa03-959e-4eff-9e68-10df4f1c4fa5 Nov 06 15:29:59 devstack sudo[100864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:29:59 devstack sudo[100861]: pam_unix(sudo:session): session closed for user root Nov 06 15:29:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0ea8dc6a-ec10-4279-83a4-cc9395a6fde9 tempest-VolumeAndVolumeTypeFromImageTest-726003660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6d72f228-0a9f-4663-88ec-6135d4de1ef5_msjz98z2devstack@QuobyteHD" returned: 0 in 0.443s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:29:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0ea8dc6a-ec10-4279-83a4-cc9395a6fde9 tempest-VolumeAndVolumeTypeFromImageTest-726003660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6d72f228-0a9f-4663-88ec-6135d4de1ef5_msjz98z2devstack@QuobyteHD {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:29:59 devstack sudo[100868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6d72f228-0a9f-4663-88ec-6135d4de1ef5_msjz98z2devstack@QuobyteHD Nov 06 15:29:59 devstack sudo[100868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:29:59 devstack sudo[100864]: pam_unix(sudo:session): session closed for user root Nov 06 15:29:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-263d71b5-8ef2-446a-ac74-5540b1096cb6 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-6c7faa03-959e-4eff-9e68-10df4f1c4fa5" returned: 0 in 0.326s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:29:59 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-263d71b5-8ef2-446a-ac74-5540b1096cb6 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] <== create_volume: return (953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:29:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-263d71b5-8ef2-446a-ac74-5540b1096cb6 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:29:59 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-263d71b5-8ef2-446a-ac74-5540b1096cb6 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9aeac48d-3294-406c-a755-860a75d6a21a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c7faa03-959e-4eff-9e68-10df4f1c4fa5', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:29:59 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-263d71b5-8ef2-446a-ac74-5540b1096cb6 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57934ed2-5b2d-42b9-b6d2-4cbc9af10280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:29:59 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-263d71b5-8ef2-446a-ac74-5540b1096cb6 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Volume volume-6c7faa03-959e-4eff-9e68-10df4f1c4fa5 (6c7faa03-959e-4eff-9e68-10df4f1c4fa5): created successfully Nov 06 15:29:59 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-263d71b5-8ef2-446a-ac74-5540b1096cb6 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57934ed2-5b2d-42b9-b6d2-4cbc9af10280) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:29:59 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-263d71b5-8ef2-446a-ac74-5540b1096cb6 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Flow 'volume_create_manager' (7449c14b-2891-4deb-915b-5f6eacde5098) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:29:59 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-263d71b5-8ef2-446a-ac74-5540b1096cb6 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Created volume successfully. Nov 06 15:30:00 devstack sudo[100868]: pam_unix(sudo:session): session closed for user root Nov 06 15:30:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0ea8dc6a-ec10-4279-83a4-cc9395a6fde9 tempest-VolumeAndVolumeTypeFromImageTest-726003660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6d72f228-0a9f-4663-88ec-6135d4de1ef5_msjz98z2devstack@QuobyteHD" returned: 1 in 0.423s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:30:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0ea8dc6a-ec10-4279-83a4-cc9395a6fde9 tempest-VolumeAndVolumeTypeFromImageTest-726003660 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6d72f228-0a9f-4663-88ec-6135d4de1ef5_msjz98z2devstack@QuobyteHD' failed. Not Retrying. {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 15:30:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0ea8dc6a-ec10-4279-83a4-cc9395a6fde9 tempest-VolumeAndVolumeTypeFromImageTest-726003660 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:30:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0ea8dc6a-ec10-4279-83a4-cc9395a6fde9 tempest-VolumeAndVolumeTypeFromImageTest-726003660 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:30:00 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0ea8dc6a-ec10-4279-83a4-cc9395a6fde9 tempest-VolumeAndVolumeTypeFromImageTest-726003660 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:29:57Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d61beb52-89e9-4a92-922f-ee3a97c4326b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0294f3ca0e1a4195a043abbf04dd3833',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:29:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:29:57Z,use_quota=True,user_id='021ab21ff6004b31b85cdc1182caf3fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cf6064fc-972e-4907-99ec-0d6df1c4ceb0),volume_type_id=cf6064fc-972e-4907-99ec-0d6df1c4ceb0)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:30:00 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-0ea8dc6a-ec10-4279-83a4-cc9395a6fde9 tempest-VolumeAndVolumeTypeFromImageTest-726003660 None] Creating volume d61beb52-89e9-4a92-922f-ee3a97c4326b {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:30:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0ea8dc6a-ec10-4279-83a4-cc9395a6fde9 tempest-VolumeAndVolumeTypeFromImageTest-726003660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:30:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0ea8dc6a-ec10-4279-83a4-cc9395a6fde9 tempest-VolumeAndVolumeTypeFromImageTest-726003660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:30:00 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0ea8dc6a-ec10-4279-83a4-cc9395a6fde9 tempest-VolumeAndVolumeTypeFromImageTest-726003660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:30:00 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0ea8dc6a-ec10-4279-83a4-cc9395a6fde9 tempest-VolumeAndVolumeTypeFromImageTest-726003660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:30:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0ea8dc6a-ec10-4279-83a4-cc9395a6fde9 tempest-VolumeAndVolumeTypeFromImageTest-726003660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:30:00 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0ea8dc6a-ec10-4279-83a4-cc9395a6fde9 tempest-VolumeAndVolumeTypeFromImageTest-726003660 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:30:00 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-0ea8dc6a-ec10-4279-83a4-cc9395a6fde9 tempest-VolumeAndVolumeTypeFromImageTest-726003660 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:30:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0ea8dc6a-ec10-4279-83a4-cc9395a6fde9 tempest-VolumeAndVolumeTypeFromImageTest-726003660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d61beb52-89e9-4a92-922f-ee3a97c4326b 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:30:00 devstack sudo[100875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d61beb52-89e9-4a92-922f-ee3a97c4326b 1073741824 Nov 06 15:30:00 devstack sudo[100875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:30:00 devstack sudo[100875]: pam_unix(sudo:session): session closed for user root Nov 06 15:30:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0ea8dc6a-ec10-4279-83a4-cc9395a6fde9 tempest-VolumeAndVolumeTypeFromImageTest-726003660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d61beb52-89e9-4a92-922f-ee3a97c4326b 1073741824" returned: 0 in 0.597s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:30:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0ea8dc6a-ec10-4279-83a4-cc9395a6fde9 tempest-VolumeAndVolumeTypeFromImageTest-726003660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d61beb52-89e9-4a92-922f-ee3a97c4326b {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:30:00 devstack sudo[100885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d61beb52-89e9-4a92-922f-ee3a97c4326b Nov 06 15:30:00 devstack sudo[100885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:30:01 devstack sudo[100885]: pam_unix(sudo:session): session closed for user root Nov 06 15:30:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0ea8dc6a-ec10-4279-83a4-cc9395a6fde9 tempest-VolumeAndVolumeTypeFromImageTest-726003660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d61beb52-89e9-4a92-922f-ee3a97c4326b" returned: 0 in 0.312s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:30:01 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0ea8dc6a-ec10-4279-83a4-cc9395a6fde9 tempest-VolumeAndVolumeTypeFromImageTest-726003660 None] <== create_volume: return (963ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:30:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0ea8dc6a-ec10-4279-83a4-cc9395a6fde9 tempest-VolumeAndVolumeTypeFromImageTest-726003660 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.965s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:30:01 devstack cinder-volume[87132]: DEBUG cinder.volume.volume_utils [None req-0ea8dc6a-ec10-4279-83a4-cc9395a6fde9 tempest-VolumeAndVolumeTypeFromImageTest-726003660 None] Attempting download of 6d72f228-0a9f-4663-88ec-6135d4de1ef5 ((None, [{'url': 'file:///opt/stack/data/glance/images/6d72f228-0a9f-4663-88ec-6135d4de1ef5', 'metadata': {}}])) to volume d61beb52-89e9-4a92-922f-ee3a97c4326b. {{(pid=87132) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 06 15:30:01 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c3ab3af-3843-44bf-8dc0-a730a2090d70]: (4, 'raw') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:30:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0ea8dc6a-ec10-4279-83a4-cc9395a6fde9 tempest-VolumeAndVolumeTypeFromImageTest-726003660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6d72f228-0a9f-4663-88ec-6135d4de1ef5_pihzyaoz {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:30:01 devstack sudo[100888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6d72f228-0a9f-4663-88ec-6135d4de1ef5_pihzyaoz Nov 06 15:30:01 devstack sudo[100888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:30:01 devstack sudo[100888]: pam_unix(sudo:session): session closed for user root Nov 06 15:30:01 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-a143e296-5ce8-45b2-a20f-cf79c721c5e5 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:30:01 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a143e296-5ce8-45b2-a20f-cf79c721c5e5 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Flow 'volume_create_manager' (9a92215d-b53f-4395-b08d-57a5274995ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:30:01 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a143e296-5ce8-45b2-a20f-cf79c721c5e5 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2dcfb2f-808b-4720-af96-aa6ed02c2460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:30:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0ea8dc6a-ec10-4279-83a4-cc9395a6fde9 tempest-VolumeAndVolumeTypeFromImageTest-726003660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6d72f228-0a9f-4663-88ec-6135d4de1ef5_pihzyaoz" returned: 0 in 0.475s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:30:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0ea8dc6a-ec10-4279-83a4-cc9395a6fde9 tempest-VolumeAndVolumeTypeFromImageTest-726003660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6d72f228-0a9f-4663-88ec-6135d4de1ef5_pihzyaoz {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:30:01 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a143e296-5ce8-45b2-a20f-cf79c721c5e5 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2dcfb2f-808b-4720-af96-aa6ed02c2460) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:30:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-998380647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c71ca534-fa19-488e-8e9d-d9a4c1f05063,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70c9518470a24c68a7196a66b2c164ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:30:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:30:02Z,use_quota=True,user_id='c257fe343c964084a948ebf655292bec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:30:01 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a143e296-5ce8-45b2-a20f-cf79c721c5e5 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05676ceb-c55e-4384-be47-5e64439f214d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:30:01 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a143e296-5ce8-45b2-a20f-cf79c721c5e5 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05676ceb-c55e-4384-be47-5e64439f214d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:30:01 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a143e296-5ce8-45b2-a20f-cf79c721c5e5 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fd51225-7614-4aa2-b7c8-96128d739d50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:30:01 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a143e296-5ce8-45b2-a20f-cf79c721c5e5 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fd51225-7614-4aa2-b7c8-96128d739d50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c71ca534-fa19-488e-8e9d-d9a4c1f05063', 'volume_name': 'volume-c71ca534-fa19-488e-8e9d-d9a4c1f05063', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:30:01 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a143e296-5ce8-45b2-a20f-cf79c721c5e5 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7197af95-391b-4b54-831d-9f0ad183dc77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:30:01 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a143e296-5ce8-45b2-a20f-cf79c721c5e5 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7197af95-391b-4b54-831d-9f0ad183dc77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:30:01 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a143e296-5ce8-45b2-a20f-cf79c721c5e5 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7735acb7-06d6-4312-b2b1-77d653fa6608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:30:01 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-a143e296-5ce8-45b2-a20f-cf79c721c5e5 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Volume c71ca534-fa19-488e-8e9d-d9a4c1f05063: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c71ca534-fa19-488e-8e9d-d9a4c1f05063', 'volume_size': 1} Nov 06 15:30:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a143e296-5ce8-45b2-a20f-cf79c721c5e5 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:30:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a143e296-5ce8-45b2-a20f-cf79c721c5e5 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:30:01 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-a143e296-5ce8-45b2-a20f-cf79c721c5e5 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:30:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-998380647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c71ca534-fa19-488e-8e9d-d9a4c1f05063,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70c9518470a24c68a7196a66b2c164ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:30:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:30:02Z,use_quota=True,user_id='c257fe343c964084a948ebf655292bec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:30:01 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-a143e296-5ce8-45b2-a20f-cf79c721c5e5 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Creating volume c71ca534-fa19-488e-8e9d-d9a4c1f05063 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:30:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a143e296-5ce8-45b2-a20f-cf79c721c5e5 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:30:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a143e296-5ce8-45b2-a20f-cf79c721c5e5 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:30:01 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-a143e296-5ce8-45b2-a20f-cf79c721c5e5 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:30:01 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-a143e296-5ce8-45b2-a20f-cf79c721c5e5 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:30:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a143e296-5ce8-45b2-a20f-cf79c721c5e5 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:30:01 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-a143e296-5ce8-45b2-a20f-cf79c721c5e5 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:30:01 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-a143e296-5ce8-45b2-a20f-cf79c721c5e5 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:30:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a143e296-5ce8-45b2-a20f-cf79c721c5e5 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-c71ca534-fa19-488e-8e9d-d9a4c1f05063 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:30:01 devstack sudo[100893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-c71ca534-fa19-488e-8e9d-d9a4c1f05063 1073741824 Nov 06 15:30:01 devstack sudo[100893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:30:01 devstack sudo[100892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6d72f228-0a9f-4663-88ec-6135d4de1ef5_pihzyaoz Nov 06 15:30:01 devstack sudo[100892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:30:02 devstack sudo[100892]: pam_unix(sudo:session): session closed for user root Nov 06 15:30:02 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-ddb9e71d-c92d-47f3-8ef0-0e4c704ccd9b tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:30:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ddb9e71d-c92d-47f3-8ef0-0e4c704ccd9b tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Flow 'volume_create_manager' (a9460f77-7ef8-470d-b892-31bf37a998e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:30:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ddb9e71d-c92d-47f3-8ef0-0e4c704ccd9b tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a0c456e-c662-4c07-af8b-8f83a0724ea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:30:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0ea8dc6a-ec10-4279-83a4-cc9395a6fde9 tempest-VolumeAndVolumeTypeFromImageTest-726003660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6d72f228-0a9f-4663-88ec-6135d4de1ef5_pihzyaoz" returned: 1 in 0.468s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:30:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0ea8dc6a-ec10-4279-83a4-cc9395a6fde9 tempest-VolumeAndVolumeTypeFromImageTest-726003660 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6d72f228-0a9f-4663-88ec-6135d4de1ef5_pihzyaoz' failed. Not Retrying. {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 15:30:02 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[84b84cd7-c598-470a-a1c6-b78553763cae]: (4, 'raw') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:30:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0ea8dc6a-ec10-4279-83a4-cc9395a6fde9 tempest-VolumeAndVolumeTypeFromImageTest-726003660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6d72f228-0a9f-4663-88ec-6135d4de1ef5_msjz98z2devstack@QuobyteHD {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:30:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ddb9e71d-c92d-47f3-8ef0-0e4c704ccd9b tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a0c456e-c662-4c07-af8b-8f83a0724ea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:30:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1753217315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2822cb30-f105-405b-9916-0977a993c404,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70c9518470a24c68a7196a66b2c164ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:30:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:30:02Z,use_quota=True,user_id='c257fe343c964084a948ebf655292bec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:30:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ddb9e71d-c92d-47f3-8ef0-0e4c704ccd9b tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5c5a7e0-a8e1-4c1a-9b5a-ce6705e44ced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:30:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ddb9e71d-c92d-47f3-8ef0-0e4c704ccd9b tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5c5a7e0-a8e1-4c1a-9b5a-ce6705e44ced) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:30:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ddb9e71d-c92d-47f3-8ef0-0e4c704ccd9b tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d22bfc24-ad1a-452b-b632-e07c904f5982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:30:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ddb9e71d-c92d-47f3-8ef0-0e4c704ccd9b tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d22bfc24-ad1a-452b-b632-e07c904f5982) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2822cb30-f105-405b-9916-0977a993c404', 'volume_name': 'volume-2822cb30-f105-405b-9916-0977a993c404', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:30:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ddb9e71d-c92d-47f3-8ef0-0e4c704ccd9b tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d884cbef-ea52-4b9a-a5fc-a0b33e7d41ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:30:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ddb9e71d-c92d-47f3-8ef0-0e4c704ccd9b tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d884cbef-ea52-4b9a-a5fc-a0b33e7d41ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:30:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ddb9e71d-c92d-47f3-8ef0-0e4c704ccd9b tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e0c6340-4d19-4350-b5dc-d7bd2d6767c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:30:02 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-ddb9e71d-c92d-47f3-8ef0-0e4c704ccd9b tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Volume 2822cb30-f105-405b-9916-0977a993c404: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2822cb30-f105-405b-9916-0977a993c404', 'volume_size': 1} Nov 06 15:30:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ddb9e71d-c92d-47f3-8ef0-0e4c704ccd9b tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:30:02 devstack sudo[100900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6d72f228-0a9f-4663-88ec-6135d4de1ef5_msjz98z2devstack@QuobyteHD Nov 06 15:30:02 devstack sudo[100900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:30:02 devstack sudo[100893]: pam_unix(sudo:session): session closed for user root Nov 06 15:30:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a143e296-5ce8-45b2-a20f-cf79c721c5e5 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-c71ca534-fa19-488e-8e9d-d9a4c1f05063 1073741824" returned: 0 in 0.745s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:30:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a143e296-5ce8-45b2-a20f-cf79c721c5e5 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-c71ca534-fa19-488e-8e9d-d9a4c1f05063 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:30:02 devstack sudo[100900]: pam_unix(sudo:session): session closed for user root Nov 06 15:30:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0ea8dc6a-ec10-4279-83a4-cc9395a6fde9 tempest-VolumeAndVolumeTypeFromImageTest-726003660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6d72f228-0a9f-4663-88ec-6135d4de1ef5_msjz98z2devstack@QuobyteHD" returned: 0 in 0.447s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:30:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0ea8dc6a-ec10-4279-83a4-cc9395a6fde9 tempest-VolumeAndVolumeTypeFromImageTest-726003660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6d72f228-0a9f-4663-88ec-6135d4de1ef5_msjz98z2devstack@QuobyteHD {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:30:02 devstack sudo[100906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-c71ca534-fa19-488e-8e9d-d9a4c1f05063 Nov 06 15:30:02 devstack sudo[100906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:30:02 devstack sudo[100908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6d72f228-0a9f-4663-88ec-6135d4de1ef5_msjz98z2devstack@QuobyteHD Nov 06 15:30:02 devstack sudo[100908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:30:03 devstack sudo[100906]: pam_unix(sudo:session): session closed for user root Nov 06 15:30:03 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-dda603d6-e507-46e1-95e4-15e05d9fe25c tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:30:03 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-dda603d6-e507-46e1-95e4-15e05d9fe25c tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Flow 'volume_create_manager' (c1c08d5d-e20c-42a6-8a1a-5a61ec0e1018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:30:03 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-dda603d6-e507-46e1-95e4-15e05d9fe25c tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3eb2e0e-8ebb-4a7c-bf07-f75533fdf548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:30:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a143e296-5ce8-45b2-a20f-cf79c721c5e5 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-c71ca534-fa19-488e-8e9d-d9a4c1f05063" returned: 0 in 0.621s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:30:03 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-a143e296-5ce8-45b2-a20f-cf79c721c5e5 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] <== create_volume: return (1448ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:30:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a143e296-5ce8-45b2-a20f-cf79c721c5e5 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.451s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:30:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ddb9e71d-c92d-47f3-8ef0-0e4c704ccd9b tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.944s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:30:03 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-ddb9e71d-c92d-47f3-8ef0-0e4c704ccd9b tempest-CreateVolumesFromSourceVolumeTest-226981821 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:30:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1753217315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2822cb30-f105-405b-9916-0977a993c404,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70c9518470a24c68a7196a66b2c164ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:30:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:30:02Z,use_quota=True,user_id='c257fe343c964084a948ebf655292bec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:30:03 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-ddb9e71d-c92d-47f3-8ef0-0e4c704ccd9b tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Creating volume 2822cb30-f105-405b-9916-0977a993c404 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:30:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ddb9e71d-c92d-47f3-8ef0-0e4c704ccd9b tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:30:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ddb9e71d-c92d-47f3-8ef0-0e4c704ccd9b tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:30:03 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-ddb9e71d-c92d-47f3-8ef0-0e4c704ccd9b tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:30:03 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-ddb9e71d-c92d-47f3-8ef0-0e4c704ccd9b tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:30:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ddb9e71d-c92d-47f3-8ef0-0e4c704ccd9b tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:30:03 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-ddb9e71d-c92d-47f3-8ef0-0e4c704ccd9b tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:30:03 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-ddb9e71d-c92d-47f3-8ef0-0e4c704ccd9b tempest-CreateVolumesFromSourceVolumeTest-226981821 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:30:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ddb9e71d-c92d-47f3-8ef0-0e4c704ccd9b tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-2822cb30-f105-405b-9916-0977a993c404 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:30:03 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-dda603d6-e507-46e1-95e4-15e05d9fe25c tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3eb2e0e-8ebb-4a7c-bf07-f75533fdf548) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:30:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1677567225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be9a7535-d0e2-4769-b1ef-4d44ca4c4e3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70c9518470a24c68a7196a66b2c164ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:30:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:30:03Z,use_quota=True,user_id='c257fe343c964084a948ebf655292bec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:30:03 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-dda603d6-e507-46e1-95e4-15e05d9fe25c tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b91bdea-1b1c-409f-87e2-aa237f7ae9cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:30:03 devstack sudo[100908]: pam_unix(sudo:session): session closed for user root Nov 06 15:30:03 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-dda603d6-e507-46e1-95e4-15e05d9fe25c tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b91bdea-1b1c-409f-87e2-aa237f7ae9cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:30:03 devstack sudo[100914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-2822cb30-f105-405b-9916-0977a993c404 1073741824 Nov 06 15:30:03 devstack sudo[100914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:30:03 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-dda603d6-e507-46e1-95e4-15e05d9fe25c tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8040ec88-0129-4e98-9515-fe2b6c54fe67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:30:03 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-dda603d6-e507-46e1-95e4-15e05d9fe25c tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8040ec88-0129-4e98-9515-fe2b6c54fe67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be9a7535-d0e2-4769-b1ef-4d44ca4c4e3d', 'volume_name': 'volume-be9a7535-d0e2-4769-b1ef-4d44ca4c4e3d', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:30:03 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-dda603d6-e507-46e1-95e4-15e05d9fe25c tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8356adc2-50b5-42e6-8454-4e78beacc268) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:30:03 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-dda603d6-e507-46e1-95e4-15e05d9fe25c tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8356adc2-50b5-42e6-8454-4e78beacc268) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:30:03 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-dda603d6-e507-46e1-95e4-15e05d9fe25c tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4f4dbc9-177e-4ee3-9074-1bb777a20e5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:30:03 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-dda603d6-e507-46e1-95e4-15e05d9fe25c tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Volume be9a7535-d0e2-4769-b1ef-4d44ca4c4e3d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be9a7535-d0e2-4769-b1ef-4d44ca4c4e3d', 'volume_size': 1} Nov 06 15:30:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-dda603d6-e507-46e1-95e4-15e05d9fe25c tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:30:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0ea8dc6a-ec10-4279-83a4-cc9395a6fde9 tempest-VolumeAndVolumeTypeFromImageTest-726003660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6d72f228-0a9f-4663-88ec-6135d4de1ef5_msjz98z2devstack@QuobyteHD" returned: 1 in 0.763s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:30:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0ea8dc6a-ec10-4279-83a4-cc9395a6fde9 tempest-VolumeAndVolumeTypeFromImageTest-726003660 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6d72f228-0a9f-4663-88ec-6135d4de1ef5_msjz98z2devstack@QuobyteHD' failed. Not Retrying. {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 15:30:03 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-0ea8dc6a-ec10-4279-83a4-cc9395a6fde9 tempest-VolumeAndVolumeTypeFromImageTest-726003660 None] 6d72f228-0a9f-4663-88ec-6135d4de1ef5 was raw, converting to qcow2 {{(pid=87132) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 06 15:30:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0ea8dc6a-ec10-4279-83a4-cc9395a6fde9 tempest-VolumeAndVolumeTypeFromImageTest-726003660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_6d72f228-0a9f-4663-88ec-6135d4de1ef5_msjz98z2devstack@QuobyteHD /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d61beb52-89e9-4a92-922f-ee3a97c4326b {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:30:03 devstack sudo[100916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_6d72f228-0a9f-4663-88ec-6135d4de1ef5_msjz98z2devstack@QuobyteHD /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d61beb52-89e9-4a92-922f-ee3a97c4326b Nov 06 15:30:03 devstack sudo[100916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:30:03 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a143e296-5ce8-45b2-a20f-cf79c721c5e5 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7735acb7-06d6-4312-b2b1-77d653fa6608) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c71ca534-fa19-488e-8e9d-d9a4c1f05063', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:30:03 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a143e296-5ce8-45b2-a20f-cf79c721c5e5 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e92224a9-f2bf-464c-b783-c7eebeaca40d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:30:03 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-a143e296-5ce8-45b2-a20f-cf79c721c5e5 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Volume volume-c71ca534-fa19-488e-8e9d-d9a4c1f05063 (c71ca534-fa19-488e-8e9d-d9a4c1f05063): created successfully Nov 06 15:30:03 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a143e296-5ce8-45b2-a20f-cf79c721c5e5 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e92224a9-f2bf-464c-b783-c7eebeaca40d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:30:03 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a143e296-5ce8-45b2-a20f-cf79c721c5e5 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Flow 'volume_create_manager' (9a92215d-b53f-4395-b08d-57a5274995ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:30:03 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-831c61d9-8052-4929-9907-8f63d4b64742 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:30:03 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-831c61d9-8052-4929-9907-8f63d4b64742 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Flow 'volume_create_manager' (8f26eaf5-1f8b-4b80-92a1-d9b2f2377621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:30:03 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-831c61d9-8052-4929-9907-8f63d4b64742 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fee617b-b2ca-487d-9df1-d2411d393ebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:30:03 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-a143e296-5ce8-45b2-a20f-cf79c721c5e5 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Created volume successfully. Nov 06 15:30:03 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-831c61d9-8052-4929-9907-8f63d4b64742 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fee617b-b2ca-487d-9df1-d2411d393ebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:30:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1602386089',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11616f75-19b0-4f87-9c5b-3b816610e6c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70c9518470a24c68a7196a66b2c164ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:30:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:30:03Z,use_quota=True,user_id='c257fe343c964084a948ebf655292bec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:30:03 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-831c61d9-8052-4929-9907-8f63d4b64742 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ec92159-f9dd-4f6f-ae2c-9ea0f5a97cf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:30:03 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-831c61d9-8052-4929-9907-8f63d4b64742 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ec92159-f9dd-4f6f-ae2c-9ea0f5a97cf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:30:03 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-831c61d9-8052-4929-9907-8f63d4b64742 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4401d494-9295-4306-aee1-bffc0523d922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:30:03 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-831c61d9-8052-4929-9907-8f63d4b64742 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4401d494-9295-4306-aee1-bffc0523d922) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11616f75-19b0-4f87-9c5b-3b816610e6c3', 'volume_name': 'volume-11616f75-19b0-4f87-9c5b-3b816610e6c3', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:30:03 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-831c61d9-8052-4929-9907-8f63d4b64742 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7c35689-c701-49c1-912f-ad760c8e112b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:30:03 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-831c61d9-8052-4929-9907-8f63d4b64742 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7c35689-c701-49c1-912f-ad760c8e112b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:30:03 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-831c61d9-8052-4929-9907-8f63d4b64742 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7ba1c2d-331a-4a52-8656-e8fba10f429e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:30:03 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-831c61d9-8052-4929-9907-8f63d4b64742 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Volume 11616f75-19b0-4f87-9c5b-3b816610e6c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11616f75-19b0-4f87-9c5b-3b816610e6c3', 'volume_size': 1} Nov 06 15:30:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-831c61d9-8052-4929-9907-8f63d4b64742 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:30:03 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-11af5922-8f6d-483e-bcae-62f13267e803 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:30:03 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-11af5922-8f6d-483e-bcae-62f13267e803 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Flow 'volume_create_manager' (1fd4665c-7a4f-4eeb-8da1-19a630b02dc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:30:03 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-11af5922-8f6d-483e-bcae-62f13267e803 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2e5af18-0280-4555-87b4-14c500f0ba14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:30:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-11af5922-8f6d-483e-bcae-62f13267e803 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2e5af18-0280-4555-87b4-14c500f0ba14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:30:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2142856872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffc85cf6-16c1-47cc-af77-dcc62807923e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70c9518470a24c68a7196a66b2c164ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:30:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:30:04Z,use_quota=True,user_id='c257fe343c964084a948ebf655292bec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:30:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-11af5922-8f6d-483e-bcae-62f13267e803 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a59a699b-efb7-4d42-ab74-a368efca16f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:30:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-11af5922-8f6d-483e-bcae-62f13267e803 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a59a699b-efb7-4d42-ab74-a368efca16f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:30:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-11af5922-8f6d-483e-bcae-62f13267e803 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9bf9760-35c1-4acb-a3b9-4dccfd98ed35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:30:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-11af5922-8f6d-483e-bcae-62f13267e803 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9bf9760-35c1-4acb-a3b9-4dccfd98ed35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ffc85cf6-16c1-47cc-af77-dcc62807923e', 'volume_name': 'volume-ffc85cf6-16c1-47cc-af77-dcc62807923e', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:30:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-11af5922-8f6d-483e-bcae-62f13267e803 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6592889-f590-4f55-8d65-c9dc48efc7f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:30:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-11af5922-8f6d-483e-bcae-62f13267e803 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6592889-f590-4f55-8d65-c9dc48efc7f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:30:04 devstack sudo[100914]: pam_unix(sudo:session): session closed for user root Nov 06 15:30:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-11af5922-8f6d-483e-bcae-62f13267e803 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab18c235-e6c1-4ffa-9b40-2b506338ced1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:30:04 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-11af5922-8f6d-483e-bcae-62f13267e803 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Volume ffc85cf6-16c1-47cc-af77-dcc62807923e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ffc85cf6-16c1-47cc-af77-dcc62807923e', 'volume_size': 1} Nov 06 15:30:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-11af5922-8f6d-483e-bcae-62f13267e803 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:30:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ddb9e71d-c92d-47f3-8ef0-0e4c704ccd9b tempest-CreateVolumesFromSourceVolumeTest-226981821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-2822cb30-f105-405b-9916-0977a993c404 1073741824" returned: 0 in 0.899s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:30:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ddb9e71d-c92d-47f3-8ef0-0e4c704ccd9b tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-2822cb30-f105-405b-9916-0977a993c404 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:30:04 devstack sudo[100926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-2822cb30-f105-405b-9916-0977a993c404 Nov 06 15:30:04 devstack sudo[100926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:30:04 devstack sudo[100916]: pam_unix(sudo:session): session closed for user root Nov 06 15:30:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0ea8dc6a-ec10-4279-83a4-cc9395a6fde9 tempest-VolumeAndVolumeTypeFromImageTest-726003660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_6d72f228-0a9f-4663-88ec-6135d4de1ef5_msjz98z2devstack@QuobyteHD /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d61beb52-89e9-4a92-922f-ee3a97c4326b" returned: 0 in 0.822s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:30:04 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-0ea8dc6a-ec10-4279-83a4-cc9395a6fde9 tempest-VolumeAndVolumeTypeFromImageTest-726003660 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6d72f228-0a9f-4663-88ec-6135d4de1ef5_msjz98z2devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d61beb52-89e9-4a92-922f-ee3a97c4326b {{(pid=87132) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 06 15:30:04 devstack cinder-volume[87132]: INFO cinder.image.image_utils [None req-0ea8dc6a-ec10-4279-83a4-cc9395a6fde9 tempest-VolumeAndVolumeTypeFromImageTest-726003660 None] Converted 0.00 MB image at 0.00 MB/s Nov 06 15:30:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0ea8dc6a-ec10-4279-83a4-cc9395a6fde9 tempest-VolumeAndVolumeTypeFromImageTest-726003660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d61beb52-89e9-4a92-922f-ee3a97c4326b 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:30:04 devstack sudo[100928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d61beb52-89e9-4a92-922f-ee3a97c4326b 1G Nov 06 15:30:04 devstack sudo[100928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:30:04 devstack sudo[100926]: pam_unix(sudo:session): session closed for user root Nov 06 15:30:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ddb9e71d-c92d-47f3-8ef0-0e4c704ccd9b tempest-CreateVolumesFromSourceVolumeTest-226981821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-2822cb30-f105-405b-9916-0977a993c404" returned: 0 in 0.307s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:30:04 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-ddb9e71d-c92d-47f3-8ef0-0e4c704ccd9b tempest-CreateVolumesFromSourceVolumeTest-226981821 None] <== create_volume: return (1265ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:30:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ddb9e71d-c92d-47f3-8ef0-0e4c704ccd9b tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.269s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:30:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-dda603d6-e507-46e1-95e4-15e05d9fe25c tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.128s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:30:04 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-dda603d6-e507-46e1-95e4-15e05d9fe25c tempest-CreateVolumesFromSourceVolumeTest-226981821 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:30:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1677567225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be9a7535-d0e2-4769-b1ef-4d44ca4c4e3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70c9518470a24c68a7196a66b2c164ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:30:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:30:03Z,use_quota=True,user_id='c257fe343c964084a948ebf655292bec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:30:04 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-dda603d6-e507-46e1-95e4-15e05d9fe25c tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Creating volume be9a7535-d0e2-4769-b1ef-4d44ca4c4e3d {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:30:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-dda603d6-e507-46e1-95e4-15e05d9fe25c tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:30:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-dda603d6-e507-46e1-95e4-15e05d9fe25c tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:30:04 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-dda603d6-e507-46e1-95e4-15e05d9fe25c tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:30:04 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-dda603d6-e507-46e1-95e4-15e05d9fe25c tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:30:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-dda603d6-e507-46e1-95e4-15e05d9fe25c tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:30:04 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-dda603d6-e507-46e1-95e4-15e05d9fe25c tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:30:04 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-dda603d6-e507-46e1-95e4-15e05d9fe25c tempest-CreateVolumesFromSourceVolumeTest-226981821 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:30:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-dda603d6-e507-46e1-95e4-15e05d9fe25c tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-be9a7535-d0e2-4769-b1ef-4d44ca4c4e3d 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:30:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ddb9e71d-c92d-47f3-8ef0-0e4c704ccd9b tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e0c6340-4d19-4350-b5dc-d7bd2d6767c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2822cb30-f105-405b-9916-0977a993c404', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:30:04 devstack sudo[100934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-be9a7535-d0e2-4769-b1ef-4d44ca4c4e3d 1073741824 Nov 06 15:30:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ddb9e71d-c92d-47f3-8ef0-0e4c704ccd9b tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ff6dea8-e5e0-497c-bf5b-78ec00f2a942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:30:04 devstack sudo[100934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:30:04 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-ddb9e71d-c92d-47f3-8ef0-0e4c704ccd9b tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Volume volume-2822cb30-f105-405b-9916-0977a993c404 (2822cb30-f105-405b-9916-0977a993c404): created successfully Nov 06 15:30:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ddb9e71d-c92d-47f3-8ef0-0e4c704ccd9b tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ff6dea8-e5e0-497c-bf5b-78ec00f2a942) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:30:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ddb9e71d-c92d-47f3-8ef0-0e4c704ccd9b tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Flow 'volume_create_manager' (a9460f77-7ef8-470d-b892-31bf37a998e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:30:04 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-ddb9e71d-c92d-47f3-8ef0-0e4c704ccd9b tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Created volume successfully. Nov 06 15:30:04 devstack sudo[100928]: pam_unix(sudo:session): session closed for user root Nov 06 15:30:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0ea8dc6a-ec10-4279-83a4-cc9395a6fde9 tempest-VolumeAndVolumeTypeFromImageTest-726003660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d61beb52-89e9-4a92-922f-ee3a97c4326b 1G" returned: 0 in 0.484s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:30:04 devstack cinder-volume[87132]: DEBUG cinder.volume.volume_utils [None req-0ea8dc6a-ec10-4279-83a4-cc9395a6fde9 tempest-VolumeAndVolumeTypeFromImageTest-726003660 None] Downloaded image 6d72f228-0a9f-4663-88ec-6135d4de1ef5 ((None, [{'url': 'file:///opt/stack/data/glance/images/6d72f228-0a9f-4663-88ec-6135d4de1ef5', 'metadata': {}}])) to volume d61beb52-89e9-4a92-922f-ee3a97c4326b successfully. {{(pid=87132) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 06 15:30:04 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-0ea8dc6a-ec10-4279-83a4-cc9395a6fde9 tempest-VolumeAndVolumeTypeFromImageTest-726003660 None] Temporary image 6d72f228-0a9f-4663-88ec-6135d4de1ef5 for user 021ab21ff6004b31b85cdc1182caf3fc is deleted. {{(pid=87132) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 06 15:30:04 devstack cinder-volume[87132]: DEBUG cinder.volume.volume_utils [None req-0ea8dc6a-ec10-4279-83a4-cc9395a6fde9 tempest-VolumeAndVolumeTypeFromImageTest-726003660 None] Marking volume d61beb52-89e9-4a92-922f-ee3a97c4326b as bootable. {{(pid=87132) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 06 15:30:04 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ea8dc6a-ec10-4279-83a4-cc9395a6fde9 tempest-VolumeAndVolumeTypeFromImageTest-726003660 None] Copying metadata from image 6d72f228-0a9f-4663-88ec-6135d4de1ef5 to d61beb52-89e9-4a92-922f-ee3a97c4326b. {{(pid=87132) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 06 15:30:04 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ea8dc6a-ec10-4279-83a4-cc9395a6fde9 tempest-VolumeAndVolumeTypeFromImageTest-726003660 None] Creating volume glance metadata for volume d61beb52-89e9-4a92-922f-ee3a97c4326b backed by image 6d72f228-0a9f-4663-88ec-6135d4de1ef5 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '6d72f228-0a9f-4663-88ec-6135d4de1ef5', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '56093ca632a04ec54b61d4e350daec2b', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87132) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 06 15:30:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0ea8dc6a-ec10-4279-83a4-cc9395a6fde9 tempest-VolumeAndVolumeTypeFromImageTest-726003660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58bd8915-74b2-4c11-816c-a0edbe58acc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d61beb52-89e9-4a92-922f-ee3a97c4326b', 'volume_size': 1, 'image_id': '6d72f228-0a9f-4663-88ec-6135d4de1ef5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6d72f228-0a9f-4663-88ec-6135d4de1ef5', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '56093ca632a04ec54b61d4e350daec2b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0294f3ca0e1a4195a043abbf04dd3833', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '152439551b3bf4bda19f3fe50180e10f58513b36ee69bfd28633861054eb710f9610d84ab0e6493f7dc582cb46d03e99afba34fb461e59e2aa2ca039a7c93b96', 'id': '6d72f228-0a9f-4663-88ec-6135d4de1ef5', 'created_at': datetime.datetime(2026, 11, 6, 14, 29, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 14, 29, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6d72f228-0a9f-4663-88ec-6135d4de1ef5/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:30:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0ea8dc6a-ec10-4279-83a4-cc9395a6fde9 tempest-VolumeAndVolumeTypeFromImageTest-726003660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad913cde-fa87-4a14-9253-fa76be23810a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:30:04 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-0ea8dc6a-ec10-4279-83a4-cc9395a6fde9 tempest-VolumeAndVolumeTypeFromImageTest-726003660 None] Volume volume-d61beb52-89e9-4a92-922f-ee3a97c4326b (d61beb52-89e9-4a92-922f-ee3a97c4326b): created successfully Nov 06 15:30:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0ea8dc6a-ec10-4279-83a4-cc9395a6fde9 tempest-VolumeAndVolumeTypeFromImageTest-726003660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad913cde-fa87-4a14-9253-fa76be23810a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:30:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0ea8dc6a-ec10-4279-83a4-cc9395a6fde9 tempest-VolumeAndVolumeTypeFromImageTest-726003660 None] Flow 'volume_create_manager' (571c0998-1e5e-484d-b6a4-384931f4d2e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:30:04 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-0ea8dc6a-ec10-4279-83a4-cc9395a6fde9 tempest-VolumeAndVolumeTypeFromImageTest-726003660 None] Created volume successfully. Nov 06 15:30:05 devstack sudo[100934]: pam_unix(sudo:session): session closed for user root Nov 06 15:30:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-dda603d6-e507-46e1-95e4-15e05d9fe25c tempest-CreateVolumesFromSourceVolumeTest-226981821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-be9a7535-d0e2-4769-b1ef-4d44ca4c4e3d 1073741824" returned: 0 in 0.601s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:30:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-dda603d6-e507-46e1-95e4-15e05d9fe25c tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-be9a7535-d0e2-4769-b1ef-4d44ca4c4e3d {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:30:05 devstack sudo[100942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-be9a7535-d0e2-4769-b1ef-4d44ca4c4e3d Nov 06 15:30:05 devstack sudo[100942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:30:05 devstack sudo[100942]: pam_unix(sudo:session): session closed for user root Nov 06 15:30:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-dda603d6-e507-46e1-95e4-15e05d9fe25c tempest-CreateVolumesFromSourceVolumeTest-226981821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-be9a7535-d0e2-4769-b1ef-4d44ca4c4e3d" returned: 0 in 0.317s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:30:05 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-dda603d6-e507-46e1-95e4-15e05d9fe25c tempest-CreateVolumesFromSourceVolumeTest-226981821 None] <== create_volume: return (971ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:30:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-dda603d6-e507-46e1-95e4-15e05d9fe25c tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.976s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:30:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-831c61d9-8052-4929-9907-8f63d4b64742 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.727s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:30:05 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-831c61d9-8052-4929-9907-8f63d4b64742 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:30:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1602386089',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11616f75-19b0-4f87-9c5b-3b816610e6c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70c9518470a24c68a7196a66b2c164ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:30:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:30:03Z,use_quota=True,user_id='c257fe343c964084a948ebf655292bec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:30:05 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-831c61d9-8052-4929-9907-8f63d4b64742 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Creating volume 11616f75-19b0-4f87-9c5b-3b816610e6c3 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:30:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-831c61d9-8052-4929-9907-8f63d4b64742 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:30:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-831c61d9-8052-4929-9907-8f63d4b64742 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:30:05 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-831c61d9-8052-4929-9907-8f63d4b64742 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:30:05 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-831c61d9-8052-4929-9907-8f63d4b64742 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:30:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-831c61d9-8052-4929-9907-8f63d4b64742 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:30:05 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-831c61d9-8052-4929-9907-8f63d4b64742 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:30:05 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-831c61d9-8052-4929-9907-8f63d4b64742 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:30:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-831c61d9-8052-4929-9907-8f63d4b64742 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-11616f75-19b0-4f87-9c5b-3b816610e6c3 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:30:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-dda603d6-e507-46e1-95e4-15e05d9fe25c tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4f4dbc9-177e-4ee3-9074-1bb777a20e5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be9a7535-d0e2-4769-b1ef-4d44ca4c4e3d', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:30:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-dda603d6-e507-46e1-95e4-15e05d9fe25c tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7816d98a-04c8-4987-8d53-3910ab2d6cef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:30:05 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-dda603d6-e507-46e1-95e4-15e05d9fe25c tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Volume volume-be9a7535-d0e2-4769-b1ef-4d44ca4c4e3d (be9a7535-d0e2-4769-b1ef-4d44ca4c4e3d): created successfully Nov 06 15:30:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-dda603d6-e507-46e1-95e4-15e05d9fe25c tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7816d98a-04c8-4987-8d53-3910ab2d6cef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:30:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-dda603d6-e507-46e1-95e4-15e05d9fe25c tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Flow 'volume_create_manager' (c1c08d5d-e20c-42a6-8a1a-5a61ec0e1018) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:30:05 devstack sudo[100946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-11616f75-19b0-4f87-9c5b-3b816610e6c3 1073741824 Nov 06 15:30:05 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-dda603d6-e507-46e1-95e4-15e05d9fe25c tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Created volume successfully. Nov 06 15:30:05 devstack sudo[100946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:30:05 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-1c85ef1b-9e80-4120-8bca-9b3f01de69c8 tempest-VolumeAndVolumeTypeFromImageTest-726003660 None] Acquiring lock "cinder-d61beb52-89e9-4a92-922f-ee3a97c4326b-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:30:05 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-1c85ef1b-9e80-4120-8bca-9b3f01de69c8 tempest-VolumeAndVolumeTypeFromImageTest-726003660 None] Lock "cinder-d61beb52-89e9-4a92-922f-ee3a97c4326b-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:30:05 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-1c85ef1b-9e80-4120-8bca-9b3f01de69c8 tempest-VolumeAndVolumeTypeFromImageTest-726003660 None] Acquiring lock "cinder-quobyte-d61beb52-89e9-4a92-922f-ee3a97c4326b" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:30:05 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-1c85ef1b-9e80-4120-8bca-9b3f01de69c8 tempest-VolumeAndVolumeTypeFromImageTest-726003660 None] Lock "cinder-quobyte-d61beb52-89e9-4a92-922f-ee3a97c4326b" acquired by "delete_volume" :: waited 0.027s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:30:05 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f8fde53-2edf-4921-a156-eeac8ef919e3]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:30:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1c85ef1b-9e80-4120-8bca-9b3f01de69c8 tempest-VolumeAndVolumeTypeFromImageTest-726003660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d61beb52-89e9-4a92-922f-ee3a97c4326b {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:30:06 devstack sudo[100951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d61beb52-89e9-4a92-922f-ee3a97c4326b Nov 06 15:30:06 devstack sudo[100951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:30:06 devstack sudo[100946]: pam_unix(sudo:session): session closed for user root Nov 06 15:30:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-831c61d9-8052-4929-9907-8f63d4b64742 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-11616f75-19b0-4f87-9c5b-3b816610e6c3 1073741824" returned: 0 in 0.781s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:30:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-831c61d9-8052-4929-9907-8f63d4b64742 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-11616f75-19b0-4f87-9c5b-3b816610e6c3 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:30:06 devstack sudo[100954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-11616f75-19b0-4f87-9c5b-3b816610e6c3 Nov 06 15:30:06 devstack sudo[100954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:30:06 devstack sudo[100951]: pam_unix(sudo:session): session closed for user root Nov 06 15:30:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1c85ef1b-9e80-4120-8bca-9b3f01de69c8 tempest-VolumeAndVolumeTypeFromImageTest-726003660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d61beb52-89e9-4a92-922f-ee3a97c4326b" returned: 0 in 0.560s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:30:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1c85ef1b-9e80-4120-8bca-9b3f01de69c8 tempest-VolumeAndVolumeTypeFromImageTest-726003660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d61beb52-89e9-4a92-922f-ee3a97c4326b {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:30:06 devstack sudo[100960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d61beb52-89e9-4a92-922f-ee3a97c4326b Nov 06 15:30:06 devstack sudo[100960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:30:06 devstack sudo[100954]: pam_unix(sudo:session): session closed for user root Nov 06 15:30:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-831c61d9-8052-4929-9907-8f63d4b64742 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-11616f75-19b0-4f87-9c5b-3b816610e6c3" returned: 0 in 0.341s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:30:06 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-831c61d9-8052-4929-9907-8f63d4b64742 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] <== create_volume: return (1191ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:30:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-831c61d9-8052-4929-9907-8f63d4b64742 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.197s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:30:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-11af5922-8f6d-483e-bcae-62f13267e803 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.547s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:30:06 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-11af5922-8f6d-483e-bcae-62f13267e803 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:30:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2142856872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffc85cf6-16c1-47cc-af77-dcc62807923e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70c9518470a24c68a7196a66b2c164ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:30:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:30:04Z,use_quota=True,user_id='c257fe343c964084a948ebf655292bec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:30:06 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-11af5922-8f6d-483e-bcae-62f13267e803 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Creating volume ffc85cf6-16c1-47cc-af77-dcc62807923e {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:30:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-11af5922-8f6d-483e-bcae-62f13267e803 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:30:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-11af5922-8f6d-483e-bcae-62f13267e803 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:30:06 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-11af5922-8f6d-483e-bcae-62f13267e803 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:30:06 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-11af5922-8f6d-483e-bcae-62f13267e803 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:30:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-11af5922-8f6d-483e-bcae-62f13267e803 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:30:06 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-11af5922-8f6d-483e-bcae-62f13267e803 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:30:06 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-11af5922-8f6d-483e-bcae-62f13267e803 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:30:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-11af5922-8f6d-483e-bcae-62f13267e803 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ffc85cf6-16c1-47cc-af77-dcc62807923e 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:30:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-831c61d9-8052-4929-9907-8f63d4b64742 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7ba1c2d-331a-4a52-8656-e8fba10f429e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11616f75-19b0-4f87-9c5b-3b816610e6c3', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:30:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-831c61d9-8052-4929-9907-8f63d4b64742 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3349153b-b0de-4979-9960-d6931b8326b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:30:06 devstack sudo[100962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ffc85cf6-16c1-47cc-af77-dcc62807923e 1073741824 Nov 06 15:30:06 devstack sudo[100962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:30:06 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-831c61d9-8052-4929-9907-8f63d4b64742 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Volume volume-11616f75-19b0-4f87-9c5b-3b816610e6c3 (11616f75-19b0-4f87-9c5b-3b816610e6c3): created successfully Nov 06 15:30:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-831c61d9-8052-4929-9907-8f63d4b64742 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3349153b-b0de-4979-9960-d6931b8326b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:30:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-831c61d9-8052-4929-9907-8f63d4b64742 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Flow 'volume_create_manager' (8f26eaf5-1f8b-4b80-92a1-d9b2f2377621) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:30:06 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-831c61d9-8052-4929-9907-8f63d4b64742 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Created volume successfully. Nov 06 15:30:06 devstack sudo[100960]: pam_unix(sudo:session): session closed for user root Nov 06 15:30:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1c85ef1b-9e80-4120-8bca-9b3f01de69c8 tempest-VolumeAndVolumeTypeFromImageTest-726003660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d61beb52-89e9-4a92-922f-ee3a97c4326b" returned: 0 in 0.331s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:30:06 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-1c85ef1b-9e80-4120-8bca-9b3f01de69c8 tempest-VolumeAndVolumeTypeFromImageTest-726003660 None] Lock "cinder-quobyte-d61beb52-89e9-4a92-922f-ee3a97c4326b" released by "delete_volume" :: held 0.960s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:30:06 devstack cinder-volume[87132]: WARNING cinder.quota [None req-1c85ef1b-9e80-4120-8bca-9b3f01de69c8 tempest-VolumeAndVolumeTypeFromImageTest-726003660 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Nov 06 15:30:06 devstack cinder-volume[87132]: WARNING cinder.quota [None req-1c85ef1b-9e80-4120-8bca-9b3f01de69c8 tempest-VolumeAndVolumeTypeFromImageTest-726003660 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Nov 06 15:30:06 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-1c85ef1b-9e80-4120-8bca-9b3f01de69c8 tempest-VolumeAndVolumeTypeFromImageTest-726003660 None] Created reservations ['fd87a80d-ed12-4d64-939c-a4893d2c0cf0', '241f9725-2ade-4983-a878-db94c3c2d91a', '9d2ca09e-e202-4e0f-8b38-295547f18cf2', '9522a50b-a764-469a-8a5b-83eb8942df9a'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:30:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1c85ef1b-9e80-4120-8bca-9b3f01de69c8 tempest-VolumeAndVolumeTypeFromImageTest-726003660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:30:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1c85ef1b-9e80-4120-8bca-9b3f01de69c8 tempest-VolumeAndVolumeTypeFromImageTest-726003660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:30:07 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1c85ef1b-9e80-4120-8bca-9b3f01de69c8 tempest-VolumeAndVolumeTypeFromImageTest-726003660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:30:07 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1c85ef1b-9e80-4120-8bca-9b3f01de69c8 tempest-VolumeAndVolumeTypeFromImageTest-726003660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:30:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1c85ef1b-9e80-4120-8bca-9b3f01de69c8 tempest-VolumeAndVolumeTypeFromImageTest-726003660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:30:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1c85ef1b-9e80-4120-8bca-9b3f01de69c8 tempest-VolumeAndVolumeTypeFromImageTest-726003660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:30:07 devstack sudo[100968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:30:07 devstack sudo[100968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:30:07 devstack sudo[100962]: pam_unix(sudo:session): session closed for user root Nov 06 15:30:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-11af5922-8f6d-483e-bcae-62f13267e803 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ffc85cf6-16c1-47cc-af77-dcc62807923e 1073741824" returned: 0 in 0.696s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:30:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-11af5922-8f6d-483e-bcae-62f13267e803 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ffc85cf6-16c1-47cc-af77-dcc62807923e {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:30:07 devstack sudo[100968]: pam_unix(sudo:session): session closed for user root Nov 06 15:30:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1c85ef1b-9e80-4120-8bca-9b3f01de69c8 tempest-VolumeAndVolumeTypeFromImageTest-726003660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.351s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:30:07 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-1c85ef1b-9e80-4120-8bca-9b3f01de69c8 tempest-VolumeAndVolumeTypeFromImageTest-726003660 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:30:07 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-1c85ef1b-9e80-4120-8bca-9b3f01de69c8 tempest-VolumeAndVolumeTypeFromImageTest-726003660 None] Deleted volume successfully. Nov 06 15:30:07 devstack sudo[100972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ffc85cf6-16c1-47cc-af77-dcc62807923e Nov 06 15:30:07 devstack sudo[100972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:30:07 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-1c85ef1b-9e80-4120-8bca-9b3f01de69c8 tempest-VolumeAndVolumeTypeFromImageTest-726003660 None] Lock "cinder-d61beb52-89e9-4a92-922f-ee3a97c4326b-delete_volume" released by "delete_volume" :: held 1.617s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:30:07 devstack sudo[100972]: pam_unix(sudo:session): session closed for user root Nov 06 15:30:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-11af5922-8f6d-483e-bcae-62f13267e803 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ffc85cf6-16c1-47cc-af77-dcc62807923e" returned: 0 in 0.293s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:30:07 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-11af5922-8f6d-483e-bcae-62f13267e803 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] <== create_volume: return (1074ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:30:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-11af5922-8f6d-483e-bcae-62f13267e803 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.077s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:30:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-11af5922-8f6d-483e-bcae-62f13267e803 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab18c235-e6c1-4ffa-9b40-2b506338ced1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ffc85cf6-16c1-47cc-af77-dcc62807923e', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:30:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-11af5922-8f6d-483e-bcae-62f13267e803 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (770dd051-e42a-4f44-90d1-bd256e4ee09c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:30:07 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-11af5922-8f6d-483e-bcae-62f13267e803 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Volume volume-ffc85cf6-16c1-47cc-af77-dcc62807923e (ffc85cf6-16c1-47cc-af77-dcc62807923e): created successfully Nov 06 15:30:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-11af5922-8f6d-483e-bcae-62f13267e803 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (770dd051-e42a-4f44-90d1-bd256e4ee09c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:30:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-11af5922-8f6d-483e-bcae-62f13267e803 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Flow 'volume_create_manager' (1fd4665c-7a4f-4eeb-8da1-19a630b02dc5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:30:07 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-11af5922-8f6d-483e-bcae-62f13267e803 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Created volume successfully. Nov 06 15:30:08 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 15:30:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:30:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:30:08 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:30:08 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:30:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:30:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:30:08 devstack sudo[100975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:30:08 devstack sudo[100975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:30:08 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-4b6d2292-d689-4c1e-acda-cd2ca20a6917 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Acquiring lock "cinder-ffc85cf6-16c1-47cc-af77-dcc62807923e-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:30:08 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-4b6d2292-d689-4c1e-acda-cd2ca20a6917 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Lock "cinder-ffc85cf6-16c1-47cc-af77-dcc62807923e-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:30:08 devstack sudo[100975]: pam_unix(sudo:session): session closed for user root Nov 06 15:30:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.603s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:30:08 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:30:08 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Running periodic task VolumeManager._thread_info {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 15:30:08 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] thread count: 28 {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 15:30:08 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] thread info: [<_MainThread(MainThread, started 140011251929216)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 06 15:30:08 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-4b6d2292-d689-4c1e-acda-cd2ca20a6917 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Acquiring lock "cinder-quobyte-ffc85cf6-16c1-47cc-af77-dcc62807923e" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:30:08 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-4b6d2292-d689-4c1e-acda-cd2ca20a6917 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Lock "cinder-quobyte-ffc85cf6-16c1-47cc-af77-dcc62807923e" acquired by "delete_volume" :: waited 0.025s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:30:08 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[7682df8d-70d1-4e7f-b4f0-fbb761f91554]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:30:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4b6d2292-d689-4c1e-acda-cd2ca20a6917 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ffc85cf6-16c1-47cc-af77-dcc62807923e {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:30:08 devstack sudo[100978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ffc85cf6-16c1-47cc-af77-dcc62807923e Nov 06 15:30:08 devstack sudo[100978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:30:09 devstack sudo[100978]: pam_unix(sudo:session): session closed for user root Nov 06 15:30:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4b6d2292-d689-4c1e-acda-cd2ca20a6917 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ffc85cf6-16c1-47cc-af77-dcc62807923e" returned: 0 in 0.505s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:30:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4b6d2292-d689-4c1e-acda-cd2ca20a6917 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ffc85cf6-16c1-47cc-af77-dcc62807923e {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:30:09 devstack sudo[100983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ffc85cf6-16c1-47cc-af77-dcc62807923e Nov 06 15:30:09 devstack sudo[100983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:30:09 devstack sudo[100983]: pam_unix(sudo:session): session closed for user root Nov 06 15:30:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4b6d2292-d689-4c1e-acda-cd2ca20a6917 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ffc85cf6-16c1-47cc-af77-dcc62807923e" returned: 0 in 0.333s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:30:09 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-4b6d2292-d689-4c1e-acda-cd2ca20a6917 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Lock "cinder-quobyte-ffc85cf6-16c1-47cc-af77-dcc62807923e" released by "delete_volume" :: held 0.893s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:30:09 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-4b6d2292-d689-4c1e-acda-cd2ca20a6917 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Created reservations ['747dc01b-c1c2-4aaf-998c-77c5d9fd0ff1', '481ce3b0-0a02-4233-a786-5bca5d0b1133', '24ea6204-5cc3-436e-a92f-42a55ef003c9', 'e92a0ea9-8569-475c-8278-eb600a254be2'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:30:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4b6d2292-d689-4c1e-acda-cd2ca20a6917 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:30:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4b6d2292-d689-4c1e-acda-cd2ca20a6917 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:30:09 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-4b6d2292-d689-4c1e-acda-cd2ca20a6917 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:30:09 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-4b6d2292-d689-4c1e-acda-cd2ca20a6917 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:30:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4b6d2292-d689-4c1e-acda-cd2ca20a6917 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:30:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4b6d2292-d689-4c1e-acda-cd2ca20a6917 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:30:09 devstack sudo[100986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:30:09 devstack sudo[100986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:30:10 devstack sudo[100986]: pam_unix(sudo:session): session closed for user root Nov 06 15:30:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4b6d2292-d689-4c1e-acda-cd2ca20a6917 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.307s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:30:10 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-4b6d2292-d689-4c1e-acda-cd2ca20a6917 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:30:10 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-4b6d2292-d689-4c1e-acda-cd2ca20a6917 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Deleted volume successfully. Nov 06 15:30:10 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-4b6d2292-d689-4c1e-acda-cd2ca20a6917 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Lock "cinder-ffc85cf6-16c1-47cc-af77-dcc62807923e-delete_volume" released by "delete_volume" :: held 1.525s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:30:10 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-72d1f37a-e5cc-42a3-befe-04522bd22fff tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Acquiring lock "cinder-11616f75-19b0-4f87-9c5b-3b816610e6c3-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:30:10 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-72d1f37a-e5cc-42a3-befe-04522bd22fff tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Lock "cinder-11616f75-19b0-4f87-9c5b-3b816610e6c3-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:30:10 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-72d1f37a-e5cc-42a3-befe-04522bd22fff tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Acquiring lock "cinder-quobyte-11616f75-19b0-4f87-9c5b-3b816610e6c3" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:30:10 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-72d1f37a-e5cc-42a3-befe-04522bd22fff tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Lock "cinder-quobyte-11616f75-19b0-4f87-9c5b-3b816610e6c3" acquired by "delete_volume" :: waited 0.015s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:30:11 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1c25b54-d642-4a28-92cd-ed92a71ea472]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:30:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-72d1f37a-e5cc-42a3-befe-04522bd22fff tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-11616f75-19b0-4f87-9c5b-3b816610e6c3 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:30:11 devstack sudo[100989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-11616f75-19b0-4f87-9c5b-3b816610e6c3 Nov 06 15:30:11 devstack sudo[100989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:30:11 devstack sudo[100989]: pam_unix(sudo:session): session closed for user root Nov 06 15:30:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-72d1f37a-e5cc-42a3-befe-04522bd22fff tempest-CreateVolumesFromSourceVolumeTest-226981821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-11616f75-19b0-4f87-9c5b-3b816610e6c3" returned: 0 in 0.444s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:30:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-72d1f37a-e5cc-42a3-befe-04522bd22fff tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-11616f75-19b0-4f87-9c5b-3b816610e6c3 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:30:11 devstack sudo[100994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-11616f75-19b0-4f87-9c5b-3b816610e6c3 Nov 06 15:30:11 devstack sudo[100994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:30:11 devstack sudo[100994]: pam_unix(sudo:session): session closed for user root Nov 06 15:30:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-72d1f37a-e5cc-42a3-befe-04522bd22fff tempest-CreateVolumesFromSourceVolumeTest-226981821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-11616f75-19b0-4f87-9c5b-3b816610e6c3" returned: 0 in 0.327s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:30:11 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-72d1f37a-e5cc-42a3-befe-04522bd22fff tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Lock "cinder-quobyte-11616f75-19b0-4f87-9c5b-3b816610e6c3" released by "delete_volume" :: held 0.829s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:30:11 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-72d1f37a-e5cc-42a3-befe-04522bd22fff tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Created reservations ['352ebc57-8947-439d-9868-502ffb7732c6', '0a2ab83f-c3ae-4fa7-a736-62f45464dbc4', '86a5c28c-beb0-466c-bf4d-5e522381b259', '17bb6c0d-359f-41aa-8d22-a569b33a9ea2'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:30:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-72d1f37a-e5cc-42a3-befe-04522bd22fff tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:30:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-72d1f37a-e5cc-42a3-befe-04522bd22fff tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:30:11 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-72d1f37a-e5cc-42a3-befe-04522bd22fff tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:30:11 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-72d1f37a-e5cc-42a3-befe-04522bd22fff tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:30:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-72d1f37a-e5cc-42a3-befe-04522bd22fff tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:30:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-72d1f37a-e5cc-42a3-befe-04522bd22fff tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:30:11 devstack sudo[100997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:30:11 devstack sudo[100997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:30:12 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6942afd3-1471-4eb2-b1e2-a549251a5e34 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Acquiring lock "cinder-be9a7535-d0e2-4769-b1ef-4d44ca4c4e3d-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:30:12 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6942afd3-1471-4eb2-b1e2-a549251a5e34 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Lock "cinder-be9a7535-d0e2-4769-b1ef-4d44ca4c4e3d-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:30:12 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6942afd3-1471-4eb2-b1e2-a549251a5e34 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Acquiring lock "cinder-quobyte-be9a7535-d0e2-4769-b1ef-4d44ca4c4e3d" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:30:12 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6942afd3-1471-4eb2-b1e2-a549251a5e34 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Lock "cinder-quobyte-be9a7535-d0e2-4769-b1ef-4d44ca4c4e3d" acquired by "delete_volume" :: waited 0.025s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:30:12 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[ace642d2-aad5-4c85-a3a8-97d0a3ee8094]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:30:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6942afd3-1471-4eb2-b1e2-a549251a5e34 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-be9a7535-d0e2-4769-b1ef-4d44ca4c4e3d {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:30:12 devstack sudo[100997]: pam_unix(sudo:session): session closed for user root Nov 06 15:30:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-72d1f37a-e5cc-42a3-befe-04522bd22fff tempest-CreateVolumesFromSourceVolumeTest-226981821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.367s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:30:12 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-72d1f37a-e5cc-42a3-befe-04522bd22fff tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:30:12 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-72d1f37a-e5cc-42a3-befe-04522bd22fff tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Deleted volume successfully. Nov 06 15:30:12 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-72d1f37a-e5cc-42a3-befe-04522bd22fff tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Lock "cinder-11616f75-19b0-4f87-9c5b-3b816610e6c3-delete_volume" released by "delete_volume" :: held 1.457s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:30:12 devstack sudo[101000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-be9a7535-d0e2-4769-b1ef-4d44ca4c4e3d Nov 06 15:30:12 devstack sudo[101000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:30:12 devstack sudo[101000]: pam_unix(sudo:session): session closed for user root Nov 06 15:30:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6942afd3-1471-4eb2-b1e2-a549251a5e34 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-be9a7535-d0e2-4769-b1ef-4d44ca4c4e3d" returned: 0 in 0.482s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:30:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6942afd3-1471-4eb2-b1e2-a549251a5e34 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-be9a7535-d0e2-4769-b1ef-4d44ca4c4e3d {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:30:12 devstack sudo[101005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-be9a7535-d0e2-4769-b1ef-4d44ca4c4e3d Nov 06 15:30:12 devstack sudo[101005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:30:13 devstack sudo[101005]: pam_unix(sudo:session): session closed for user root Nov 06 15:30:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6942afd3-1471-4eb2-b1e2-a549251a5e34 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-be9a7535-d0e2-4769-b1ef-4d44ca4c4e3d" returned: 0 in 0.370s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:30:13 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6942afd3-1471-4eb2-b1e2-a549251a5e34 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Lock "cinder-quobyte-be9a7535-d0e2-4769-b1ef-4d44ca4c4e3d" released by "delete_volume" :: held 0.919s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:30:13 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-6942afd3-1471-4eb2-b1e2-a549251a5e34 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Created reservations ['d2614e1e-88eb-4d36-997f-08bb591a6f89', '43a4840b-cfdc-4c28-b53f-49a6b582463b', 'e31f62a6-459d-4e00-b378-4da238ef97a4', 'a97a4bbd-f80b-45c0-a379-a4f956bd2732'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:30:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6942afd3-1471-4eb2-b1e2-a549251a5e34 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:30:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6942afd3-1471-4eb2-b1e2-a549251a5e34 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:30:13 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-6942afd3-1471-4eb2-b1e2-a549251a5e34 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:30:13 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-6942afd3-1471-4eb2-b1e2-a549251a5e34 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:30:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6942afd3-1471-4eb2-b1e2-a549251a5e34 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:30:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6942afd3-1471-4eb2-b1e2-a549251a5e34 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:30:13 devstack sudo[101008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:30:13 devstack sudo[101008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:30:13 devstack sudo[101008]: pam_unix(sudo:session): session closed for user root Nov 06 15:30:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6942afd3-1471-4eb2-b1e2-a549251a5e34 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.283s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:30:13 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-6942afd3-1471-4eb2-b1e2-a549251a5e34 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:30:13 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-6942afd3-1471-4eb2-b1e2-a549251a5e34 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Deleted volume successfully. Nov 06 15:30:13 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6942afd3-1471-4eb2-b1e2-a549251a5e34 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Lock "cinder-be9a7535-d0e2-4769-b1ef-4d44ca4c4e3d-delete_volume" released by "delete_volume" :: held 1.592s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:30:14 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-28f2a91a-cc13-43c3-8185-3abec6edb30c tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Acquiring lock "cinder-2822cb30-f105-405b-9916-0977a993c404-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:30:14 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-28f2a91a-cc13-43c3-8185-3abec6edb30c tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Lock "cinder-2822cb30-f105-405b-9916-0977a993c404-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:30:14 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-28f2a91a-cc13-43c3-8185-3abec6edb30c tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Acquiring lock "cinder-quobyte-2822cb30-f105-405b-9916-0977a993c404" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:30:14 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-28f2a91a-cc13-43c3-8185-3abec6edb30c tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Lock "cinder-quobyte-2822cb30-f105-405b-9916-0977a993c404" acquired by "delete_volume" :: waited 0.017s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:30:14 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[b741e235-ca24-48c9-81e6-4ca49f531567]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:30:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-28f2a91a-cc13-43c3-8185-3abec6edb30c tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-2822cb30-f105-405b-9916-0977a993c404 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:30:14 devstack sudo[101011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-2822cb30-f105-405b-9916-0977a993c404 Nov 06 15:30:14 devstack sudo[101011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:30:14 devstack sudo[101011]: pam_unix(sudo:session): session closed for user root Nov 06 15:30:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-28f2a91a-cc13-43c3-8185-3abec6edb30c tempest-CreateVolumesFromSourceVolumeTest-226981821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-2822cb30-f105-405b-9916-0977a993c404" returned: 0 in 0.384s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:30:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-28f2a91a-cc13-43c3-8185-3abec6edb30c tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-2822cb30-f105-405b-9916-0977a993c404 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:30:14 devstack sudo[101017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-2822cb30-f105-405b-9916-0977a993c404 Nov 06 15:30:14 devstack sudo[101017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:30:15 devstack sudo[101017]: pam_unix(sudo:session): session closed for user root Nov 06 15:30:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-28f2a91a-cc13-43c3-8185-3abec6edb30c tempest-CreateVolumesFromSourceVolumeTest-226981821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-2822cb30-f105-405b-9916-0977a993c404" returned: 0 in 0.323s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:30:15 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-28f2a91a-cc13-43c3-8185-3abec6edb30c tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Lock "cinder-quobyte-2822cb30-f105-405b-9916-0977a993c404" released by "delete_volume" :: held 0.787s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:30:15 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-28f2a91a-cc13-43c3-8185-3abec6edb30c tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Created reservations ['79b1ee18-3d0f-44da-966f-e594905a6c3b', '13c42ff6-9ab6-4f43-85b9-c8499c1eea22', '68037c53-710e-429c-906b-a6e9851ba9a5', 'b5a7bb9f-69f8-469e-bcec-b39e35611af7'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:30:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-28f2a91a-cc13-43c3-8185-3abec6edb30c tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:30:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-28f2a91a-cc13-43c3-8185-3abec6edb30c tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:30:15 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-28f2a91a-cc13-43c3-8185-3abec6edb30c tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:30:15 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-28f2a91a-cc13-43c3-8185-3abec6edb30c tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:30:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-28f2a91a-cc13-43c3-8185-3abec6edb30c tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:30:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-28f2a91a-cc13-43c3-8185-3abec6edb30c tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:30:15 devstack sudo[101022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:30:15 devstack sudo[101022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:30:15 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c34400e3-348d-412c-aa66-c0e549d5ba80 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Acquiring lock "cinder-c71ca534-fa19-488e-8e9d-d9a4c1f05063-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:30:15 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c34400e3-348d-412c-aa66-c0e549d5ba80 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Lock "cinder-c71ca534-fa19-488e-8e9d-d9a4c1f05063-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:30:15 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c34400e3-348d-412c-aa66-c0e549d5ba80 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Acquiring lock "cinder-quobyte-c71ca534-fa19-488e-8e9d-d9a4c1f05063" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:30:15 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c34400e3-348d-412c-aa66-c0e549d5ba80 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Lock "cinder-quobyte-c71ca534-fa19-488e-8e9d-d9a4c1f05063" acquired by "delete_volume" :: waited 0.020s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:30:15 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[4627333d-44e1-42e1-86ea-fb8ba67ddb24]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:30:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c34400e3-348d-412c-aa66-c0e549d5ba80 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-c71ca534-fa19-488e-8e9d-d9a4c1f05063 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:30:15 devstack sudo[101022]: pam_unix(sudo:session): session closed for user root Nov 06 15:30:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-28f2a91a-cc13-43c3-8185-3abec6edb30c tempest-CreateVolumesFromSourceVolumeTest-226981821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.368s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:30:15 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-28f2a91a-cc13-43c3-8185-3abec6edb30c tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:30:15 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-28f2a91a-cc13-43c3-8185-3abec6edb30c tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Deleted volume successfully. Nov 06 15:30:15 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-28f2a91a-cc13-43c3-8185-3abec6edb30c tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Lock "cinder-2822cb30-f105-405b-9916-0977a993c404-delete_volume" released by "delete_volume" :: held 1.452s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:30:15 devstack sudo[101024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-c71ca534-fa19-488e-8e9d-d9a4c1f05063 Nov 06 15:30:15 devstack sudo[101024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:30:16 devstack sudo[101024]: pam_unix(sudo:session): session closed for user root Nov 06 15:30:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c34400e3-348d-412c-aa66-c0e549d5ba80 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-c71ca534-fa19-488e-8e9d-d9a4c1f05063" returned: 0 in 0.439s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:30:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c34400e3-348d-412c-aa66-c0e549d5ba80 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-c71ca534-fa19-488e-8e9d-d9a4c1f05063 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:30:16 devstack sudo[101030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-c71ca534-fa19-488e-8e9d-d9a4c1f05063 Nov 06 15:30:16 devstack sudo[101030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:30:16 devstack sudo[101030]: pam_unix(sudo:session): session closed for user root Nov 06 15:30:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c34400e3-348d-412c-aa66-c0e549d5ba80 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-c71ca534-fa19-488e-8e9d-d9a4c1f05063" returned: 0 in 0.292s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:30:16 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c34400e3-348d-412c-aa66-c0e549d5ba80 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Lock "cinder-quobyte-c71ca534-fa19-488e-8e9d-d9a4c1f05063" released by "delete_volume" :: held 0.798s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:30:16 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-c34400e3-348d-412c-aa66-c0e549d5ba80 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Created reservations ['7420739e-f31f-4aa6-85b8-fd38ff49b245', '850bff98-c0bf-4510-b239-18c7129beaca', '7b69db39-d319-4061-8802-dae64881d627', '8dfb9960-d52c-4a7e-88fe-67ad5c0839f7'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:30:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c34400e3-348d-412c-aa66-c0e549d5ba80 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:30:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c34400e3-348d-412c-aa66-c0e549d5ba80 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:30:16 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c34400e3-348d-412c-aa66-c0e549d5ba80 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:30:16 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c34400e3-348d-412c-aa66-c0e549d5ba80 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:30:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c34400e3-348d-412c-aa66-c0e549d5ba80 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:30:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c34400e3-348d-412c-aa66-c0e549d5ba80 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:30:16 devstack sudo[101033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:30:16 devstack sudo[101033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:30:16 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-4fc332a1-1765-4298-9b67-c62ee4bffc69 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Acquiring lock "cinder-6c7faa03-959e-4eff-9e68-10df4f1c4fa5-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:30:16 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-4fc332a1-1765-4298-9b67-c62ee4bffc69 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Lock "cinder-6c7faa03-959e-4eff-9e68-10df4f1c4fa5-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:30:16 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-4fc332a1-1765-4298-9b67-c62ee4bffc69 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Acquiring lock "cinder-quobyte-6c7faa03-959e-4eff-9e68-10df4f1c4fa5" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:30:17 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-4fc332a1-1765-4298-9b67-c62ee4bffc69 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Lock "cinder-quobyte-6c7faa03-959e-4eff-9e68-10df4f1c4fa5" acquired by "delete_volume" :: waited 0.024s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:30:17 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad458f87-1d51-4e6e-a951-81878c202c02]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:30:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4fc332a1-1765-4298-9b67-c62ee4bffc69 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-6c7faa03-959e-4eff-9e68-10df4f1c4fa5 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:30:17 devstack sudo[101033]: pam_unix(sudo:session): session closed for user root Nov 06 15:30:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c34400e3-348d-412c-aa66-c0e549d5ba80 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.372s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:30:17 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-c34400e3-348d-412c-aa66-c0e549d5ba80 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:30:17 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-c34400e3-348d-412c-aa66-c0e549d5ba80 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Deleted volume successfully. Nov 06 15:30:17 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c34400e3-348d-412c-aa66-c0e549d5ba80 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Lock "cinder-c71ca534-fa19-488e-8e9d-d9a4c1f05063-delete_volume" released by "delete_volume" :: held 1.479s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:30:17 devstack sudo[101036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-6c7faa03-959e-4eff-9e68-10df4f1c4fa5 Nov 06 15:30:17 devstack sudo[101036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:30:17 devstack sudo[101036]: pam_unix(sudo:session): session closed for user root Nov 06 15:30:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4fc332a1-1765-4298-9b67-c62ee4bffc69 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-6c7faa03-959e-4eff-9e68-10df4f1c4fa5" returned: 0 in 0.438s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:30:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4fc332a1-1765-4298-9b67-c62ee4bffc69 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-6c7faa03-959e-4eff-9e68-10df4f1c4fa5 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:30:17 devstack sudo[101042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-6c7faa03-959e-4eff-9e68-10df4f1c4fa5 Nov 06 15:30:17 devstack sudo[101042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:30:17 devstack sudo[101042]: pam_unix(sudo:session): session closed for user root Nov 06 15:30:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4fc332a1-1765-4298-9b67-c62ee4bffc69 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-6c7faa03-959e-4eff-9e68-10df4f1c4fa5" returned: 0 in 0.400s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:30:17 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-4fc332a1-1765-4298-9b67-c62ee4bffc69 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Lock "cinder-quobyte-6c7faa03-959e-4eff-9e68-10df4f1c4fa5" released by "delete_volume" :: held 0.910s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:30:17 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-4fc332a1-1765-4298-9b67-c62ee4bffc69 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Created reservations ['b65e91b2-3430-4597-b358-7039b271c1a6', '0dd4d3da-e83a-4841-8cb9-a00646939759', '04658d23-c32b-4be0-963e-35bb2530ccae', 'f8981d62-fee8-4ed7-83ac-9b9f3b41f5d2'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:30:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4fc332a1-1765-4298-9b67-c62ee4bffc69 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:30:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4fc332a1-1765-4298-9b67-c62ee4bffc69 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:30:18 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-4fc332a1-1765-4298-9b67-c62ee4bffc69 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:30:18 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-4fc332a1-1765-4298-9b67-c62ee4bffc69 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:30:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4fc332a1-1765-4298-9b67-c62ee4bffc69 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:30:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4fc332a1-1765-4298-9b67-c62ee4bffc69 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:30:18 devstack sudo[101045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:30:18 devstack sudo[101045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:30:18 devstack sudo[101045]: pam_unix(sudo:session): session closed for user root Nov 06 15:30:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4fc332a1-1765-4298-9b67-c62ee4bffc69 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.491s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:30:18 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-4fc332a1-1765-4298-9b67-c62ee4bffc69 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:30:18 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-4fc332a1-1765-4298-9b67-c62ee4bffc69 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Deleted volume successfully. Nov 06 15:30:18 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-4fc332a1-1765-4298-9b67-c62ee4bffc69 tempest-CreateVolumesFromSourceVolumeTest-226981821 None] Lock "cinder-6c7faa03-959e-4eff-9e68-10df4f1c4fa5-delete_volume" released by "delete_volume" :: held 1.737s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:30:19 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-da1b4518-49b6-4169-a3d1-6733efda7674 tempest-ProjectReaderTests-457792923 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:30:19 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-da1b4518-49b6-4169-a3d1-6733efda7674 tempest-ProjectReaderTests-457792923 None] Flow 'volume_create_manager' (99a9cac3-3f0c-4009-aaf8-6c36d861afad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:30:19 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-da1b4518-49b6-4169-a3d1-6733efda7674 tempest-ProjectReaderTests-457792923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92abfb3d-444a-4123-beb6-8c7022be8f97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:30:19 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-da1b4518-49b6-4169-a3d1-6733efda7674 tempest-ProjectReaderTests-457792923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92abfb3d-444a-4123-beb6-8c7022be8f97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:30:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1776384385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1456e3d-4b9a-471a-9c05-1db78c85b0c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdbfe2c89eb64308aede877800c4f090',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:30:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:30:20Z,use_quota=True,user_id='2246b936f88e4917b64cf2eb58897f40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:30:19 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-da1b4518-49b6-4169-a3d1-6733efda7674 tempest-ProjectReaderTests-457792923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5d93898-75ca-4533-b990-824c762a9022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:30:19 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-da1b4518-49b6-4169-a3d1-6733efda7674 tempest-ProjectReaderTests-457792923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5d93898-75ca-4533-b990-824c762a9022) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:30:19 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-da1b4518-49b6-4169-a3d1-6733efda7674 tempest-ProjectReaderTests-457792923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a193421-e720-47df-a54b-fa4d28e5e991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:30:19 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-da1b4518-49b6-4169-a3d1-6733efda7674 tempest-ProjectReaderTests-457792923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a193421-e720-47df-a54b-fa4d28e5e991) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1456e3d-4b9a-471a-9c05-1db78c85b0c0', 'volume_name': 'volume-d1456e3d-4b9a-471a-9c05-1db78c85b0c0', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:30:19 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-da1b4518-49b6-4169-a3d1-6733efda7674 tempest-ProjectReaderTests-457792923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f258409-9bed-40c0-9efe-3f9b650ce3e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:30:19 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-da1b4518-49b6-4169-a3d1-6733efda7674 tempest-ProjectReaderTests-457792923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f258409-9bed-40c0-9efe-3f9b650ce3e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:30:19 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-da1b4518-49b6-4169-a3d1-6733efda7674 tempest-ProjectReaderTests-457792923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68b99a70-8f5a-4b1b-b22a-70f8e96bcfa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:30:19 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-da1b4518-49b6-4169-a3d1-6733efda7674 tempest-ProjectReaderTests-457792923 None] Volume d1456e3d-4b9a-471a-9c05-1db78c85b0c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1456e3d-4b9a-471a-9c05-1db78c85b0c0', 'volume_size': 1} Nov 06 15:30:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-da1b4518-49b6-4169-a3d1-6733efda7674 tempest-ProjectReaderTests-457792923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:30:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-da1b4518-49b6-4169-a3d1-6733efda7674 tempest-ProjectReaderTests-457792923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:30:19 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-da1b4518-49b6-4169-a3d1-6733efda7674 tempest-ProjectReaderTests-457792923 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:30:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1776384385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1456e3d-4b9a-471a-9c05-1db78c85b0c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdbfe2c89eb64308aede877800c4f090',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:30:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:30:20Z,use_quota=True,user_id='2246b936f88e4917b64cf2eb58897f40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:30:19 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-da1b4518-49b6-4169-a3d1-6733efda7674 tempest-ProjectReaderTests-457792923 None] Creating volume d1456e3d-4b9a-471a-9c05-1db78c85b0c0 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:30:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-da1b4518-49b6-4169-a3d1-6733efda7674 tempest-ProjectReaderTests-457792923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:30:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-da1b4518-49b6-4169-a3d1-6733efda7674 tempest-ProjectReaderTests-457792923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:30:19 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-da1b4518-49b6-4169-a3d1-6733efda7674 tempest-ProjectReaderTests-457792923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:30:19 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-da1b4518-49b6-4169-a3d1-6733efda7674 tempest-ProjectReaderTests-457792923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:30:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-da1b4518-49b6-4169-a3d1-6733efda7674 tempest-ProjectReaderTests-457792923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:30:19 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-da1b4518-49b6-4169-a3d1-6733efda7674 tempest-ProjectReaderTests-457792923 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:30:19 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-da1b4518-49b6-4169-a3d1-6733efda7674 tempest-ProjectReaderTests-457792923 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:30:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-da1b4518-49b6-4169-a3d1-6733efda7674 tempest-ProjectReaderTests-457792923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d1456e3d-4b9a-471a-9c05-1db78c85b0c0 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:30:19 devstack sudo[101048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d1456e3d-4b9a-471a-9c05-1db78c85b0c0 1073741824 Nov 06 15:30:19 devstack sudo[101048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:30:20 devstack sudo[101048]: pam_unix(sudo:session): session closed for user root Nov 06 15:30:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-da1b4518-49b6-4169-a3d1-6733efda7674 tempest-ProjectReaderTests-457792923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d1456e3d-4b9a-471a-9c05-1db78c85b0c0 1073741824" returned: 0 in 0.596s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:30:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-da1b4518-49b6-4169-a3d1-6733efda7674 tempest-ProjectReaderTests-457792923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d1456e3d-4b9a-471a-9c05-1db78c85b0c0 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:30:20 devstack sudo[101054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d1456e3d-4b9a-471a-9c05-1db78c85b0c0 Nov 06 15:30:20 devstack sudo[101054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:30:20 devstack sudo[101054]: pam_unix(sudo:session): session closed for user root Nov 06 15:30:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-da1b4518-49b6-4169-a3d1-6733efda7674 tempest-ProjectReaderTests-457792923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d1456e3d-4b9a-471a-9c05-1db78c85b0c0" returned: 0 in 0.316s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:30:20 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-da1b4518-49b6-4169-a3d1-6733efda7674 tempest-ProjectReaderTests-457792923 None] <== create_volume: return (969ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:30:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-da1b4518-49b6-4169-a3d1-6733efda7674 tempest-ProjectReaderTests-457792923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.972s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:30:20 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-da1b4518-49b6-4169-a3d1-6733efda7674 tempest-ProjectReaderTests-457792923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68b99a70-8f5a-4b1b-b22a-70f8e96bcfa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1456e3d-4b9a-471a-9c05-1db78c85b0c0', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:30:20 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-da1b4518-49b6-4169-a3d1-6733efda7674 tempest-ProjectReaderTests-457792923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5426ca7-527d-43ce-b6c3-c343bf9edbc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:30:20 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-da1b4518-49b6-4169-a3d1-6733efda7674 tempest-ProjectReaderTests-457792923 None] Volume volume-d1456e3d-4b9a-471a-9c05-1db78c85b0c0 (d1456e3d-4b9a-471a-9c05-1db78c85b0c0): created successfully Nov 06 15:30:20 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-da1b4518-49b6-4169-a3d1-6733efda7674 tempest-ProjectReaderTests-457792923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5426ca7-527d-43ce-b6c3-c343bf9edbc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:30:20 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-da1b4518-49b6-4169-a3d1-6733efda7674 tempest-ProjectReaderTests-457792923 None] Flow 'volume_create_manager' (99a9cac3-3f0c-4009-aaf8-6c36d861afad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:30:20 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-da1b4518-49b6-4169-a3d1-6733efda7674 tempest-ProjectReaderTests-457792923 None] Created volume successfully. Nov 06 15:30:22 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-1dab592a-b82b-41ce-b890-d8d40876bd49 tempest-ProjectReaderTests-457792923 None] Acquiring lock "cinder-d1456e3d-4b9a-471a-9c05-1db78c85b0c0-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:30:22 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-1dab592a-b82b-41ce-b890-d8d40876bd49 tempest-ProjectReaderTests-457792923 None] Lock "cinder-d1456e3d-4b9a-471a-9c05-1db78c85b0c0-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:30:22 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-1dab592a-b82b-41ce-b890-d8d40876bd49 tempest-ProjectReaderTests-457792923 None] Acquiring lock "cinder-quobyte-d1456e3d-4b9a-471a-9c05-1db78c85b0c0" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:30:22 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-1dab592a-b82b-41ce-b890-d8d40876bd49 tempest-ProjectReaderTests-457792923 None] Lock "cinder-quobyte-d1456e3d-4b9a-471a-9c05-1db78c85b0c0" acquired by "delete_volume" :: waited 0.025s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:30:22 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1b4ac86-7622-4373-80cb-29e625f13d7b]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:30:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1dab592a-b82b-41ce-b890-d8d40876bd49 tempest-ProjectReaderTests-457792923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d1456e3d-4b9a-471a-9c05-1db78c85b0c0 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:30:22 devstack sudo[101057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d1456e3d-4b9a-471a-9c05-1db78c85b0c0 Nov 06 15:30:22 devstack sudo[101057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:30:22 devstack sudo[101057]: pam_unix(sudo:session): session closed for user root Nov 06 15:30:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1dab592a-b82b-41ce-b890-d8d40876bd49 tempest-ProjectReaderTests-457792923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d1456e3d-4b9a-471a-9c05-1db78c85b0c0" returned: 0 in 0.463s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:30:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1dab592a-b82b-41ce-b890-d8d40876bd49 tempest-ProjectReaderTests-457792923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d1456e3d-4b9a-471a-9c05-1db78c85b0c0 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:30:22 devstack sudo[101062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d1456e3d-4b9a-471a-9c05-1db78c85b0c0 Nov 06 15:30:22 devstack sudo[101062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:30:22 devstack sudo[101062]: pam_unix(sudo:session): session closed for user root Nov 06 15:30:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1dab592a-b82b-41ce-b890-d8d40876bd49 tempest-ProjectReaderTests-457792923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d1456e3d-4b9a-471a-9c05-1db78c85b0c0" returned: 0 in 0.307s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:30:23 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-1dab592a-b82b-41ce-b890-d8d40876bd49 tempest-ProjectReaderTests-457792923 None] Lock "cinder-quobyte-d1456e3d-4b9a-471a-9c05-1db78c85b0c0" released by "delete_volume" :: held 0.836s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:30:23 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-1dab592a-b82b-41ce-b890-d8d40876bd49 tempest-ProjectReaderTests-457792923 None] Created reservations ['549d8a5c-0632-45a2-83e6-c92f3a6983ed', 'e4e6a997-f784-4f56-b097-54e9d5a802c0', '9ab72eca-9e34-49db-8638-ce35841640c5', 'c01d8644-6ae4-4c79-8d6c-0c2fdbc7d244'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:30:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1dab592a-b82b-41ce-b890-d8d40876bd49 tempest-ProjectReaderTests-457792923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:30:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1dab592a-b82b-41ce-b890-d8d40876bd49 tempest-ProjectReaderTests-457792923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:30:23 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1dab592a-b82b-41ce-b890-d8d40876bd49 tempest-ProjectReaderTests-457792923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:30:23 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1dab592a-b82b-41ce-b890-d8d40876bd49 tempest-ProjectReaderTests-457792923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:30:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1dab592a-b82b-41ce-b890-d8d40876bd49 tempest-ProjectReaderTests-457792923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:30:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1dab592a-b82b-41ce-b890-d8d40876bd49 tempest-ProjectReaderTests-457792923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:30:23 devstack sudo[101065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:30:23 devstack sudo[101065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:30:23 devstack sudo[101065]: pam_unix(sudo:session): session closed for user root Nov 06 15:30:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1dab592a-b82b-41ce-b890-d8d40876bd49 tempest-ProjectReaderTests-457792923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.477s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:30:23 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-1dab592a-b82b-41ce-b890-d8d40876bd49 tempest-ProjectReaderTests-457792923 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:30:23 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-1dab592a-b82b-41ce-b890-d8d40876bd49 tempest-ProjectReaderTests-457792923 None] Deleted volume successfully. Nov 06 15:30:23 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-1dab592a-b82b-41ce-b890-d8d40876bd49 tempest-ProjectReaderTests-457792923 None] Lock "cinder-d1456e3d-4b9a-471a-9c05-1db78c85b0c0-delete_volume" released by "delete_volume" :: held 1.679s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:30:24 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-5763504b-0fa2-4b61-811c-297cb5e00bb5 tempest-ProjectReaderTests-457792923 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:30:24 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5763504b-0fa2-4b61-811c-297cb5e00bb5 tempest-ProjectReaderTests-457792923 None] Flow 'volume_create_manager' (c6db4050-813e-467f-923a-8efede6f517b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:30:24 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5763504b-0fa2-4b61-811c-297cb5e00bb5 tempest-ProjectReaderTests-457792923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95d9b245-6646-43c8-9b1a-ca3ef0c45dae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:30:24 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5763504b-0fa2-4b61-811c-297cb5e00bb5 tempest-ProjectReaderTests-457792923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95d9b245-6646-43c8-9b1a-ca3ef0c45dae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:30:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-232444380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3702b9c-7d13-43a3-a5d2-9ba71c62db15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdbfe2c89eb64308aede877800c4f090',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:30:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:30:24Z,use_quota=True,user_id='2246b936f88e4917b64cf2eb58897f40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:30:24 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5763504b-0fa2-4b61-811c-297cb5e00bb5 tempest-ProjectReaderTests-457792923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd2a77e2-abf3-445e-b9ea-c633bb8e0118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:30:24 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5763504b-0fa2-4b61-811c-297cb5e00bb5 tempest-ProjectReaderTests-457792923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd2a77e2-abf3-445e-b9ea-c633bb8e0118) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:30:24 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5763504b-0fa2-4b61-811c-297cb5e00bb5 tempest-ProjectReaderTests-457792923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5994d532-c8b5-4e6b-9a1c-894d29676611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:30:24 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5763504b-0fa2-4b61-811c-297cb5e00bb5 tempest-ProjectReaderTests-457792923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5994d532-c8b5-4e6b-9a1c-894d29676611) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3702b9c-7d13-43a3-a5d2-9ba71c62db15', 'volume_name': 'volume-a3702b9c-7d13-43a3-a5d2-9ba71c62db15', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:30:24 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5763504b-0fa2-4b61-811c-297cb5e00bb5 tempest-ProjectReaderTests-457792923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77367e68-f2f2-4fb1-b5f0-581d41426b09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:30:24 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5763504b-0fa2-4b61-811c-297cb5e00bb5 tempest-ProjectReaderTests-457792923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77367e68-f2f2-4fb1-b5f0-581d41426b09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:30:24 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5763504b-0fa2-4b61-811c-297cb5e00bb5 tempest-ProjectReaderTests-457792923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83981bcc-88ee-4d9a-8f5e-9d293df32070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:30:24 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-5763504b-0fa2-4b61-811c-297cb5e00bb5 tempest-ProjectReaderTests-457792923 None] Volume a3702b9c-7d13-43a3-a5d2-9ba71c62db15: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3702b9c-7d13-43a3-a5d2-9ba71c62db15', 'volume_size': 1} Nov 06 15:30:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5763504b-0fa2-4b61-811c-297cb5e00bb5 tempest-ProjectReaderTests-457792923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:30:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5763504b-0fa2-4b61-811c-297cb5e00bb5 tempest-ProjectReaderTests-457792923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:30:24 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-5763504b-0fa2-4b61-811c-297cb5e00bb5 tempest-ProjectReaderTests-457792923 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:30:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-232444380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3702b9c-7d13-43a3-a5d2-9ba71c62db15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdbfe2c89eb64308aede877800c4f090',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:30:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:30:24Z,use_quota=True,user_id='2246b936f88e4917b64cf2eb58897f40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:30:24 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-5763504b-0fa2-4b61-811c-297cb5e00bb5 tempest-ProjectReaderTests-457792923 None] Creating volume a3702b9c-7d13-43a3-a5d2-9ba71c62db15 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:30:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5763504b-0fa2-4b61-811c-297cb5e00bb5 tempest-ProjectReaderTests-457792923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:30:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5763504b-0fa2-4b61-811c-297cb5e00bb5 tempest-ProjectReaderTests-457792923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:30:24 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-5763504b-0fa2-4b61-811c-297cb5e00bb5 tempest-ProjectReaderTests-457792923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:30:24 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-5763504b-0fa2-4b61-811c-297cb5e00bb5 tempest-ProjectReaderTests-457792923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:30:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5763504b-0fa2-4b61-811c-297cb5e00bb5 tempest-ProjectReaderTests-457792923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:30:24 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-5763504b-0fa2-4b61-811c-297cb5e00bb5 tempest-ProjectReaderTests-457792923 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:30:24 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-5763504b-0fa2-4b61-811c-297cb5e00bb5 tempest-ProjectReaderTests-457792923 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:30:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5763504b-0fa2-4b61-811c-297cb5e00bb5 tempest-ProjectReaderTests-457792923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a3702b9c-7d13-43a3-a5d2-9ba71c62db15 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:30:24 devstack sudo[101068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a3702b9c-7d13-43a3-a5d2-9ba71c62db15 1073741824 Nov 06 15:30:24 devstack sudo[101068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:30:24 devstack sudo[101068]: pam_unix(sudo:session): session closed for user root Nov 06 15:30:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5763504b-0fa2-4b61-811c-297cb5e00bb5 tempest-ProjectReaderTests-457792923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a3702b9c-7d13-43a3-a5d2-9ba71c62db15 1073741824" returned: 0 in 0.696s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:30:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5763504b-0fa2-4b61-811c-297cb5e00bb5 tempest-ProjectReaderTests-457792923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a3702b9c-7d13-43a3-a5d2-9ba71c62db15 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:30:25 devstack sudo[101074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a3702b9c-7d13-43a3-a5d2-9ba71c62db15 Nov 06 15:30:25 devstack sudo[101074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:30:25 devstack sudo[101074]: pam_unix(sudo:session): session closed for user root Nov 06 15:30:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5763504b-0fa2-4b61-811c-297cb5e00bb5 tempest-ProjectReaderTests-457792923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a3702b9c-7d13-43a3-a5d2-9ba71c62db15" returned: 0 in 0.417s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:30:25 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-5763504b-0fa2-4b61-811c-297cb5e00bb5 tempest-ProjectReaderTests-457792923 None] <== create_volume: return (1212ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:30:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5763504b-0fa2-4b61-811c-297cb5e00bb5 tempest-ProjectReaderTests-457792923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.214s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:30:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5763504b-0fa2-4b61-811c-297cb5e00bb5 tempest-ProjectReaderTests-457792923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83981bcc-88ee-4d9a-8f5e-9d293df32070) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3702b9c-7d13-43a3-a5d2-9ba71c62db15', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:30:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5763504b-0fa2-4b61-811c-297cb5e00bb5 tempest-ProjectReaderTests-457792923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37fa36d8-73de-4f06-b065-a6cf94920f5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:30:25 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-5763504b-0fa2-4b61-811c-297cb5e00bb5 tempest-ProjectReaderTests-457792923 None] Volume volume-a3702b9c-7d13-43a3-a5d2-9ba71c62db15 (a3702b9c-7d13-43a3-a5d2-9ba71c62db15): created successfully Nov 06 15:30:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5763504b-0fa2-4b61-811c-297cb5e00bb5 tempest-ProjectReaderTests-457792923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37fa36d8-73de-4f06-b065-a6cf94920f5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:30:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5763504b-0fa2-4b61-811c-297cb5e00bb5 tempest-ProjectReaderTests-457792923 None] Flow 'volume_create_manager' (c6db4050-813e-467f-923a-8efede6f517b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:30:25 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-5763504b-0fa2-4b61-811c-297cb5e00bb5 tempest-ProjectReaderTests-457792923 None] Created volume successfully. Nov 06 15:30:26 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-43d2e043-9cfd-410a-83a4-0fbc2cd3bd3f tempest-ProjectReaderTests-457792923 None] Acquiring lock "cinder-a3702b9c-7d13-43a3-a5d2-9ba71c62db15-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:30:26 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-43d2e043-9cfd-410a-83a4-0fbc2cd3bd3f tempest-ProjectReaderTests-457792923 None] Lock "cinder-a3702b9c-7d13-43a3-a5d2-9ba71c62db15-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:30:26 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-43d2e043-9cfd-410a-83a4-0fbc2cd3bd3f tempest-ProjectReaderTests-457792923 None] Acquiring lock "cinder-quobyte-a3702b9c-7d13-43a3-a5d2-9ba71c62db15" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:30:26 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-43d2e043-9cfd-410a-83a4-0fbc2cd3bd3f tempest-ProjectReaderTests-457792923 None] Lock "cinder-quobyte-a3702b9c-7d13-43a3-a5d2-9ba71c62db15" acquired by "delete_volume" :: waited 0.026s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:30:26 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b00d9bd-4c1f-41bf-9d00-71d3c61b3f80]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:30:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-43d2e043-9cfd-410a-83a4-0fbc2cd3bd3f tempest-ProjectReaderTests-457792923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a3702b9c-7d13-43a3-a5d2-9ba71c62db15 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:30:26 devstack sudo[101078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a3702b9c-7d13-43a3-a5d2-9ba71c62db15 Nov 06 15:30:26 devstack sudo[101078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:30:27 devstack sudo[101078]: pam_unix(sudo:session): session closed for user root Nov 06 15:30:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-43d2e043-9cfd-410a-83a4-0fbc2cd3bd3f tempest-ProjectReaderTests-457792923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a3702b9c-7d13-43a3-a5d2-9ba71c62db15" returned: 0 in 0.549s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:30:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-43d2e043-9cfd-410a-83a4-0fbc2cd3bd3f tempest-ProjectReaderTests-457792923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a3702b9c-7d13-43a3-a5d2-9ba71c62db15 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:30:27 devstack sudo[101083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a3702b9c-7d13-43a3-a5d2-9ba71c62db15 Nov 06 15:30:27 devstack sudo[101083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:30:27 devstack sudo[101083]: pam_unix(sudo:session): session closed for user root Nov 06 15:30:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-43d2e043-9cfd-410a-83a4-0fbc2cd3bd3f tempest-ProjectReaderTests-457792923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a3702b9c-7d13-43a3-a5d2-9ba71c62db15" returned: 0 in 0.314s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:30:27 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-43d2e043-9cfd-410a-83a4-0fbc2cd3bd3f tempest-ProjectReaderTests-457792923 None] Lock "cinder-quobyte-a3702b9c-7d13-43a3-a5d2-9ba71c62db15" released by "delete_volume" :: held 0.924s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:30:27 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-43d2e043-9cfd-410a-83a4-0fbc2cd3bd3f tempest-ProjectReaderTests-457792923 None] Created reservations ['226f8d88-8da7-454c-8607-6da729ad60e6', '0bd2c2d2-1f31-4175-973b-39c529bff4f9', 'f395e06b-d219-418d-9736-bac8cff9d522', 'a38a1873-6cc6-42db-880f-dfaf06be89e6'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:30:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-43d2e043-9cfd-410a-83a4-0fbc2cd3bd3f tempest-ProjectReaderTests-457792923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:30:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-43d2e043-9cfd-410a-83a4-0fbc2cd3bd3f tempest-ProjectReaderTests-457792923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:30:27 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-43d2e043-9cfd-410a-83a4-0fbc2cd3bd3f tempest-ProjectReaderTests-457792923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:30:27 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-43d2e043-9cfd-410a-83a4-0fbc2cd3bd3f tempest-ProjectReaderTests-457792923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:30:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-43d2e043-9cfd-410a-83a4-0fbc2cd3bd3f tempest-ProjectReaderTests-457792923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:30:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-43d2e043-9cfd-410a-83a4-0fbc2cd3bd3f tempest-ProjectReaderTests-457792923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:30:27 devstack sudo[101086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:30:27 devstack sudo[101086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:30:27 devstack sudo[101086]: pam_unix(sudo:session): session closed for user root Nov 06 15:30:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-43d2e043-9cfd-410a-83a4-0fbc2cd3bd3f tempest-ProjectReaderTests-457792923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.300s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:30:27 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-43d2e043-9cfd-410a-83a4-0fbc2cd3bd3f tempest-ProjectReaderTests-457792923 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:30:27 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-43d2e043-9cfd-410a-83a4-0fbc2cd3bd3f tempest-ProjectReaderTests-457792923 None] Deleted volume successfully. Nov 06 15:30:27 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-43d2e043-9cfd-410a-83a4-0fbc2cd3bd3f tempest-ProjectReaderTests-457792923 None] Lock "cinder-a3702b9c-7d13-43a3-a5d2-9ba71c62db15-delete_volume" released by "delete_volume" :: held 1.582s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:30:29 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-012f9a38-dfa1-46f5-8302-44db8b0db2e0 tempest-VolumeImageDependencyTests-1011859502 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:30:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-012f9a38-dfa1-46f5-8302-44db8b0db2e0 tempest-VolumeImageDependencyTests-1011859502 None] Flow 'volume_create_manager' (29fc7c3c-e1cf-4a8a-9e21-997c54d8448f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:30:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-012f9a38-dfa1-46f5-8302-44db8b0db2e0 tempest-VolumeImageDependencyTests-1011859502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf8b5796-07b8-4fe6-b5a9-e577e7c934f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:30:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-012f9a38-dfa1-46f5-8302-44db8b0db2e0 tempest-VolumeImageDependencyTests-1011859502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf8b5796-07b8-4fe6-b5a9-e577e7c934f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:30:29Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdd29e82-8b08-477d-8c2b-928e3f68d392,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9eae110c43bb44f9b572051ff6eaf953',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:30:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:30:29Z,use_quota=True,user_id='c7cb39b30446452c8f18554eaef3d8b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:30:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-012f9a38-dfa1-46f5-8302-44db8b0db2e0 tempest-VolumeImageDependencyTests-1011859502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0798f246-2c50-4708-a47d-254098f71521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:30:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-012f9a38-dfa1-46f5-8302-44db8b0db2e0 tempest-VolumeImageDependencyTests-1011859502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0798f246-2c50-4708-a47d-254098f71521) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:30:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-012f9a38-dfa1-46f5-8302-44db8b0db2e0 tempest-VolumeImageDependencyTests-1011859502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a711dfd-8f11-45e1-aded-5d88535499e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:30:29 devstack cinder-volume[87132]: DEBUG cinder.image.glance [None req-012f9a38-dfa1-46f5-8302-44db8b0db2e0 tempest-VolumeImageDependencyTests-1011859502 None] Creating Keystone auth plugin from conf {{(pid=87132) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 06 15:30:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-012f9a38-dfa1-46f5-8302-44db8b0db2e0 tempest-VolumeImageDependencyTests-1011859502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a711dfd-8f11-45e1-aded-5d88535499e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'fdd29e82-8b08-477d-8c2b-928e3f68d392', 'volume_name': 'volume-fdd29e82-8b08-477d-8c2b-928e3f68d392', 'volume_size': 1, 'image_id': 'f080c367-c3dd-4df6-94e7-e84b9d4193ad', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f080c367-c3dd-4df6-94e7-e84b9d4193ad', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5f31a3e58d3e72b4b3ecf7695aba6c9f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9eae110c43bb44f9b572051ff6eaf953', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1a0fd7318680c551e13ed08403e0f3ec5d5bef76cd58777691aa6cc5fd4e86a01f96fb4c6edd44276352e5d2b167c88ba5694fd59d39537f9287fadbbdebb66f', 'id': 'f080c367-c3dd-4df6-94e7-e84b9d4193ad', 'created_at': datetime.datetime(2026, 11, 6, 14, 30, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 14, 30, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f080c367-c3dd-4df6-94e7-e84b9d4193ad/file', 'properties': {}}, 'image_service': }' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:30:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-012f9a38-dfa1-46f5-8302-44db8b0db2e0 tempest-VolumeImageDependencyTests-1011859502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd6b14d6-fa03-4df1-baad-d743c461ba87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:30:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-012f9a38-dfa1-46f5-8302-44db8b0db2e0 tempest-VolumeImageDependencyTests-1011859502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd6b14d6-fa03-4df1-baad-d743c461ba87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:30:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-012f9a38-dfa1-46f5-8302-44db8b0db2e0 tempest-VolumeImageDependencyTests-1011859502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc15f7d7-be3d-4d96-8f37-7f1c6bad12f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:30:30 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-012f9a38-dfa1-46f5-8302-44db8b0db2e0 tempest-VolumeImageDependencyTests-1011859502 None] Volume fdd29e82-8b08-477d-8c2b-928e3f68d392: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-fdd29e82-8b08-477d-8c2b-928e3f68d392', 'volume_size': 1, 'image_id': 'f080c367-c3dd-4df6-94e7-e84b9d4193ad', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f080c367-c3dd-4df6-94e7-e84b9d4193ad', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5f31a3e58d3e72b4b3ecf7695aba6c9f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9eae110c43bb44f9b572051ff6eaf953', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1a0fd7318680c551e13ed08403e0f3ec5d5bef76cd58777691aa6cc5fd4e86a01f96fb4c6edd44276352e5d2b167c88ba5694fd59d39537f9287fadbbdebb66f', 'id': 'f080c367-c3dd-4df6-94e7-e84b9d4193ad', 'created_at': datetime.datetime(2026, 11, 6, 14, 30, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 14, 30, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f080c367-c3dd-4df6-94e7-e84b9d4193ad/file', 'properties': {}}, 'image_service': } Nov 06 15:30:30 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-012f9a38-dfa1-46f5-8302-44db8b0db2e0 tempest-VolumeImageDependencyTests-1011859502 None] Trying to clone fdd29e82-8b08-477d-8c2b-928e3f68d392 from image f080c367-c3dd-4df6-94e7-e84b9d4193ad at location (None, [{'url': 'file:///opt/stack/data/glance/images/f080c367-c3dd-4df6-94e7-e84b9d4193ad', 'metadata': {}}]). {{(pid=87132) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 06 15:30:30 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-012f9a38-dfa1-46f5-8302-44db8b0db2e0 tempest-VolumeImageDependencyTests-1011859502 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f080c367-c3dd-4df6-94e7-e84b9d4193ad_kqgg9s0udevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87132) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 06 15:30:30 devstack cinder-volume[87132]: INFO cinder.image.image_utils [None req-012f9a38-dfa1-46f5-8302-44db8b0db2e0 tempest-VolumeImageDependencyTests-1011859502 None] Image download 0.00 MB at 0.00 MB/s Nov 06 15:30:30 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[d69ccb50-6ed4-4494-ad85-bc06485569a9]: (4, 'raw') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:30:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-012f9a38-dfa1-46f5-8302-44db8b0db2e0 tempest-VolumeImageDependencyTests-1011859502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f080c367-c3dd-4df6-94e7-e84b9d4193ad_kqgg9s0udevstack@QuobyteHD {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:30:30 devstack sudo[101093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f080c367-c3dd-4df6-94e7-e84b9d4193ad_kqgg9s0udevstack@QuobyteHD Nov 06 15:30:30 devstack sudo[101093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:30:30 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-f69b1701-8dfa-42c2-8472-0830d0b1728f tempest-SnapshotDependencyTests-907813795 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:30:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f69b1701-8dfa-42c2-8472-0830d0b1728f tempest-SnapshotDependencyTests-907813795 None] Flow 'volume_create_manager' (8f8834c3-d1f1-4ca2-a857-28cbc50095b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:30:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f69b1701-8dfa-42c2-8472-0830d0b1728f tempest-SnapshotDependencyTests-907813795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a315a468-333a-4f0f-b0ef-f556f52f577a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:30:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f69b1701-8dfa-42c2-8472-0830d0b1728f tempest-SnapshotDependencyTests-907813795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a315a468-333a-4f0f-b0ef-f556f52f577a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:30:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-124773141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e0f73b5-309c-4a82-bb9f-3260ec571f08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='442f2c6fa37843b8b993e1c0182936c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:30:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:30:31Z,use_quota=True,user_id='73ae0474848f48468cbcf93d4aa9952b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:30:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f69b1701-8dfa-42c2-8472-0830d0b1728f tempest-SnapshotDependencyTests-907813795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb8194f3-7129-4954-816f-3d07ef0dc06f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:30:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f69b1701-8dfa-42c2-8472-0830d0b1728f tempest-SnapshotDependencyTests-907813795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb8194f3-7129-4954-816f-3d07ef0dc06f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:30:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f69b1701-8dfa-42c2-8472-0830d0b1728f tempest-SnapshotDependencyTests-907813795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b72a803d-fda8-4c6d-80c8-33ca2ec60198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:30:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f69b1701-8dfa-42c2-8472-0830d0b1728f tempest-SnapshotDependencyTests-907813795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b72a803d-fda8-4c6d-80c8-33ca2ec60198) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e0f73b5-309c-4a82-bb9f-3260ec571f08', 'volume_name': 'volume-0e0f73b5-309c-4a82-bb9f-3260ec571f08', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:30:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f69b1701-8dfa-42c2-8472-0830d0b1728f tempest-SnapshotDependencyTests-907813795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f9b48cf-a343-40d6-ae28-56faf564f227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:30:30 devstack sudo[101093]: pam_unix(sudo:session): session closed for user root Nov 06 15:30:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f69b1701-8dfa-42c2-8472-0830d0b1728f tempest-SnapshotDependencyTests-907813795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f9b48cf-a343-40d6-ae28-56faf564f227) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:30:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f69b1701-8dfa-42c2-8472-0830d0b1728f tempest-SnapshotDependencyTests-907813795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81653922-6fee-4041-bfa2-71ea1d69d35e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:30:30 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-f69b1701-8dfa-42c2-8472-0830d0b1728f tempest-SnapshotDependencyTests-907813795 None] Volume 0e0f73b5-309c-4a82-bb9f-3260ec571f08: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e0f73b5-309c-4a82-bb9f-3260ec571f08', 'volume_size': 1} Nov 06 15:30:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f69b1701-8dfa-42c2-8472-0830d0b1728f tempest-SnapshotDependencyTests-907813795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:30:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f69b1701-8dfa-42c2-8472-0830d0b1728f tempest-SnapshotDependencyTests-907813795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:30:30 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-f69b1701-8dfa-42c2-8472-0830d0b1728f tempest-SnapshotDependencyTests-907813795 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:30:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-124773141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e0f73b5-309c-4a82-bb9f-3260ec571f08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='442f2c6fa37843b8b993e1c0182936c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:30:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:30:31Z,use_quota=True,user_id='73ae0474848f48468cbcf93d4aa9952b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:30:30 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-f69b1701-8dfa-42c2-8472-0830d0b1728f tempest-SnapshotDependencyTests-907813795 None] Creating volume 0e0f73b5-309c-4a82-bb9f-3260ec571f08 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:30:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f69b1701-8dfa-42c2-8472-0830d0b1728f tempest-SnapshotDependencyTests-907813795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:30:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f69b1701-8dfa-42c2-8472-0830d0b1728f tempest-SnapshotDependencyTests-907813795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:30:30 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-f69b1701-8dfa-42c2-8472-0830d0b1728f tempest-SnapshotDependencyTests-907813795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:30:30 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-f69b1701-8dfa-42c2-8472-0830d0b1728f tempest-SnapshotDependencyTests-907813795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:30:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f69b1701-8dfa-42c2-8472-0830d0b1728f tempest-SnapshotDependencyTests-907813795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:30:30 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-f69b1701-8dfa-42c2-8472-0830d0b1728f tempest-SnapshotDependencyTests-907813795 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:30:30 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-f69b1701-8dfa-42c2-8472-0830d0b1728f tempest-SnapshotDependencyTests-907813795 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:30:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f69b1701-8dfa-42c2-8472-0830d0b1728f tempest-SnapshotDependencyTests-907813795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0e0f73b5-309c-4a82-bb9f-3260ec571f08 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:30:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-012f9a38-dfa1-46f5-8302-44db8b0db2e0 tempest-VolumeImageDependencyTests-1011859502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f080c367-c3dd-4df6-94e7-e84b9d4193ad_kqgg9s0udevstack@QuobyteHD" returned: 0 in 0.494s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:30:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-012f9a38-dfa1-46f5-8302-44db8b0db2e0 tempest-VolumeImageDependencyTests-1011859502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f080c367-c3dd-4df6-94e7-e84b9d4193ad_kqgg9s0udevstack@QuobyteHD {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:30:30 devstack sudo[101101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0e0f73b5-309c-4a82-bb9f-3260ec571f08 1073741824 Nov 06 15:30:30 devstack sudo[101101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:30:31 devstack sudo[101104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f080c367-c3dd-4df6-94e7-e84b9d4193ad_kqgg9s0udevstack@QuobyteHD Nov 06 15:30:31 devstack sudo[101104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:30:31 devstack sudo[101104]: pam_unix(sudo:session): session closed for user root Nov 06 15:30:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-012f9a38-dfa1-46f5-8302-44db8b0db2e0 tempest-VolumeImageDependencyTests-1011859502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f080c367-c3dd-4df6-94e7-e84b9d4193ad_kqgg9s0udevstack@QuobyteHD" returned: 1 in 0.531s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:30:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-012f9a38-dfa1-46f5-8302-44db8b0db2e0 tempest-VolumeImageDependencyTests-1011859502 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f080c367-c3dd-4df6-94e7-e84b9d4193ad_kqgg9s0udevstack@QuobyteHD' failed. Not Retrying. {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 15:30:31 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-012f9a38-dfa1-46f5-8302-44db8b0db2e0 tempest-VolumeImageDependencyTests-1011859502 None] Temporary image f080c367-c3dd-4df6-94e7-e84b9d4193ad is fetched for user c7cb39b30446452c8f18554eaef3d8b9. {{(pid=87132) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 06 15:30:31 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ebfa2a3-a71f-47e9-a134-fb4f4fa3b1d1]: (4, 'raw') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:30:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-012f9a38-dfa1-46f5-8302-44db8b0db2e0 tempest-VolumeImageDependencyTests-1011859502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f080c367-c3dd-4df6-94e7-e84b9d4193ad_kqgg9s0udevstack@QuobyteHD {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:30:31 devstack sudo[101101]: pam_unix(sudo:session): session closed for user root Nov 06 15:30:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f69b1701-8dfa-42c2-8472-0830d0b1728f tempest-SnapshotDependencyTests-907813795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0e0f73b5-309c-4a82-bb9f-3260ec571f08 1073741824" returned: 0 in 0.832s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:30:31 devstack sudo[101126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f080c367-c3dd-4df6-94e7-e84b9d4193ad_kqgg9s0udevstack@QuobyteHD Nov 06 15:30:31 devstack sudo[101126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:30:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f69b1701-8dfa-42c2-8472-0830d0b1728f tempest-SnapshotDependencyTests-907813795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0e0f73b5-309c-4a82-bb9f-3260ec571f08 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:30:31 devstack sudo[101128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0e0f73b5-309c-4a82-bb9f-3260ec571f08 Nov 06 15:30:31 devstack sudo[101128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:30:31 devstack sudo[101126]: pam_unix(sudo:session): session closed for user root Nov 06 15:30:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-012f9a38-dfa1-46f5-8302-44db8b0db2e0 tempest-VolumeImageDependencyTests-1011859502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f080c367-c3dd-4df6-94e7-e84b9d4193ad_kqgg9s0udevstack@QuobyteHD" returned: 0 in 0.415s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:30:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-012f9a38-dfa1-46f5-8302-44db8b0db2e0 tempest-VolumeImageDependencyTests-1011859502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f080c367-c3dd-4df6-94e7-e84b9d4193ad_kqgg9s0udevstack@QuobyteHD {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:30:32 devstack sudo[101128]: pam_unix(sudo:session): session closed for user root Nov 06 15:30:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f69b1701-8dfa-42c2-8472-0830d0b1728f tempest-SnapshotDependencyTests-907813795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0e0f73b5-309c-4a82-bb9f-3260ec571f08" returned: 0 in 0.301s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:30:32 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-f69b1701-8dfa-42c2-8472-0830d0b1728f tempest-SnapshotDependencyTests-907813795 None] <== create_volume: return (1210ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:30:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f69b1701-8dfa-42c2-8472-0830d0b1728f tempest-SnapshotDependencyTests-907813795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.213s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:30:32 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f69b1701-8dfa-42c2-8472-0830d0b1728f tempest-SnapshotDependencyTests-907813795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81653922-6fee-4041-bfa2-71ea1d69d35e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e0f73b5-309c-4a82-bb9f-3260ec571f08', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:30:32 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f69b1701-8dfa-42c2-8472-0830d0b1728f tempest-SnapshotDependencyTests-907813795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9f975cd-ac9b-4dce-a7ab-c2e5d32b6989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:30:32 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-f69b1701-8dfa-42c2-8472-0830d0b1728f tempest-SnapshotDependencyTests-907813795 None] Volume volume-0e0f73b5-309c-4a82-bb9f-3260ec571f08 (0e0f73b5-309c-4a82-bb9f-3260ec571f08): created successfully Nov 06 15:30:32 devstack sudo[101132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f080c367-c3dd-4df6-94e7-e84b9d4193ad_kqgg9s0udevstack@QuobyteHD Nov 06 15:30:32 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f69b1701-8dfa-42c2-8472-0830d0b1728f tempest-SnapshotDependencyTests-907813795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9f975cd-ac9b-4dce-a7ab-c2e5d32b6989) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:30:32 devstack sudo[101132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:30:32 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f69b1701-8dfa-42c2-8472-0830d0b1728f tempest-SnapshotDependencyTests-907813795 None] Flow 'volume_create_manager' (8f8834c3-d1f1-4ca2-a857-28cbc50095b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:30:32 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-f69b1701-8dfa-42c2-8472-0830d0b1728f tempest-SnapshotDependencyTests-907813795 None] Created volume successfully. Nov 06 15:30:32 devstack sudo[101132]: pam_unix(sudo:session): session closed for user root Nov 06 15:30:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-012f9a38-dfa1-46f5-8302-44db8b0db2e0 tempest-VolumeImageDependencyTests-1011859502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f080c367-c3dd-4df6-94e7-e84b9d4193ad_kqgg9s0udevstack@QuobyteHD" returned: 1 in 0.381s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:30:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-012f9a38-dfa1-46f5-8302-44db8b0db2e0 tempest-VolumeImageDependencyTests-1011859502 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f080c367-c3dd-4df6-94e7-e84b9d4193ad_kqgg9s0udevstack@QuobyteHD' failed. Not Retrying. {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 15:30:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-012f9a38-dfa1-46f5-8302-44db8b0db2e0 tempest-VolumeImageDependencyTests-1011859502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:30:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-012f9a38-dfa1-46f5-8302-44db8b0db2e0 tempest-VolumeImageDependencyTests-1011859502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:30:32 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-012f9a38-dfa1-46f5-8302-44db8b0db2e0 tempest-VolumeImageDependencyTests-1011859502 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:30:29Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdd29e82-8b08-477d-8c2b-928e3f68d392,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9eae110c43bb44f9b572051ff6eaf953',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:30:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:30:29Z,use_quota=True,user_id='c7cb39b30446452c8f18554eaef3d8b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:30:32 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-012f9a38-dfa1-46f5-8302-44db8b0db2e0 tempest-VolumeImageDependencyTests-1011859502 None] Creating volume fdd29e82-8b08-477d-8c2b-928e3f68d392 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:30:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-012f9a38-dfa1-46f5-8302-44db8b0db2e0 tempest-VolumeImageDependencyTests-1011859502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:30:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-012f9a38-dfa1-46f5-8302-44db8b0db2e0 tempest-VolumeImageDependencyTests-1011859502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:30:32 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-012f9a38-dfa1-46f5-8302-44db8b0db2e0 tempest-VolumeImageDependencyTests-1011859502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:30:32 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-012f9a38-dfa1-46f5-8302-44db8b0db2e0 tempest-VolumeImageDependencyTests-1011859502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:30:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-012f9a38-dfa1-46f5-8302-44db8b0db2e0 tempest-VolumeImageDependencyTests-1011859502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:30:32 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-012f9a38-dfa1-46f5-8302-44db8b0db2e0 tempest-VolumeImageDependencyTests-1011859502 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:30:32 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-012f9a38-dfa1-46f5-8302-44db8b0db2e0 tempest-VolumeImageDependencyTests-1011859502 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:30:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-012f9a38-dfa1-46f5-8302-44db8b0db2e0 tempest-VolumeImageDependencyTests-1011859502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-fdd29e82-8b08-477d-8c2b-928e3f68d392 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:30:32 devstack sudo[101139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-fdd29e82-8b08-477d-8c2b-928e3f68d392 1073741824 Nov 06 15:30:32 devstack sudo[101139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:30:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-63dbcbc6-5ce9-430d-ae3e-efe2ba8672ce tempest-SnapshotDependencyTests-907813795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:30:32 devstack sudo[101139]: pam_unix(sudo:session): session closed for user root Nov 06 15:30:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-012f9a38-dfa1-46f5-8302-44db8b0db2e0 tempest-VolumeImageDependencyTests-1011859502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-fdd29e82-8b08-477d-8c2b-928e3f68d392 1073741824" returned: 0 in 0.635s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:30:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-012f9a38-dfa1-46f5-8302-44db8b0db2e0 tempest-VolumeImageDependencyTests-1011859502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-fdd29e82-8b08-477d-8c2b-928e3f68d392 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:30:33 devstack sudo[101146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-fdd29e82-8b08-477d-8c2b-928e3f68d392 Nov 06 15:30:33 devstack sudo[101146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:30:33 devstack sudo[101146]: pam_unix(sudo:session): session closed for user root Nov 06 15:30:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-012f9a38-dfa1-46f5-8302-44db8b0db2e0 tempest-VolumeImageDependencyTests-1011859502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-fdd29e82-8b08-477d-8c2b-928e3f68d392" returned: 0 in 0.393s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:30:33 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-012f9a38-dfa1-46f5-8302-44db8b0db2e0 tempest-VolumeImageDependencyTests-1011859502 None] <== create_volume: return (1088ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:30:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-012f9a38-dfa1-46f5-8302-44db8b0db2e0 tempest-VolumeImageDependencyTests-1011859502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.092s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:30:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-63dbcbc6-5ce9-430d-ae3e-efe2ba8672ce tempest-SnapshotDependencyTests-907813795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.487s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:30:33 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-63dbcbc6-5ce9-430d-ae3e-efe2ba8672ce tempest-SnapshotDependencyTests-907813795 None] Creating offline snapshot 73b6ccb7-201e-4969-bb25-48a9f3a1aca1 of volume 0e0f73b5-309c-4a82-bb9f-3260ec571f08 {{(pid=87132) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 15:30:33 devstack cinder-volume[87132]: DEBUG cinder.volume.volume_utils [None req-012f9a38-dfa1-46f5-8302-44db8b0db2e0 tempest-VolumeImageDependencyTests-1011859502 None] Attempting download of f080c367-c3dd-4df6-94e7-e84b9d4193ad ((None, [{'url': 'file:///opt/stack/data/glance/images/f080c367-c3dd-4df6-94e7-e84b9d4193ad', 'metadata': {}}])) to volume fdd29e82-8b08-477d-8c2b-928e3f68d392. {{(pid=87132) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 06 15:30:33 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[36e6dc22-2e56-49d4-b2d8-3a391e57d32d]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:30:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-63dbcbc6-5ce9-430d-ae3e-efe2ba8672ce tempest-SnapshotDependencyTests-907813795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0e0f73b5-309c-4a82-bb9f-3260ec571f08 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:30:33 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[a721cfef-9b26-435d-99db-dd34d6a71602]: (4, 'raw') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:30:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-012f9a38-dfa1-46f5-8302-44db8b0db2e0 tempest-VolumeImageDependencyTests-1011859502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f080c367-c3dd-4df6-94e7-e84b9d4193ad_jga8vltm {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:30:33 devstack sudo[101149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0e0f73b5-309c-4a82-bb9f-3260ec571f08 Nov 06 15:30:33 devstack sudo[101149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:30:33 devstack sudo[101150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f080c367-c3dd-4df6-94e7-e84b9d4193ad_jga8vltm Nov 06 15:30:33 devstack sudo[101150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:30:34 devstack sudo[101150]: pam_unix(sudo:session): session closed for user root Nov 06 15:30:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-012f9a38-dfa1-46f5-8302-44db8b0db2e0 tempest-VolumeImageDependencyTests-1011859502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f080c367-c3dd-4df6-94e7-e84b9d4193ad_jga8vltm" returned: 0 in 0.560s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:30:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-012f9a38-dfa1-46f5-8302-44db8b0db2e0 tempest-VolumeImageDependencyTests-1011859502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f080c367-c3dd-4df6-94e7-e84b9d4193ad_jga8vltm {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:30:34 devstack sudo[101149]: pam_unix(sudo:session): session closed for user root Nov 06 15:30:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-63dbcbc6-5ce9-430d-ae3e-efe2ba8672ce tempest-SnapshotDependencyTests-907813795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0e0f73b5-309c-4a82-bb9f-3260ec571f08" returned: 0 in 0.645s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:30:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-63dbcbc6-5ce9-430d-ae3e-efe2ba8672ce tempest-SnapshotDependencyTests-907813795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0e0f73b5-309c-4a82-bb9f-3260ec571f08,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0e0f73b5-309c-4a82-bb9f-3260ec571f08.73b6ccb7-201e-4969-bb25-48a9f3a1aca1 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:30:34 devstack sudo[101177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0e0f73b5-309c-4a82-bb9f-3260ec571f08,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0e0f73b5-309c-4a82-bb9f-3260ec571f08.73b6ccb7-201e-4969-bb25-48a9f3a1aca1 1G Nov 06 15:30:34 devstack sudo[101177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:30:34 devstack sudo[101173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f080c367-c3dd-4df6-94e7-e84b9d4193ad_jga8vltm Nov 06 15:30:34 devstack sudo[101173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:30:34 devstack sudo[101173]: pam_unix(sudo:session): session closed for user root Nov 06 15:30:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-012f9a38-dfa1-46f5-8302-44db8b0db2e0 tempest-VolumeImageDependencyTests-1011859502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f080c367-c3dd-4df6-94e7-e84b9d4193ad_jga8vltm" returned: 1 in 0.488s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:30:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-012f9a38-dfa1-46f5-8302-44db8b0db2e0 tempest-VolumeImageDependencyTests-1011859502 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f080c367-c3dd-4df6-94e7-e84b9d4193ad_jga8vltm' failed. Not Retrying. {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 15:30:34 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f905ef1-f5c1-4f5d-8490-cfbd7593b2e4]: (4, 'raw') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:30:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-012f9a38-dfa1-46f5-8302-44db8b0db2e0 tempest-VolumeImageDependencyTests-1011859502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f080c367-c3dd-4df6-94e7-e84b9d4193ad_kqgg9s0udevstack@QuobyteHD {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:30:34 devstack sudo[101216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f080c367-c3dd-4df6-94e7-e84b9d4193ad_kqgg9s0udevstack@QuobyteHD Nov 06 15:30:34 devstack sudo[101216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:30:35 devstack sudo[101216]: pam_unix(sudo:session): session closed for user root Nov 06 15:30:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-012f9a38-dfa1-46f5-8302-44db8b0db2e0 tempest-VolumeImageDependencyTests-1011859502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f080c367-c3dd-4df6-94e7-e84b9d4193ad_kqgg9s0udevstack@QuobyteHD" returned: 0 in 0.528s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:30:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-012f9a38-dfa1-46f5-8302-44db8b0db2e0 tempest-VolumeImageDependencyTests-1011859502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f080c367-c3dd-4df6-94e7-e84b9d4193ad_kqgg9s0udevstack@QuobyteHD {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:30:35 devstack sudo[101177]: pam_unix(sudo:session): session closed for user root Nov 06 15:30:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-63dbcbc6-5ce9-430d-ae3e-efe2ba8672ce tempest-SnapshotDependencyTests-907813795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0e0f73b5-309c-4a82-bb9f-3260ec571f08,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0e0f73b5-309c-4a82-bb9f-3260ec571f08.73b6ccb7-201e-4969-bb25-48a9f3a1aca1 1G" returned: 0 in 1.015s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:30:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-63dbcbc6-5ce9-430d-ae3e-efe2ba8672ce tempest-SnapshotDependencyTests-907813795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e0f73b5-309c-4a82-bb9f-3260ec571f08 -F qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0e0f73b5-309c-4a82-bb9f-3260ec571f08.73b6ccb7-201e-4969-bb25-48a9f3a1aca1 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:30:35 devstack sudo[101234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e0f73b5-309c-4a82-bb9f-3260ec571f08 -F qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0e0f73b5-309c-4a82-bb9f-3260ec571f08.73b6ccb7-201e-4969-bb25-48a9f3a1aca1 Nov 06 15:30:35 devstack sudo[101234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:30:35 devstack sudo[101233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f080c367-c3dd-4df6-94e7-e84b9d4193ad_kqgg9s0udevstack@QuobyteHD Nov 06 15:30:35 devstack sudo[101233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:30:35 devstack sudo[101234]: pam_unix(sudo:session): session closed for user root Nov 06 15:30:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-63dbcbc6-5ce9-430d-ae3e-efe2ba8672ce tempest-SnapshotDependencyTests-907813795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e0f73b5-309c-4a82-bb9f-3260ec571f08 -F qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0e0f73b5-309c-4a82-bb9f-3260ec571f08.73b6ccb7-201e-4969-bb25-48a9f3a1aca1" returned: 0 in 0.469s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:30:35 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-63dbcbc6-5ce9-430d-ae3e-efe2ba8672ce tempest-SnapshotDependencyTests-907813795 None] /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0e0f73b5-309c-4a82-bb9f-3260ec571f08.73b6ccb7-201e-4969-bb25-48a9f3a1aca1 is being set with open permissions: ugo+rw Nov 06 15:30:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-63dbcbc6-5ce9-430d-ae3e-efe2ba8672ce tempest-SnapshotDependencyTests-907813795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0e0f73b5-309c-4a82-bb9f-3260ec571f08.73b6ccb7-201e-4969-bb25-48a9f3a1aca1 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:30:35 devstack sudo[101246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0e0f73b5-309c-4a82-bb9f-3260ec571f08.73b6ccb7-201e-4969-bb25-48a9f3a1aca1 Nov 06 15:30:35 devstack sudo[101246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:30:35 devstack sudo[101233]: pam_unix(sudo:session): session closed for user root Nov 06 15:30:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-012f9a38-dfa1-46f5-8302-44db8b0db2e0 tempest-VolumeImageDependencyTests-1011859502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f080c367-c3dd-4df6-94e7-e84b9d4193ad_kqgg9s0udevstack@QuobyteHD" returned: 1 in 0.642s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:30:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-012f9a38-dfa1-46f5-8302-44db8b0db2e0 tempest-VolumeImageDependencyTests-1011859502 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f080c367-c3dd-4df6-94e7-e84b9d4193ad_kqgg9s0udevstack@QuobyteHD' failed. Not Retrying. {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 15:30:35 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-012f9a38-dfa1-46f5-8302-44db8b0db2e0 tempest-VolumeImageDependencyTests-1011859502 None] f080c367-c3dd-4df6-94e7-e84b9d4193ad was raw, converting to qcow2 {{(pid=87132) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 06 15:30:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-012f9a38-dfa1-46f5-8302-44db8b0db2e0 tempest-VolumeImageDependencyTests-1011859502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f080c367-c3dd-4df6-94e7-e84b9d4193ad_kqgg9s0udevstack@QuobyteHD /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-fdd29e82-8b08-477d-8c2b-928e3f68d392 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:30:35 devstack sudo[101253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f080c367-c3dd-4df6-94e7-e84b9d4193ad_kqgg9s0udevstack@QuobyteHD /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-fdd29e82-8b08-477d-8c2b-928e3f68d392 Nov 06 15:30:35 devstack sudo[101253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:30:36 devstack sudo[101246]: pam_unix(sudo:session): session closed for user root Nov 06 15:30:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-63dbcbc6-5ce9-430d-ae3e-efe2ba8672ce tempest-SnapshotDependencyTests-907813795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0e0f73b5-309c-4a82-bb9f-3260ec571f08.73b6ccb7-201e-4969-bb25-48a9f3a1aca1" returned: 0 in 0.478s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:30:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-63dbcbc6-5ce9-430d-ae3e-efe2ba8672ce tempest-SnapshotDependencyTests-907813795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0e0f73b5-309c-4a82-bb9f-3260ec571f08.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:30:36 devstack sudo[101257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0e0f73b5-309c-4a82-bb9f-3260ec571f08.info Nov 06 15:30:36 devstack sudo[101257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:30:36 devstack sudo[101257]: pam_unix(sudo:session): session closed for user root Nov 06 15:30:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-63dbcbc6-5ce9-430d-ae3e-efe2ba8672ce tempest-SnapshotDependencyTests-907813795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0e0f73b5-309c-4a82-bb9f-3260ec571f08.info" returned: 0 in 0.490s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:30:36 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-63dbcbc6-5ce9-430d-ae3e-efe2ba8672ce tempest-SnapshotDependencyTests-907813795 None] /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0e0f73b5-309c-4a82-bb9f-3260ec571f08.info is being set with open permissions: ugo+rw Nov 06 15:30:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-63dbcbc6-5ce9-430d-ae3e-efe2ba8672ce tempest-SnapshotDependencyTests-907813795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0e0f73b5-309c-4a82-bb9f-3260ec571f08.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:30:36 devstack sudo[101264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0e0f73b5-309c-4a82-bb9f-3260ec571f08.info Nov 06 15:30:36 devstack sudo[101264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:30:36 devstack sudo[101253]: pam_unix(sudo:session): session closed for user root Nov 06 15:30:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-012f9a38-dfa1-46f5-8302-44db8b0db2e0 tempest-VolumeImageDependencyTests-1011859502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f080c367-c3dd-4df6-94e7-e84b9d4193ad_kqgg9s0udevstack@QuobyteHD /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-fdd29e82-8b08-477d-8c2b-928e3f68d392" returned: 0 in 0.987s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:30:36 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-012f9a38-dfa1-46f5-8302-44db8b0db2e0 tempest-VolumeImageDependencyTests-1011859502 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f080c367-c3dd-4df6-94e7-e84b9d4193ad_kqgg9s0udevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-fdd29e82-8b08-477d-8c2b-928e3f68d392 {{(pid=87132) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 06 15:30:36 devstack cinder-volume[87132]: INFO cinder.image.image_utils [None req-012f9a38-dfa1-46f5-8302-44db8b0db2e0 tempest-VolumeImageDependencyTests-1011859502 None] Converted 0.00 MB image at 0.00 MB/s Nov 06 15:30:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-012f9a38-dfa1-46f5-8302-44db8b0db2e0 tempest-VolumeImageDependencyTests-1011859502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-fdd29e82-8b08-477d-8c2b-928e3f68d392 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:30:36 devstack sudo[101266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-fdd29e82-8b08-477d-8c2b-928e3f68d392 1G Nov 06 15:30:36 devstack sudo[101266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:30:37 devstack sudo[101264]: pam_unix(sudo:session): session closed for user root Nov 06 15:30:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-63dbcbc6-5ce9-430d-ae3e-efe2ba8672ce tempest-SnapshotDependencyTests-907813795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0e0f73b5-309c-4a82-bb9f-3260ec571f08.info" returned: 0 in 0.362s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:30:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-63dbcbc6-5ce9-430d-ae3e-efe2ba8672ce tempest-SnapshotDependencyTests-907813795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.618s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:30:37 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-63dbcbc6-5ce9-430d-ae3e-efe2ba8672ce tempest-SnapshotDependencyTests-907813795 None] Create snapshot completed successfully Nov 06 15:30:37 devstack sudo[101266]: pam_unix(sudo:session): session closed for user root Nov 06 15:30:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-012f9a38-dfa1-46f5-8302-44db8b0db2e0 tempest-VolumeImageDependencyTests-1011859502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-fdd29e82-8b08-477d-8c2b-928e3f68d392 1G" returned: 0 in 0.492s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:30:37 devstack cinder-volume[87132]: DEBUG cinder.volume.volume_utils [None req-012f9a38-dfa1-46f5-8302-44db8b0db2e0 tempest-VolumeImageDependencyTests-1011859502 None] Downloaded image f080c367-c3dd-4df6-94e7-e84b9d4193ad ((None, [{'url': 'file:///opt/stack/data/glance/images/f080c367-c3dd-4df6-94e7-e84b9d4193ad', 'metadata': {}}])) to volume fdd29e82-8b08-477d-8c2b-928e3f68d392 successfully. {{(pid=87132) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 06 15:30:37 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-012f9a38-dfa1-46f5-8302-44db8b0db2e0 tempest-VolumeImageDependencyTests-1011859502 None] Temporary image f080c367-c3dd-4df6-94e7-e84b9d4193ad for user c7cb39b30446452c8f18554eaef3d8b9 is deleted. {{(pid=87132) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 06 15:30:37 devstack cinder-volume[87132]: DEBUG cinder.volume.volume_utils [None req-012f9a38-dfa1-46f5-8302-44db8b0db2e0 tempest-VolumeImageDependencyTests-1011859502 None] Marking volume fdd29e82-8b08-477d-8c2b-928e3f68d392 as bootable. {{(pid=87132) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 06 15:30:37 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-012f9a38-dfa1-46f5-8302-44db8b0db2e0 tempest-VolumeImageDependencyTests-1011859502 None] Copying metadata from image f080c367-c3dd-4df6-94e7-e84b9d4193ad to fdd29e82-8b08-477d-8c2b-928e3f68d392. {{(pid=87132) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 06 15:30:37 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-012f9a38-dfa1-46f5-8302-44db8b0db2e0 tempest-VolumeImageDependencyTests-1011859502 None] Creating volume glance metadata for volume fdd29e82-8b08-477d-8c2b-928e3f68d392 backed by image f080c367-c3dd-4df6-94e7-e84b9d4193ad with: {'image_id': 'f080c367-c3dd-4df6-94e7-e84b9d4193ad', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '5f31a3e58d3e72b4b3ecf7695aba6c9f', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87132) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 06 15:30:37 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-012f9a38-dfa1-46f5-8302-44db8b0db2e0 tempest-VolumeImageDependencyTests-1011859502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc15f7d7-be3d-4d96-8f37-7f1c6bad12f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fdd29e82-8b08-477d-8c2b-928e3f68d392', 'volume_size': 1, 'image_id': 'f080c367-c3dd-4df6-94e7-e84b9d4193ad', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f080c367-c3dd-4df6-94e7-e84b9d4193ad', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5f31a3e58d3e72b4b3ecf7695aba6c9f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9eae110c43bb44f9b572051ff6eaf953', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1a0fd7318680c551e13ed08403e0f3ec5d5bef76cd58777691aa6cc5fd4e86a01f96fb4c6edd44276352e5d2b167c88ba5694fd59d39537f9287fadbbdebb66f', 'id': 'f080c367-c3dd-4df6-94e7-e84b9d4193ad', 'created_at': datetime.datetime(2026, 11, 6, 14, 30, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 14, 30, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f080c367-c3dd-4df6-94e7-e84b9d4193ad/file', 'properties': {}}, 'image_service': }' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:30:37 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-012f9a38-dfa1-46f5-8302-44db8b0db2e0 tempest-VolumeImageDependencyTests-1011859502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14c499dd-594a-4e3a-b5c0-efb118a74a10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:30:37 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-012f9a38-dfa1-46f5-8302-44db8b0db2e0 tempest-VolumeImageDependencyTests-1011859502 None] Volume volume-fdd29e82-8b08-477d-8c2b-928e3f68d392 (fdd29e82-8b08-477d-8c2b-928e3f68d392): created successfully Nov 06 15:30:37 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-012f9a38-dfa1-46f5-8302-44db8b0db2e0 tempest-VolumeImageDependencyTests-1011859502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14c499dd-594a-4e3a-b5c0-efb118a74a10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:30:37 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-012f9a38-dfa1-46f5-8302-44db8b0db2e0 tempest-VolumeImageDependencyTests-1011859502 None] Flow 'volume_create_manager' (29fc7c3c-e1cf-4a8a-9e21-997c54d8448f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:30:37 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-012f9a38-dfa1-46f5-8302-44db8b0db2e0 tempest-VolumeImageDependencyTests-1011859502 None] Created volume successfully. Nov 06 15:30:38 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d4134ee-958d-4116-a4b6-b2aa752dce8e tempest-SnapshotDependencyTests-907813795 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:30:38 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0d4134ee-958d-4116-a4b6-b2aa752dce8e tempest-SnapshotDependencyTests-907813795 None] Flow 'volume_create_manager' (9473fd3d-8578-4f2a-9402-b9ded7791c9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:30:38 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0d4134ee-958d-4116-a4b6-b2aa752dce8e tempest-SnapshotDependencyTests-907813795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9dd2c973-4cd7-4a1b-8430-8592c6778d68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:30:38 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0d4134ee-958d-4116-a4b6-b2aa752dce8e tempest-SnapshotDependencyTests-907813795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9dd2c973-4cd7-4a1b-8430-8592c6778d68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:30:38Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ddb4961-c851-4e59-94d4-2edd90d54138,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='442f2c6fa37843b8b993e1c0182936c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:30:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=73b6ccb7-201e-4969-bb25-48a9f3a1aca1,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:30:38Z,use_quota=True,user_id='73ae0474848f48468cbcf93d4aa9952b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:30:38 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0d4134ee-958d-4116-a4b6-b2aa752dce8e tempest-SnapshotDependencyTests-907813795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73894f52-2a17-4db2-a41b-9b719772a777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:30:38 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0d4134ee-958d-4116-a4b6-b2aa752dce8e tempest-SnapshotDependencyTests-907813795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73894f52-2a17-4db2-a41b-9b719772a777) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:30:38 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0d4134ee-958d-4116-a4b6-b2aa752dce8e tempest-SnapshotDependencyTests-907813795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36839f94-aea9-44c0-9317-26361baed6ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:30:38 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0d4134ee-958d-4116-a4b6-b2aa752dce8e tempest-SnapshotDependencyTests-907813795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36839f94-aea9-44c0-9317-26361baed6ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3ddb4961-c851-4e59-94d4-2edd90d54138', 'volume_name': 'volume-3ddb4961-c851-4e59-94d4-2edd90d54138', 'volume_size': 1, 'snapshot_id': '73b6ccb7-201e-4969-bb25-48a9f3a1aca1'}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:30:38 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0d4134ee-958d-4116-a4b6-b2aa752dce8e tempest-SnapshotDependencyTests-907813795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc8c9f2b-a681-4c1c-a885-9761efdc51e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:30:38 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0d4134ee-958d-4116-a4b6-b2aa752dce8e tempest-SnapshotDependencyTests-907813795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc8c9f2b-a681-4c1c-a885-9761efdc51e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:30:38 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0d4134ee-958d-4116-a4b6-b2aa752dce8e tempest-SnapshotDependencyTests-907813795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ceb93b7d-e421-4972-b920-67ce83a672e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:30:38 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-0d4134ee-958d-4116-a4b6-b2aa752dce8e tempest-SnapshotDependencyTests-907813795 None] Volume 3ddb4961-c851-4e59-94d4-2edd90d54138: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3ddb4961-c851-4e59-94d4-2edd90d54138', 'volume_size': 1, 'snapshot_id': '73b6ccb7-201e-4969-bb25-48a9f3a1aca1'} Nov 06 15:30:38 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-8768f639-c711-4ba2-bd1d-aafb904d5129 tempest-VolumeImageDependencyTests-1011859502 None] Acquiring lock "cinder-fdd29e82-8b08-477d-8c2b-928e3f68d392-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:30:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0d4134ee-958d-4116-a4b6-b2aa752dce8e tempest-SnapshotDependencyTests-907813795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:30:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0d4134ee-958d-4116-a4b6-b2aa752dce8e tempest-SnapshotDependencyTests-907813795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:30:38 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-0d4134ee-958d-4116-a4b6-b2aa752dce8e tempest-SnapshotDependencyTests-907813795 None] Acquiring lock "cinder-quobyte-73b6ccb7-201e-4969-bb25-48a9f3a1aca1-3ddb4961-c851-4e59-94d4-2edd90d54138" by "_create_volume_from_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:30:38 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-0d4134ee-958d-4116-a4b6-b2aa752dce8e tempest-SnapshotDependencyTests-907813795 None] Lock "cinder-quobyte-73b6ccb7-201e-4969-bb25-48a9f3a1aca1-3ddb4961-c851-4e59-94d4-2edd90d54138" acquired by "_create_volume_from_snapshot" :: waited 0.028s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:30:38 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0d4134ee-958d-4116-a4b6-b2aa752dce8e tempest-SnapshotDependencyTests-907813795 None] Creating volume 3ddb4961-c851-4e59-94d4-2edd90d54138 from snapshot 73b6ccb7-201e-4969-bb25-48a9f3a1aca1 {{(pid=87132) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 06 15:30:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0d4134ee-958d-4116-a4b6-b2aa752dce8e tempest-SnapshotDependencyTests-907813795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:30:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0d4134ee-958d-4116-a4b6-b2aa752dce8e tempest-SnapshotDependencyTests-907813795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:30:38 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0d4134ee-958d-4116-a4b6-b2aa752dce8e tempest-SnapshotDependencyTests-907813795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:30:38 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0d4134ee-958d-4116-a4b6-b2aa752dce8e tempest-SnapshotDependencyTests-907813795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:30:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0d4134ee-958d-4116-a4b6-b2aa752dce8e tempest-SnapshotDependencyTests-907813795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:30:38 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0d4134ee-958d-4116-a4b6-b2aa752dce8e tempest-SnapshotDependencyTests-907813795 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:30:38 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-0d4134ee-958d-4116-a4b6-b2aa752dce8e tempest-SnapshotDependencyTests-907813795 None] Acquiring lock "cinder-quobyte-3ddb4961-c851-4e59-94d4-2edd90d54138" by "_copy_volume_from_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:30:38 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-8768f639-c711-4ba2-bd1d-aafb904d5129 tempest-VolumeImageDependencyTests-1011859502 None] Lock "cinder-fdd29e82-8b08-477d-8c2b-928e3f68d392-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:30:38 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-0d4134ee-958d-4116-a4b6-b2aa752dce8e tempest-SnapshotDependencyTests-907813795 None] Lock "cinder-quobyte-3ddb4961-c851-4e59-94d4-2edd90d54138" acquired by "_copy_volume_from_snapshot" :: waited 0.032s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:30:38 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0d4134ee-958d-4116-a4b6-b2aa752dce8e tempest-SnapshotDependencyTests-907813795 None] snapshot: 73b6ccb7-201e-4969-bb25-48a9f3a1aca1, volume: 3ddb4961-c851-4e59-94d4-2edd90d54138, {{(pid=87132) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 06 15:30:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0d4134ee-958d-4116-a4b6-b2aa752dce8e tempest-SnapshotDependencyTests-907813795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:30:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0d4134ee-958d-4116-a4b6-b2aa752dce8e tempest-SnapshotDependencyTests-907813795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:30:38 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0d4134ee-958d-4116-a4b6-b2aa752dce8e tempest-SnapshotDependencyTests-907813795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:30:38 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0d4134ee-958d-4116-a4b6-b2aa752dce8e tempest-SnapshotDependencyTests-907813795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:30:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0d4134ee-958d-4116-a4b6-b2aa752dce8e tempest-SnapshotDependencyTests-907813795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:30:38 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc15db27-a519-4225-a604-55da58cbf6c0]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:30:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0d4134ee-958d-4116-a4b6-b2aa752dce8e tempest-SnapshotDependencyTests-907813795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0e0f73b5-309c-4a82-bb9f-3260ec571f08.73b6ccb7-201e-4969-bb25-48a9f3a1aca1 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:30:38 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-8768f639-c711-4ba2-bd1d-aafb904d5129 tempest-VolumeImageDependencyTests-1011859502 None] Acquiring lock "cinder-quobyte-fdd29e82-8b08-477d-8c2b-928e3f68d392" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:30:38 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-8768f639-c711-4ba2-bd1d-aafb904d5129 tempest-VolumeImageDependencyTests-1011859502 None] Lock "cinder-quobyte-fdd29e82-8b08-477d-8c2b-928e3f68d392" acquired by "delete_volume" :: waited 0.029s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:30:38 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[b77a734b-14af-43c3-ae7c-9dc423db3ee9]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:30:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8768f639-c711-4ba2-bd1d-aafb904d5129 tempest-VolumeImageDependencyTests-1011859502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-fdd29e82-8b08-477d-8c2b-928e3f68d392 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:30:38 devstack sudo[101272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0e0f73b5-309c-4a82-bb9f-3260ec571f08.73b6ccb7-201e-4969-bb25-48a9f3a1aca1 Nov 06 15:30:38 devstack sudo[101272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:30:39 devstack sudo[101273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-fdd29e82-8b08-477d-8c2b-928e3f68d392 Nov 06 15:30:39 devstack sudo[101273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:30:39 devstack sudo[101272]: pam_unix(sudo:session): session closed for user root Nov 06 15:30:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0d4134ee-958d-4116-a4b6-b2aa752dce8e tempest-SnapshotDependencyTests-907813795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0e0f73b5-309c-4a82-bb9f-3260ec571f08.73b6ccb7-201e-4969-bb25-48a9f3a1aca1" returned: 0 in 0.664s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:30:39 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-0d4134ee-958d-4116-a4b6-b2aa752dce8e tempest-SnapshotDependencyTests-907813795 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0e0f73b5-309c-4a82-bb9f-3260ec571f08(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 15:30:39 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b8e7793-5e4d-476d-bde9-c35340fe19a3]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:30:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0d4134ee-958d-4116-a4b6-b2aa752dce8e tempest-SnapshotDependencyTests-907813795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0e0f73b5-309c-4a82-bb9f-3260ec571f08 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:30:39 devstack sudo[101273]: pam_unix(sudo:session): session closed for user root Nov 06 15:30:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8768f639-c711-4ba2-bd1d-aafb904d5129 tempest-VolumeImageDependencyTests-1011859502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-fdd29e82-8b08-477d-8c2b-928e3f68d392" returned: 0 in 0.799s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:30:39 devstack sudo[101280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0e0f73b5-309c-4a82-bb9f-3260ec571f08 Nov 06 15:30:39 devstack sudo[101280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:30:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8768f639-c711-4ba2-bd1d-aafb904d5129 tempest-VolumeImageDependencyTests-1011859502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-fdd29e82-8b08-477d-8c2b-928e3f68d392 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:30:39 devstack sudo[101285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-fdd29e82-8b08-477d-8c2b-928e3f68d392 Nov 06 15:30:39 devstack sudo[101285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:30:39 devstack sudo[101280]: pam_unix(sudo:session): session closed for user root Nov 06 15:30:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0d4134ee-958d-4116-a4b6-b2aa752dce8e tempest-SnapshotDependencyTests-907813795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0e0f73b5-309c-4a82-bb9f-3260ec571f08" returned: 0 in 0.580s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:30:39 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0d4134ee-958d-4116-a4b6-b2aa752dce8e tempest-SnapshotDependencyTests-907813795 None] will copy from snapshot at /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0e0f73b5-309c-4a82-bb9f-3260ec571f08 {{(pid=87132) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 06 15:30:39 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0d4134ee-958d-4116-a4b6-b2aa752dce8e tempest-SnapshotDependencyTests-907813795 None] Creating direct copy from snapshot {{(pid=87132) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 06 15:30:39 devstack cinder-volume[87132]: DEBUG cinder.utils [None req-0d4134ee-958d-4116-a4b6-b2aa752dce8e tempest-SnapshotDependencyTests-907813795 None] Path /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-3ddb4961-c851-4e59-94d4-2edd90d54138 not found in is_blk_device check {{(pid=87132) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 06 15:30:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0d4134ee-958d-4116-a4b6-b2aa752dce8e tempest-SnapshotDependencyTests-907813795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0e0f73b5-309c-4a82-bb9f-3260ec571f08 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-3ddb4961-c851-4e59-94d4-2edd90d54138 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:30:39 devstack sudo[101293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0e0f73b5-309c-4a82-bb9f-3260ec571f08 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-3ddb4961-c851-4e59-94d4-2edd90d54138 Nov 06 15:30:39 devstack sudo[101293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:30:40 devstack sudo[101285]: pam_unix(sudo:session): session closed for user root Nov 06 15:30:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8768f639-c711-4ba2-bd1d-aafb904d5129 tempest-VolumeImageDependencyTests-1011859502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-fdd29e82-8b08-477d-8c2b-928e3f68d392" returned: 0 in 0.471s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:30:40 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-8768f639-c711-4ba2-bd1d-aafb904d5129 tempest-VolumeImageDependencyTests-1011859502 None] Lock "cinder-quobyte-fdd29e82-8b08-477d-8c2b-928e3f68d392" released by "delete_volume" :: held 1.394s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:30:40 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-8768f639-c711-4ba2-bd1d-aafb904d5129 tempest-VolumeImageDependencyTests-1011859502 None] Created reservations ['9db115cb-7799-4a0e-84a5-97e1694cb653', '63ab831f-025c-4ac0-9374-26b1a68ddefa', 'f1ffc7db-7475-4c8f-b3d8-77ec487f9e72', 'c256b3bc-48fb-4cf2-84ad-22ef3708764b'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:30:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8768f639-c711-4ba2-bd1d-aafb904d5129 tempest-VolumeImageDependencyTests-1011859502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:30:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8768f639-c711-4ba2-bd1d-aafb904d5129 tempest-VolumeImageDependencyTests-1011859502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:30:40 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-8768f639-c711-4ba2-bd1d-aafb904d5129 tempest-VolumeImageDependencyTests-1011859502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:30:40 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-8768f639-c711-4ba2-bd1d-aafb904d5129 tempest-VolumeImageDependencyTests-1011859502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:30:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8768f639-c711-4ba2-bd1d-aafb904d5129 tempest-VolumeImageDependencyTests-1011859502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:30:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8768f639-c711-4ba2-bd1d-aafb904d5129 tempest-VolumeImageDependencyTests-1011859502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:30:40 devstack sudo[101299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:30:40 devstack sudo[101299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:30:40 devstack sudo[101299]: pam_unix(sudo:session): session closed for user root Nov 06 15:30:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8768f639-c711-4ba2-bd1d-aafb904d5129 tempest-VolumeImageDependencyTests-1011859502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.338s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:30:40 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-8768f639-c711-4ba2-bd1d-aafb904d5129 tempest-VolumeImageDependencyTests-1011859502 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:30:40 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-8768f639-c711-4ba2-bd1d-aafb904d5129 tempest-VolumeImageDependencyTests-1011859502 None] Deleted volume successfully. Nov 06 15:30:40 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-8768f639-c711-4ba2-bd1d-aafb904d5129 tempest-VolumeImageDependencyTests-1011859502 None] Lock "cinder-fdd29e82-8b08-477d-8c2b-928e3f68d392-delete_volume" released by "delete_volume" :: held 2.333s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:30:48 devstack sudo[101293]: pam_unix(sudo:session): session closed for user root Nov 06 15:30:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0d4134ee-958d-4116-a4b6-b2aa752dce8e tempest-SnapshotDependencyTests-907813795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0e0f73b5-309c-4a82-bb9f-3260ec571f08 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-3ddb4961-c851-4e59-94d4-2edd90d54138" returned: 0 in 8.764s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:30:48 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-0d4134ee-958d-4116-a4b6-b2aa752dce8e tempest-SnapshotDependencyTests-907813795 None] Image conversion details: src /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0e0f73b5-309c-4a82-bb9f-3260ec571f08, size 1024.00 MB, duration 8.77 sec, destination /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-3ddb4961-c851-4e59-94d4-2edd90d54138 {{(pid=87132) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 06 15:30:48 devstack cinder-volume[87132]: INFO cinder.image.image_utils [None req-0d4134ee-958d-4116-a4b6-b2aa752dce8e tempest-SnapshotDependencyTests-907813795 None] Converted 1024.00 MB image at 116.82 MB/s Nov 06 15:30:48 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-0d4134ee-958d-4116-a4b6-b2aa752dce8e tempest-SnapshotDependencyTests-907813795 None] /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-3ddb4961-c851-4e59-94d4-2edd90d54138 is being set with open permissions: ugo+rw Nov 06 15:30:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0d4134ee-958d-4116-a4b6-b2aa752dce8e tempest-SnapshotDependencyTests-907813795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-3ddb4961-c851-4e59-94d4-2edd90d54138 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:30:48 devstack sudo[101328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-3ddb4961-c851-4e59-94d4-2edd90d54138 Nov 06 15:30:48 devstack sudo[101328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:30:48 devstack sudo[101328]: pam_unix(sudo:session): session closed for user root Nov 06 15:30:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0d4134ee-958d-4116-a4b6-b2aa752dce8e tempest-SnapshotDependencyTests-907813795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-3ddb4961-c851-4e59-94d4-2edd90d54138" returned: 0 in 0.242s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:30:48 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-0d4134ee-958d-4116-a4b6-b2aa752dce8e tempest-SnapshotDependencyTests-907813795 None] Lock "cinder-quobyte-3ddb4961-c851-4e59-94d4-2edd90d54138" released by "_copy_volume_from_snapshot" :: held 10.416s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:30:48 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:SELECT=107,cinder:INSERT=44,cinder:UPDATE=145,cinder:DELETE=10 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 15:30:48 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:UPDATE=140,cinder:SELECT=102,cinder:INSERT=39,cinder:DELETE=15 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 15:30:48 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-0d4134ee-958d-4116-a4b6-b2aa752dce8e tempest-SnapshotDependencyTests-907813795 None] Lock "cinder-quobyte-73b6ccb7-201e-4969-bb25-48a9f3a1aca1-3ddb4961-c851-4e59-94d4-2edd90d54138" released by "_create_volume_from_snapshot" :: held 10.520s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:30:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0d4134ee-958d-4116-a4b6-b2aa752dce8e tempest-SnapshotDependencyTests-907813795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.549s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:30:48 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0d4134ee-958d-4116-a4b6-b2aa752dce8e tempest-SnapshotDependencyTests-907813795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ceb93b7d-e421-4972-b920-67ce83a672e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ddb4961-c851-4e59-94d4-2edd90d54138', 'volume_size': 1, 'snapshot_id': '73b6ccb7-201e-4969-bb25-48a9f3a1aca1'}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:30:48 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0d4134ee-958d-4116-a4b6-b2aa752dce8e tempest-SnapshotDependencyTests-907813795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6baeacf0-9957-43c7-908b-6cba4967aaaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:30:48 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-0d4134ee-958d-4116-a4b6-b2aa752dce8e tempest-SnapshotDependencyTests-907813795 None] Volume volume-3ddb4961-c851-4e59-94d4-2edd90d54138 (3ddb4961-c851-4e59-94d4-2edd90d54138): created successfully Nov 06 15:30:49 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0d4134ee-958d-4116-a4b6-b2aa752dce8e tempest-SnapshotDependencyTests-907813795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6baeacf0-9957-43c7-908b-6cba4967aaaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:30:49 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0d4134ee-958d-4116-a4b6-b2aa752dce8e tempest-SnapshotDependencyTests-907813795 None] Flow 'volume_create_manager' (9473fd3d-8578-4f2a-9402-b9ded7791c9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:30:49 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-0d4134ee-958d-4116-a4b6-b2aa752dce8e tempest-SnapshotDependencyTests-907813795 None] Created volume successfully. Nov 06 15:30:49 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-60a194fd-bc23-4ff7-9c3d-04f68bec70b3 tempest-SnapshotDependencyTests-907813795 None] Acquiring lock "cinder-73b6ccb7-201e-4969-bb25-48a9f3a1aca1-delete_snapshot" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:30:49 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-60a194fd-bc23-4ff7-9c3d-04f68bec70b3 tempest-SnapshotDependencyTests-907813795 None] Lock "cinder-73b6ccb7-201e-4969-bb25-48a9f3a1aca1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:30:49 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-60a194fd-bc23-4ff7-9c3d-04f68bec70b3 tempest-SnapshotDependencyTests-907813795 None] Acquiring lock "cinder-quobyte-0e0f73b5-309c-4a82-bb9f-3260ec571f08" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:30:49 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-60a194fd-bc23-4ff7-9c3d-04f68bec70b3 tempest-SnapshotDependencyTests-907813795 None] Lock "cinder-quobyte-0e0f73b5-309c-4a82-bb9f-3260ec571f08" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:30:49 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-60a194fd-bc23-4ff7-9c3d-04f68bec70b3 tempest-SnapshotDependencyTests-907813795 None] Acquiring lock "cinder-quobyte-73b6ccb7-201e-4969-bb25-48a9f3a1aca1" by "_delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:30:49 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-60a194fd-bc23-4ff7-9c3d-04f68bec70b3 tempest-SnapshotDependencyTests-907813795 None] Lock "cinder-quobyte-73b6ccb7-201e-4969-bb25-48a9f3a1aca1" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:30:49 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-60a194fd-bc23-4ff7-9c3d-04f68bec70b3 tempest-SnapshotDependencyTests-907813795 None] Deleting offline snapshot 73b6ccb7-201e-4969-bb25-48a9f3a1aca1 of volume 0e0f73b5-309c-4a82-bb9f-3260ec571f08 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 15:30:49 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-60a194fd-bc23-4ff7-9c3d-04f68bec70b3 tempest-SnapshotDependencyTests-907813795 None] snapshot_file for this snap is: volume-0e0f73b5-309c-4a82-bb9f-3260ec571f08.73b6ccb7-201e-4969-bb25-48a9f3a1aca1 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 15:30:49 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[127e261f-7bda-48f5-b7b1-cc5dd07dc46f]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:30:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-60a194fd-bc23-4ff7-9c3d-04f68bec70b3 tempest-SnapshotDependencyTests-907813795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0e0f73b5-309c-4a82-bb9f-3260ec571f08.73b6ccb7-201e-4969-bb25-48a9f3a1aca1 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:30:49 devstack sudo[101332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0e0f73b5-309c-4a82-bb9f-3260ec571f08.73b6ccb7-201e-4969-bb25-48a9f3a1aca1 Nov 06 15:30:49 devstack sudo[101332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:30:49 devstack sudo[101332]: pam_unix(sudo:session): session closed for user root Nov 06 15:30:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-60a194fd-bc23-4ff7-9c3d-04f68bec70b3 tempest-SnapshotDependencyTests-907813795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0e0f73b5-309c-4a82-bb9f-3260ec571f08.73b6ccb7-201e-4969-bb25-48a9f3a1aca1" returned: 0 in 0.352s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:30:49 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-60a194fd-bc23-4ff7-9c3d-04f68bec70b3 tempest-SnapshotDependencyTests-907813795 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0e0f73b5-309c-4a82-bb9f-3260ec571f08(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 15:30:49 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3b63561-6904-4436-a894-b64da1b5a1d6]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:30:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-60a194fd-bc23-4ff7-9c3d-04f68bec70b3 tempest-SnapshotDependencyTests-907813795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0e0f73b5-309c-4a82-bb9f-3260ec571f08 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:30:49 devstack sudo[101340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0e0f73b5-309c-4a82-bb9f-3260ec571f08 Nov 06 15:30:49 devstack sudo[101340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:30:50 devstack sudo[101340]: pam_unix(sudo:session): session closed for user root Nov 06 15:30:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-60a194fd-bc23-4ff7-9c3d-04f68bec70b3 tempest-SnapshotDependencyTests-907813795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0e0f73b5-309c-4a82-bb9f-3260ec571f08" returned: 0 in 0.524s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:30:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-60a194fd-bc23-4ff7-9c3d-04f68bec70b3 tempest-SnapshotDependencyTests-907813795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0e0f73b5-309c-4a82-bb9f-3260ec571f08.73b6ccb7-201e-4969-bb25-48a9f3a1aca1 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:30:50 devstack sudo[101345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0e0f73b5-309c-4a82-bb9f-3260ec571f08.73b6ccb7-201e-4969-bb25-48a9f3a1aca1 Nov 06 15:30:50 devstack sudo[101345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:30:50 devstack sudo[101345]: pam_unix(sudo:session): session closed for user root Nov 06 15:30:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-60a194fd-bc23-4ff7-9c3d-04f68bec70b3 tempest-SnapshotDependencyTests-907813795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0e0f73b5-309c-4a82-bb9f-3260ec571f08.73b6ccb7-201e-4969-bb25-48a9f3a1aca1" returned: 0 in 0.330s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:30:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-60a194fd-bc23-4ff7-9c3d-04f68bec70b3 tempest-SnapshotDependencyTests-907813795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0e0f73b5-309c-4a82-bb9f-3260ec571f08.73b6ccb7-201e-4969-bb25-48a9f3a1aca1 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:30:50 devstack sudo[101350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0e0f73b5-309c-4a82-bb9f-3260ec571f08.73b6ccb7-201e-4969-bb25-48a9f3a1aca1 Nov 06 15:30:50 devstack sudo[101350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:30:50 devstack sudo[101350]: pam_unix(sudo:session): session closed for user root Nov 06 15:30:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-60a194fd-bc23-4ff7-9c3d-04f68bec70b3 tempest-SnapshotDependencyTests-907813795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0e0f73b5-309c-4a82-bb9f-3260ec571f08.73b6ccb7-201e-4969-bb25-48a9f3a1aca1" returned: 0 in 0.237s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:30:51 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-60a194fd-bc23-4ff7-9c3d-04f68bec70b3 tempest-SnapshotDependencyTests-907813795 None] Lock "cinder-quobyte-73b6ccb7-201e-4969-bb25-48a9f3a1aca1" released by "_delete_snapshot" :: held 1.545s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:30:51 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-60a194fd-bc23-4ff7-9c3d-04f68bec70b3 tempest-SnapshotDependencyTests-907813795 None] Lock "cinder-quobyte-0e0f73b5-309c-4a82-bb9f-3260ec571f08" released by "delete_snapshot" :: held 1.567s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:30:51 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-60a194fd-bc23-4ff7-9c3d-04f68bec70b3 tempest-SnapshotDependencyTests-907813795 None] Created reservations ['9beaf51b-930a-4330-ad47-291427830830', 'a71f07e3-7fc7-46e1-86db-cdd1f02527ef', '27140e10-3a61-4c95-8069-f9b04f3ebab4', '6980791b-5026-452d-82b9-a90a268be150'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:30:51 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-60a194fd-bc23-4ff7-9c3d-04f68bec70b3 tempest-SnapshotDependencyTests-907813795 None] Delete snapshot completed successfully. Nov 06 15:30:51 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-60a194fd-bc23-4ff7-9c3d-04f68bec70b3 tempest-SnapshotDependencyTests-907813795 None] Lock "cinder-73b6ccb7-201e-4969-bb25-48a9f3a1aca1-delete_snapshot" released by "delete_snapshot" :: held 1.692s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:30:51 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-8ca6d815-b007-419a-96ab-f1d2c6a89ecf tempest-SnapshotDependencyTests-907813795 None] Acquiring lock "cinder-0e0f73b5-309c-4a82-bb9f-3260ec571f08-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:30:51 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-8ca6d815-b007-419a-96ab-f1d2c6a89ecf tempest-SnapshotDependencyTests-907813795 None] Lock "cinder-0e0f73b5-309c-4a82-bb9f-3260ec571f08-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:30:51 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-8ca6d815-b007-419a-96ab-f1d2c6a89ecf tempest-SnapshotDependencyTests-907813795 None] Acquiring lock "cinder-quobyte-0e0f73b5-309c-4a82-bb9f-3260ec571f08" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:30:51 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-8ca6d815-b007-419a-96ab-f1d2c6a89ecf tempest-SnapshotDependencyTests-907813795 None] Lock "cinder-quobyte-0e0f73b5-309c-4a82-bb9f-3260ec571f08" acquired by "delete_volume" :: waited 0.017s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:30:51 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[429b6ad2-d375-4d25-8c7f-9a7bbaeca5b8]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:30:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8ca6d815-b007-419a-96ab-f1d2c6a89ecf tempest-SnapshotDependencyTests-907813795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0e0f73b5-309c-4a82-bb9f-3260ec571f08 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:30:51 devstack sudo[101353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0e0f73b5-309c-4a82-bb9f-3260ec571f08 Nov 06 15:30:51 devstack sudo[101353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:30:52 devstack sudo[101353]: pam_unix(sudo:session): session closed for user root Nov 06 15:30:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8ca6d815-b007-419a-96ab-f1d2c6a89ecf tempest-SnapshotDependencyTests-907813795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0e0f73b5-309c-4a82-bb9f-3260ec571f08" returned: 0 in 0.350s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:30:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8ca6d815-b007-419a-96ab-f1d2c6a89ecf tempest-SnapshotDependencyTests-907813795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0e0f73b5-309c-4a82-bb9f-3260ec571f08 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:30:52 devstack sudo[101360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0e0f73b5-309c-4a82-bb9f-3260ec571f08 Nov 06 15:30:52 devstack sudo[101360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:30:52 devstack sudo[101360]: pam_unix(sudo:session): session closed for user root Nov 06 15:30:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8ca6d815-b007-419a-96ab-f1d2c6a89ecf tempest-SnapshotDependencyTests-907813795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0e0f73b5-309c-4a82-bb9f-3260ec571f08" returned: 0 in 0.241s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:30:52 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-8ca6d815-b007-419a-96ab-f1d2c6a89ecf tempest-SnapshotDependencyTests-907813795 None] Lock "cinder-quobyte-0e0f73b5-309c-4a82-bb9f-3260ec571f08" released by "delete_volume" :: held 0.654s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:30:52 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-8ca6d815-b007-419a-96ab-f1d2c6a89ecf tempest-SnapshotDependencyTests-907813795 None] Created reservations ['bd86d109-6479-406d-aa13-bbfbe2a74c47', 'b2b8d312-2dd7-4df0-8196-26cc6763361e', 'eb66dd12-9d34-4ac0-a2da-bdf2fd66b262', 'ae84afdd-5ab5-4b83-a15e-76158f633c43'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:30:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8ca6d815-b007-419a-96ab-f1d2c6a89ecf tempest-SnapshotDependencyTests-907813795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:30:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8ca6d815-b007-419a-96ab-f1d2c6a89ecf tempest-SnapshotDependencyTests-907813795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:30:52 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-8ca6d815-b007-419a-96ab-f1d2c6a89ecf tempest-SnapshotDependencyTests-907813795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:30:52 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-8ca6d815-b007-419a-96ab-f1d2c6a89ecf tempest-SnapshotDependencyTests-907813795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:30:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8ca6d815-b007-419a-96ab-f1d2c6a89ecf tempest-SnapshotDependencyTests-907813795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:30:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8ca6d815-b007-419a-96ab-f1d2c6a89ecf tempest-SnapshotDependencyTests-907813795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:30:52 devstack sudo[101363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:30:52 devstack sudo[101363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:30:52 devstack sudo[101363]: pam_unix(sudo:session): session closed for user root Nov 06 15:30:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8ca6d815-b007-419a-96ab-f1d2c6a89ecf tempest-SnapshotDependencyTests-907813795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.241s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:30:52 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-8ca6d815-b007-419a-96ab-f1d2c6a89ecf tempest-SnapshotDependencyTests-907813795 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:30:52 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-8ca6d815-b007-419a-96ab-f1d2c6a89ecf tempest-SnapshotDependencyTests-907813795 None] Deleted volume successfully. Nov 06 15:30:52 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-8ca6d815-b007-419a-96ab-f1d2c6a89ecf tempest-SnapshotDependencyTests-907813795 None] Lock "cinder-0e0f73b5-309c-4a82-bb9f-3260ec571f08-delete_volume" released by "delete_volume" :: held 1.087s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:30:52 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-da3dd4c7-2c72-41e6-9edd-4b36aab087d2 tempest-SnapshotDependencyTests-907813795 None] Acquiring lock "cinder-3ddb4961-c851-4e59-94d4-2edd90d54138-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:30:52 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-da3dd4c7-2c72-41e6-9edd-4b36aab087d2 tempest-SnapshotDependencyTests-907813795 None] Lock "cinder-3ddb4961-c851-4e59-94d4-2edd90d54138-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:30:52 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-da3dd4c7-2c72-41e6-9edd-4b36aab087d2 tempest-SnapshotDependencyTests-907813795 None] Acquiring lock "cinder-quobyte-3ddb4961-c851-4e59-94d4-2edd90d54138" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:30:52 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-da3dd4c7-2c72-41e6-9edd-4b36aab087d2 tempest-SnapshotDependencyTests-907813795 None] Lock "cinder-quobyte-3ddb4961-c851-4e59-94d4-2edd90d54138" acquired by "delete_volume" :: waited 0.013s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:30:52 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b3b7f4e-665b-408e-b76d-8a63fd780c89]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:30:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-da3dd4c7-2c72-41e6-9edd-4b36aab087d2 tempest-SnapshotDependencyTests-907813795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-3ddb4961-c851-4e59-94d4-2edd90d54138 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:30:52 devstack sudo[101366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-3ddb4961-c851-4e59-94d4-2edd90d54138 Nov 06 15:30:52 devstack sudo[101366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:30:53 devstack sudo[101366]: pam_unix(sudo:session): session closed for user root Nov 06 15:30:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-da3dd4c7-2c72-41e6-9edd-4b36aab087d2 tempest-SnapshotDependencyTests-907813795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-3ddb4961-c851-4e59-94d4-2edd90d54138" returned: 0 in 0.348s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:30:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-da3dd4c7-2c72-41e6-9edd-4b36aab087d2 tempest-SnapshotDependencyTests-907813795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-3ddb4961-c851-4e59-94d4-2edd90d54138 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:30:53 devstack sudo[101372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-3ddb4961-c851-4e59-94d4-2edd90d54138 Nov 06 15:30:53 devstack sudo[101372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:30:53 devstack sudo[101372]: pam_unix(sudo:session): session closed for user root Nov 06 15:30:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-da3dd4c7-2c72-41e6-9edd-4b36aab087d2 tempest-SnapshotDependencyTests-907813795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-3ddb4961-c851-4e59-94d4-2edd90d54138" returned: 0 in 0.242s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:30:53 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-da3dd4c7-2c72-41e6-9edd-4b36aab087d2 tempest-SnapshotDependencyTests-907813795 None] Lock "cinder-quobyte-3ddb4961-c851-4e59-94d4-2edd90d54138" released by "delete_volume" :: held 0.630s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:30:53 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-da3dd4c7-2c72-41e6-9edd-4b36aab087d2 tempest-SnapshotDependencyTests-907813795 None] Created reservations ['e3094382-6bba-4e52-b1dd-cff43904f3cf', 'ce28b877-2559-4287-b9aa-3b0845030255', 'b1a96a4a-3862-4397-8904-dffcf0f4f54a', '9383988a-3afd-4f3e-a125-8132a088b416'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:30:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-da3dd4c7-2c72-41e6-9edd-4b36aab087d2 tempest-SnapshotDependencyTests-907813795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:30:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-da3dd4c7-2c72-41e6-9edd-4b36aab087d2 tempest-SnapshotDependencyTests-907813795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:30:53 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-da3dd4c7-2c72-41e6-9edd-4b36aab087d2 tempest-SnapshotDependencyTests-907813795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:30:53 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-da3dd4c7-2c72-41e6-9edd-4b36aab087d2 tempest-SnapshotDependencyTests-907813795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:30:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-da3dd4c7-2c72-41e6-9edd-4b36aab087d2 tempest-SnapshotDependencyTests-907813795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:30:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-da3dd4c7-2c72-41e6-9edd-4b36aab087d2 tempest-SnapshotDependencyTests-907813795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:30:53 devstack sudo[101375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:30:53 devstack sudo[101375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:30:53 devstack sudo[101375]: pam_unix(sudo:session): session closed for user root Nov 06 15:30:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-da3dd4c7-2c72-41e6-9edd-4b36aab087d2 tempest-SnapshotDependencyTests-907813795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.251s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:30:53 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-da3dd4c7-2c72-41e6-9edd-4b36aab087d2 tempest-SnapshotDependencyTests-907813795 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:30:53 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-da3dd4c7-2c72-41e6-9edd-4b36aab087d2 tempest-SnapshotDependencyTests-907813795 None] Deleted volume successfully. Nov 06 15:30:53 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-da3dd4c7-2c72-41e6-9edd-4b36aab087d2 tempest-SnapshotDependencyTests-907813795 None] Lock "cinder-3ddb4961-c851-4e59-94d4-2edd90d54138-delete_volume" released by "delete_volume" :: held 1.078s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:31:00 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a68a45f-78e0-4246-bba7-92c8604d1d99 tempest-AttachVolumeNegativeTest-625165533 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:31:00 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0a68a45f-78e0-4246-bba7-92c8604d1d99 tempest-AttachVolumeNegativeTest-625165533 None] Flow 'volume_create_manager' (fd204a29-65ae-4942-a118-3a714f73cd90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:31:00 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0a68a45f-78e0-4246-bba7-92c8604d1d99 tempest-AttachVolumeNegativeTest-625165533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d949d5b7-e56c-44e6-b8a9-17df4f76f2b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:31:00 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0a68a45f-78e0-4246-bba7-92c8604d1d99 tempest-AttachVolumeNegativeTest-625165533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d949d5b7-e56c-44e6-b8a9-17df4f76f2b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:31:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1663514119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f32da07e-27a7-49d6-ae41-46fb66d4ace4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73884d0c897e4937a8a62ca22bd0d56c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:31:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:31:01Z,use_quota=True,user_id='5d17ede13c034abf8a132cac03a00a09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:31:00 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0a68a45f-78e0-4246-bba7-92c8604d1d99 tempest-AttachVolumeNegativeTest-625165533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab0b5c70-3222-4dbb-a399-4b7941908e51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:31:00 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0a68a45f-78e0-4246-bba7-92c8604d1d99 tempest-AttachVolumeNegativeTest-625165533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab0b5c70-3222-4dbb-a399-4b7941908e51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:31:00 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0a68a45f-78e0-4246-bba7-92c8604d1d99 tempest-AttachVolumeNegativeTest-625165533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (726ab5cf-4b0a-4279-b5b1-3820ca44dd37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:31:00 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0a68a45f-78e0-4246-bba7-92c8604d1d99 tempest-AttachVolumeNegativeTest-625165533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (726ab5cf-4b0a-4279-b5b1-3820ca44dd37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f32da07e-27a7-49d6-ae41-46fb66d4ace4', 'volume_name': 'volume-f32da07e-27a7-49d6-ae41-46fb66d4ace4', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:31:00 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0a68a45f-78e0-4246-bba7-92c8604d1d99 tempest-AttachVolumeNegativeTest-625165533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd7f0316-1769-414e-be16-7253d127c30e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:31:00 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0a68a45f-78e0-4246-bba7-92c8604d1d99 tempest-AttachVolumeNegativeTest-625165533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd7f0316-1769-414e-be16-7253d127c30e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:31:00 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0a68a45f-78e0-4246-bba7-92c8604d1d99 tempest-AttachVolumeNegativeTest-625165533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcc5bbf4-4531-4a34-946b-8fd33ead516d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:31:00 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-0a68a45f-78e0-4246-bba7-92c8604d1d99 tempest-AttachVolumeNegativeTest-625165533 None] Volume f32da07e-27a7-49d6-ae41-46fb66d4ace4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f32da07e-27a7-49d6-ae41-46fb66d4ace4', 'volume_size': 1} Nov 06 15:31:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0a68a45f-78e0-4246-bba7-92c8604d1d99 tempest-AttachVolumeNegativeTest-625165533 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:31:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0a68a45f-78e0-4246-bba7-92c8604d1d99 tempest-AttachVolumeNegativeTest-625165533 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:31:00 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0a68a45f-78e0-4246-bba7-92c8604d1d99 tempest-AttachVolumeNegativeTest-625165533 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:31:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1663514119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f32da07e-27a7-49d6-ae41-46fb66d4ace4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73884d0c897e4937a8a62ca22bd0d56c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:31:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:31:01Z,use_quota=True,user_id='5d17ede13c034abf8a132cac03a00a09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:31:00 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-0a68a45f-78e0-4246-bba7-92c8604d1d99 tempest-AttachVolumeNegativeTest-625165533 None] Creating volume f32da07e-27a7-49d6-ae41-46fb66d4ace4 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:31:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0a68a45f-78e0-4246-bba7-92c8604d1d99 tempest-AttachVolumeNegativeTest-625165533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:31:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0a68a45f-78e0-4246-bba7-92c8604d1d99 tempest-AttachVolumeNegativeTest-625165533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:31:00 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0a68a45f-78e0-4246-bba7-92c8604d1d99 tempest-AttachVolumeNegativeTest-625165533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:31:00 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0a68a45f-78e0-4246-bba7-92c8604d1d99 tempest-AttachVolumeNegativeTest-625165533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:31:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0a68a45f-78e0-4246-bba7-92c8604d1d99 tempest-AttachVolumeNegativeTest-625165533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:31:00 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0a68a45f-78e0-4246-bba7-92c8604d1d99 tempest-AttachVolumeNegativeTest-625165533 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:31:00 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-0a68a45f-78e0-4246-bba7-92c8604d1d99 tempest-AttachVolumeNegativeTest-625165533 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:31:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0a68a45f-78e0-4246-bba7-92c8604d1d99 tempest-AttachVolumeNegativeTest-625165533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f32da07e-27a7-49d6-ae41-46fb66d4ace4 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:31:00 devstack sudo[101426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f32da07e-27a7-49d6-ae41-46fb66d4ace4 1073741824 Nov 06 15:31:00 devstack sudo[101426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:31:01 devstack sudo[101426]: pam_unix(sudo:session): session closed for user root Nov 06 15:31:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0a68a45f-78e0-4246-bba7-92c8604d1d99 tempest-AttachVolumeNegativeTest-625165533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f32da07e-27a7-49d6-ae41-46fb66d4ace4 1073741824" returned: 0 in 0.419s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:31:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0a68a45f-78e0-4246-bba7-92c8604d1d99 tempest-AttachVolumeNegativeTest-625165533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f32da07e-27a7-49d6-ae41-46fb66d4ace4 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:31:01 devstack sudo[101432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f32da07e-27a7-49d6-ae41-46fb66d4ace4 Nov 06 15:31:01 devstack sudo[101432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:31:01 devstack sudo[101432]: pam_unix(sudo:session): session closed for user root Nov 06 15:31:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0a68a45f-78e0-4246-bba7-92c8604d1d99 tempest-AttachVolumeNegativeTest-625165533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f32da07e-27a7-49d6-ae41-46fb66d4ace4" returned: 0 in 0.321s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:31:01 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0a68a45f-78e0-4246-bba7-92c8604d1d99 tempest-AttachVolumeNegativeTest-625165533 None] <== create_volume: return (780ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:31:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0a68a45f-78e0-4246-bba7-92c8604d1d99 tempest-AttachVolumeNegativeTest-625165533 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.784s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:31:01 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0a68a45f-78e0-4246-bba7-92c8604d1d99 tempest-AttachVolumeNegativeTest-625165533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcc5bbf4-4531-4a34-946b-8fd33ead516d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f32da07e-27a7-49d6-ae41-46fb66d4ace4', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:31:01 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0a68a45f-78e0-4246-bba7-92c8604d1d99 tempest-AttachVolumeNegativeTest-625165533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf87345a-9f14-45af-860a-5481d96a3f57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:31:01 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-0a68a45f-78e0-4246-bba7-92c8604d1d99 tempest-AttachVolumeNegativeTest-625165533 None] Volume volume-f32da07e-27a7-49d6-ae41-46fb66d4ace4 (f32da07e-27a7-49d6-ae41-46fb66d4ace4): created successfully Nov 06 15:31:01 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0a68a45f-78e0-4246-bba7-92c8604d1d99 tempest-AttachVolumeNegativeTest-625165533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf87345a-9f14-45af-860a-5481d96a3f57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:31:01 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0a68a45f-78e0-4246-bba7-92c8604d1d99 tempest-AttachVolumeNegativeTest-625165533 None] Flow 'volume_create_manager' (fd204a29-65ae-4942-a118-3a714f73cd90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:31:01 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-0a68a45f-78e0-4246-bba7-92c8604d1d99 tempest-AttachVolumeNegativeTest-625165533 None] Created volume successfully. Nov 06 15:31:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-616fd303-1b83-4359-91c3-6c7775dcc96b req-130b1641-d0fa-4cfd-a40a-b946d57792ce tempest-AttachVolumeNegativeTest-625165533 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:31:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-616fd303-1b83-4359-91c3-6c7775dcc96b req-130b1641-d0fa-4cfd-a40a-b946d57792ce tempest-AttachVolumeNegativeTest-625165533 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:31:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-616fd303-1b83-4359-91c3-6c7775dcc96b req-130b1641-d0fa-4cfd-a40a-b946d57792ce tempest-AttachVolumeNegativeTest-625165533 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:31:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-616fd303-1b83-4359-91c3-6c7775dcc96b req-130b1641-d0fa-4cfd-a40a-b946d57792ce tempest-AttachVolumeNegativeTest-625165533 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b', 'name': 'volume-f32da07e-27a7-49d6-ae41-46fb66d4ace4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bb1faae7-6b06-4c28-bd3a-eb9aa42f3f38', 'enforce_multipath': True} {{(pid=87132) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 15:31:02 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-616fd303-1b83-4359-91c3-6c7775dcc96b req-130b1641-d0fa-4cfd-a40a-b946d57792ce tempest-AttachVolumeNegativeTest-625165533 None] attachment_update completed successfully. Nov 06 15:31:08 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 15:31:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:31:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:31:08 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:31:08 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:31:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:31:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:31:08 devstack sudo[101876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:31:08 devstack sudo[101876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:31:08 devstack sudo[101876]: pam_unix(sudo:session): session closed for user root Nov 06 15:31:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.296s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:31:08 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:31:08 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Running periodic task VolumeManager._thread_info {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 15:31:08 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] thread count: 28 {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 15:31:08 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] thread info: [<_MainThread(MainThread, started 140011251929216)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 06 15:31:12 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:UPDATE=24,cinder:DELETE=4,cinder:SELECT=25,cinder:INSERT=8 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 15:31:12 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:SELECT=26,cinder:INSERT=6,cinder:UPDATE=33 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 15:31:39 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-ab6d2693-cabc-4a01-965e-800ee98f765b req-fc436366-5884-4bc5-af4d-dd983342f1ac tempest-AttachVolumeNegativeTest-625165533 None] Terminate volume connection completed successfully. Nov 06 15:31:39 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-ab6d2693-cabc-4a01-965e-800ee98f765b req-fc436366-5884-4bc5-af4d-dd983342f1ac tempest-AttachVolumeNegativeTest-625165533 None] Deleting attachment bb1faae7-6b06-4c28-bd3a-eb9aa42f3f38. {{(pid=87132) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 06 15:31:49 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:SELECT=2 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 15:32:08 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 15:32:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:32:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:32:08 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:32:08 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:32:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:32:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:32:08 devstack sudo[102215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:32:08 devstack sudo[102215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:32:08 devstack sudo[102215]: pam_unix(sudo:session): session closed for user root Nov 06 15:32:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.248s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:32:08 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:32:08 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Running periodic task VolumeManager._thread_info {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 15:32:08 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] thread count: 28 {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 15:32:08 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] thread info: [<_MainThread(MainThread, started 140011251929216)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 06 15:32:12 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-00742ebd-31a8-4153-9d07-8bc0f2f1f13d tempest-AttachVolumeNegativeTest-625165533 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:32:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-00742ebd-31a8-4153-9d07-8bc0f2f1f13d tempest-AttachVolumeNegativeTest-625165533 None] Flow 'volume_create_manager' (36e58cb2-eab7-42d5-b999-ac77afd6ca37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:32:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-00742ebd-31a8-4153-9d07-8bc0f2f1f13d tempest-AttachVolumeNegativeTest-625165533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (928660f7-515c-4bb5-8776-01cb8732f9bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:32:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-00742ebd-31a8-4153-9d07-8bc0f2f1f13d tempest-AttachVolumeNegativeTest-625165533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (928660f7-515c-4bb5-8776-01cb8732f9bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:32:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2097098758',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7cf227d-e7c6-4f00-8710-fdc6029aa62d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73884d0c897e4937a8a62ca22bd0d56c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:32:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:32:12Z,use_quota=True,user_id='5d17ede13c034abf8a132cac03a00a09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:32:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-00742ebd-31a8-4153-9d07-8bc0f2f1f13d tempest-AttachVolumeNegativeTest-625165533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9abf42ce-2f3c-4549-8ca1-c411c48a2a28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:32:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-00742ebd-31a8-4153-9d07-8bc0f2f1f13d tempest-AttachVolumeNegativeTest-625165533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9abf42ce-2f3c-4549-8ca1-c411c48a2a28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:32:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-00742ebd-31a8-4153-9d07-8bc0f2f1f13d tempest-AttachVolumeNegativeTest-625165533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28a9d993-0e1a-4c45-99a8-0fac367d044b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:32:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-00742ebd-31a8-4153-9d07-8bc0f2f1f13d tempest-AttachVolumeNegativeTest-625165533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28a9d993-0e1a-4c45-99a8-0fac367d044b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7cf227d-e7c6-4f00-8710-fdc6029aa62d', 'volume_name': 'volume-d7cf227d-e7c6-4f00-8710-fdc6029aa62d', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:32:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-00742ebd-31a8-4153-9d07-8bc0f2f1f13d tempest-AttachVolumeNegativeTest-625165533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (123bc90c-1c47-4a91-8afc-6d2d529c9286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:32:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-00742ebd-31a8-4153-9d07-8bc0f2f1f13d tempest-AttachVolumeNegativeTest-625165533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (123bc90c-1c47-4a91-8afc-6d2d529c9286) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:32:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-00742ebd-31a8-4153-9d07-8bc0f2f1f13d tempest-AttachVolumeNegativeTest-625165533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b403f99-f04f-4fb5-b78c-c95885d2699d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:32:12 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-00742ebd-31a8-4153-9d07-8bc0f2f1f13d tempest-AttachVolumeNegativeTest-625165533 None] Volume d7cf227d-e7c6-4f00-8710-fdc6029aa62d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7cf227d-e7c6-4f00-8710-fdc6029aa62d', 'volume_size': 1} Nov 06 15:32:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-00742ebd-31a8-4153-9d07-8bc0f2f1f13d tempest-AttachVolumeNegativeTest-625165533 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:32:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-00742ebd-31a8-4153-9d07-8bc0f2f1f13d tempest-AttachVolumeNegativeTest-625165533 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:32:12 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-00742ebd-31a8-4153-9d07-8bc0f2f1f13d tempest-AttachVolumeNegativeTest-625165533 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:32:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2097098758',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7cf227d-e7c6-4f00-8710-fdc6029aa62d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73884d0c897e4937a8a62ca22bd0d56c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:32:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:32:12Z,use_quota=True,user_id='5d17ede13c034abf8a132cac03a00a09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:32:12 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-00742ebd-31a8-4153-9d07-8bc0f2f1f13d tempest-AttachVolumeNegativeTest-625165533 None] Creating volume d7cf227d-e7c6-4f00-8710-fdc6029aa62d {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:32:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-00742ebd-31a8-4153-9d07-8bc0f2f1f13d tempest-AttachVolumeNegativeTest-625165533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:32:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-00742ebd-31a8-4153-9d07-8bc0f2f1f13d tempest-AttachVolumeNegativeTest-625165533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:32:12 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-00742ebd-31a8-4153-9d07-8bc0f2f1f13d tempest-AttachVolumeNegativeTest-625165533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:32:12 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-00742ebd-31a8-4153-9d07-8bc0f2f1f13d tempest-AttachVolumeNegativeTest-625165533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:32:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-00742ebd-31a8-4153-9d07-8bc0f2f1f13d tempest-AttachVolumeNegativeTest-625165533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:32:12 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-00742ebd-31a8-4153-9d07-8bc0f2f1f13d tempest-AttachVolumeNegativeTest-625165533 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:32:12 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-00742ebd-31a8-4153-9d07-8bc0f2f1f13d tempest-AttachVolumeNegativeTest-625165533 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:32:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-00742ebd-31a8-4153-9d07-8bc0f2f1f13d tempest-AttachVolumeNegativeTest-625165533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d7cf227d-e7c6-4f00-8710-fdc6029aa62d 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:32:12 devstack sudo[102220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d7cf227d-e7c6-4f00-8710-fdc6029aa62d 1073741824 Nov 06 15:32:12 devstack sudo[102220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:32:12 devstack sudo[102220]: pam_unix(sudo:session): session closed for user root Nov 06 15:32:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-00742ebd-31a8-4153-9d07-8bc0f2f1f13d tempest-AttachVolumeNegativeTest-625165533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d7cf227d-e7c6-4f00-8710-fdc6029aa62d 1073741824" returned: 0 in 0.428s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:32:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-00742ebd-31a8-4153-9d07-8bc0f2f1f13d tempest-AttachVolumeNegativeTest-625165533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d7cf227d-e7c6-4f00-8710-fdc6029aa62d {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:32:12 devstack sudo[102225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d7cf227d-e7c6-4f00-8710-fdc6029aa62d Nov 06 15:32:12 devstack sudo[102225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:32:12 devstack sudo[102225]: pam_unix(sudo:session): session closed for user root Nov 06 15:32:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-00742ebd-31a8-4153-9d07-8bc0f2f1f13d tempest-AttachVolumeNegativeTest-625165533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d7cf227d-e7c6-4f00-8710-fdc6029aa62d" returned: 0 in 0.238s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:32:12 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-00742ebd-31a8-4153-9d07-8bc0f2f1f13d tempest-AttachVolumeNegativeTest-625165533 None] <== create_volume: return (704ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:32:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-00742ebd-31a8-4153-9d07-8bc0f2f1f13d tempest-AttachVolumeNegativeTest-625165533 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.706s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:32:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-00742ebd-31a8-4153-9d07-8bc0f2f1f13d tempest-AttachVolumeNegativeTest-625165533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b403f99-f04f-4fb5-b78c-c95885d2699d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7cf227d-e7c6-4f00-8710-fdc6029aa62d', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:32:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-00742ebd-31a8-4153-9d07-8bc0f2f1f13d tempest-AttachVolumeNegativeTest-625165533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14698686-682b-49e7-9c80-2b6a68fe9d70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:32:12 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-00742ebd-31a8-4153-9d07-8bc0f2f1f13d tempest-AttachVolumeNegativeTest-625165533 None] Volume volume-d7cf227d-e7c6-4f00-8710-fdc6029aa62d (d7cf227d-e7c6-4f00-8710-fdc6029aa62d): created successfully Nov 06 15:32:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-00742ebd-31a8-4153-9d07-8bc0f2f1f13d tempest-AttachVolumeNegativeTest-625165533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14698686-682b-49e7-9c80-2b6a68fe9d70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:32:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-00742ebd-31a8-4153-9d07-8bc0f2f1f13d tempest-AttachVolumeNegativeTest-625165533 None] Flow 'volume_create_manager' (36e58cb2-eab7-42d5-b999-ac77afd6ca37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:32:12 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-00742ebd-31a8-4153-9d07-8bc0f2f1f13d tempest-AttachVolumeNegativeTest-625165533 None] Created volume successfully. Nov 06 15:32:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-02c1d7a9-9e2b-44e4-b9b4-ecaa1a09baa2 req-958a14ca-51b0-4504-911a-d2d3079f3173 tempest-AttachVolumeNegativeTest-625165533 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:32:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-02c1d7a9-9e2b-44e4-b9b4-ecaa1a09baa2 req-958a14ca-51b0-4504-911a-d2d3079f3173 tempest-AttachVolumeNegativeTest-625165533 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:32:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-02c1d7a9-9e2b-44e4-b9b4-ecaa1a09baa2 req-958a14ca-51b0-4504-911a-d2d3079f3173 tempest-AttachVolumeNegativeTest-625165533 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.010s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:32:13 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-02c1d7a9-9e2b-44e4-b9b4-ecaa1a09baa2 req-958a14ca-51b0-4504-911a-d2d3079f3173 tempest-AttachVolumeNegativeTest-625165533 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b', 'name': 'volume-d7cf227d-e7c6-4f00-8710-fdc6029aa62d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cdc6dc4a-4f16-4bc5-9e5b-e131beebc461', 'enforce_multipath': True} {{(pid=87132) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 15:32:13 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-02c1d7a9-9e2b-44e4-b9b4-ecaa1a09baa2 req-958a14ca-51b0-4504-911a-d2d3079f3173 tempest-AttachVolumeNegativeTest-625165533 None] attachment_update completed successfully. Nov 06 15:32:15 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-b23c8399-c082-41d7-8d30-160fa8ed05f3 req-888025c0-abb4-4dab-a903-e27a29d7d54b tempest-AttachVolumeNegativeTest-625165533 None] Terminate volume connection completed successfully. Nov 06 15:32:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-b23c8399-c082-41d7-8d30-160fa8ed05f3 req-888025c0-abb4-4dab-a903-e27a29d7d54b tempest-AttachVolumeNegativeTest-625165533 None] Deleting attachment cdc6dc4a-4f16-4bc5-9e5b-e131beebc461. {{(pid=87132) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 06 15:32:25 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:SELECT=8,cinder:UPDATE=5,cinder:INSERT=1 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 15:32:25 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:UPDATE=4,cinder:SELECT=11,cinder:DELETE=1 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 15:32:49 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-215521b8-f43d-452b-a467-7a449f875ebc tempest-AttachVolumeNegativeTest-625165533 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:32:49 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-215521b8-f43d-452b-a467-7a449f875ebc tempest-AttachVolumeNegativeTest-625165533 None] Flow 'volume_create_manager' (9ede36d2-b83c-4c67-b9fe-ac53eb064362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:32:49 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-215521b8-f43d-452b-a467-7a449f875ebc tempest-AttachVolumeNegativeTest-625165533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (951642b2-8ae8-4ef8-bd2d-377930e81dad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:32:49 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-215521b8-f43d-452b-a467-7a449f875ebc tempest-AttachVolumeNegativeTest-625165533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (951642b2-8ae8-4ef8-bd2d-377930e81dad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:32:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-56781331',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efd32569-72ef-40f2-bfb0-bc6e72e78374,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73884d0c897e4937a8a62ca22bd0d56c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:32:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:32:49Z,use_quota=True,user_id='5d17ede13c034abf8a132cac03a00a09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:32:49 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-215521b8-f43d-452b-a467-7a449f875ebc tempest-AttachVolumeNegativeTest-625165533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a701d0d-4c78-4305-87e5-4ea7a6a37e36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:32:49 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-215521b8-f43d-452b-a467-7a449f875ebc tempest-AttachVolumeNegativeTest-625165533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a701d0d-4c78-4305-87e5-4ea7a6a37e36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:32:49 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-215521b8-f43d-452b-a467-7a449f875ebc tempest-AttachVolumeNegativeTest-625165533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (865cc9b0-9493-48ea-96a1-649d92032c40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:32:49 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-215521b8-f43d-452b-a467-7a449f875ebc tempest-AttachVolumeNegativeTest-625165533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (865cc9b0-9493-48ea-96a1-649d92032c40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'efd32569-72ef-40f2-bfb0-bc6e72e78374', 'volume_name': 'volume-efd32569-72ef-40f2-bfb0-bc6e72e78374', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:32:49 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-215521b8-f43d-452b-a467-7a449f875ebc tempest-AttachVolumeNegativeTest-625165533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c643d0c-e812-4ac5-bb2a-b9d022cbcc05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:32:49 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-215521b8-f43d-452b-a467-7a449f875ebc tempest-AttachVolumeNegativeTest-625165533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c643d0c-e812-4ac5-bb2a-b9d022cbcc05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:32:49 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-215521b8-f43d-452b-a467-7a449f875ebc tempest-AttachVolumeNegativeTest-625165533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9e02b6b-3175-458f-bcf0-19f04a16e581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:32:49 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-215521b8-f43d-452b-a467-7a449f875ebc tempest-AttachVolumeNegativeTest-625165533 None] Volume efd32569-72ef-40f2-bfb0-bc6e72e78374: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-efd32569-72ef-40f2-bfb0-bc6e72e78374', 'volume_size': 1} Nov 06 15:32:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-215521b8-f43d-452b-a467-7a449f875ebc tempest-AttachVolumeNegativeTest-625165533 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:32:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-215521b8-f43d-452b-a467-7a449f875ebc tempest-AttachVolumeNegativeTest-625165533 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:32:49 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-215521b8-f43d-452b-a467-7a449f875ebc tempest-AttachVolumeNegativeTest-625165533 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:32:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-56781331',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efd32569-72ef-40f2-bfb0-bc6e72e78374,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73884d0c897e4937a8a62ca22bd0d56c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:32:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:32:49Z,use_quota=True,user_id='5d17ede13c034abf8a132cac03a00a09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:32:49 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-215521b8-f43d-452b-a467-7a449f875ebc tempest-AttachVolumeNegativeTest-625165533 None] Creating volume efd32569-72ef-40f2-bfb0-bc6e72e78374 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:32:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-215521b8-f43d-452b-a467-7a449f875ebc tempest-AttachVolumeNegativeTest-625165533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:32:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-215521b8-f43d-452b-a467-7a449f875ebc tempest-AttachVolumeNegativeTest-625165533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:32:49 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-215521b8-f43d-452b-a467-7a449f875ebc tempest-AttachVolumeNegativeTest-625165533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:32:49 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-215521b8-f43d-452b-a467-7a449f875ebc tempest-AttachVolumeNegativeTest-625165533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:32:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-215521b8-f43d-452b-a467-7a449f875ebc tempest-AttachVolumeNegativeTest-625165533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:32:49 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-215521b8-f43d-452b-a467-7a449f875ebc tempest-AttachVolumeNegativeTest-625165533 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:32:49 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-215521b8-f43d-452b-a467-7a449f875ebc tempest-AttachVolumeNegativeTest-625165533 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:32:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-215521b8-f43d-452b-a467-7a449f875ebc tempest-AttachVolumeNegativeTest-625165533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-efd32569-72ef-40f2-bfb0-bc6e72e78374 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:32:49 devstack sudo[102822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-efd32569-72ef-40f2-bfb0-bc6e72e78374 1073741824 Nov 06 15:32:49 devstack sudo[102822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:32:49 devstack sudo[102822]: pam_unix(sudo:session): session closed for user root Nov 06 15:32:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-215521b8-f43d-452b-a467-7a449f875ebc tempest-AttachVolumeNegativeTest-625165533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-efd32569-72ef-40f2-bfb0-bc6e72e78374 1073741824" returned: 0 in 0.419s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:32:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-215521b8-f43d-452b-a467-7a449f875ebc tempest-AttachVolumeNegativeTest-625165533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-efd32569-72ef-40f2-bfb0-bc6e72e78374 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:32:49 devstack sudo[102828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-efd32569-72ef-40f2-bfb0-bc6e72e78374 Nov 06 15:32:49 devstack sudo[102828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:32:49 devstack sudo[102828]: pam_unix(sudo:session): session closed for user root Nov 06 15:32:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-215521b8-f43d-452b-a467-7a449f875ebc tempest-AttachVolumeNegativeTest-625165533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-efd32569-72ef-40f2-bfb0-bc6e72e78374" returned: 0 in 0.244s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:32:49 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-215521b8-f43d-452b-a467-7a449f875ebc tempest-AttachVolumeNegativeTest-625165533 None] <== create_volume: return (702ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:32:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-215521b8-f43d-452b-a467-7a449f875ebc tempest-AttachVolumeNegativeTest-625165533 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.705s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:32:49 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-215521b8-f43d-452b-a467-7a449f875ebc tempest-AttachVolumeNegativeTest-625165533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9e02b6b-3175-458f-bcf0-19f04a16e581) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-efd32569-72ef-40f2-bfb0-bc6e72e78374', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:32:49 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-215521b8-f43d-452b-a467-7a449f875ebc tempest-AttachVolumeNegativeTest-625165533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d82e89e-2637-4522-bac6-e99c4144c33d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:32:49 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-215521b8-f43d-452b-a467-7a449f875ebc tempest-AttachVolumeNegativeTest-625165533 None] Volume volume-efd32569-72ef-40f2-bfb0-bc6e72e78374 (efd32569-72ef-40f2-bfb0-bc6e72e78374): created successfully Nov 06 15:32:49 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-215521b8-f43d-452b-a467-7a449f875ebc tempest-AttachVolumeNegativeTest-625165533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d82e89e-2637-4522-bac6-e99c4144c33d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:32:49 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-215521b8-f43d-452b-a467-7a449f875ebc tempest-AttachVolumeNegativeTest-625165533 None] Flow 'volume_create_manager' (9ede36d2-b83c-4c67-b9fe-ac53eb064362) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:32:49 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-215521b8-f43d-452b-a467-7a449f875ebc tempest-AttachVolumeNegativeTest-625165533 None] Created volume successfully. Nov 06 15:32:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-f9416553-e410-455f-b885-ae1a2856db8e req-db7f2fdc-10a5-455f-98e8-6c6a567a03d8 tempest-AttachVolumeNegativeTest-625165533 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:32:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-f9416553-e410-455f-b885-ae1a2856db8e req-db7f2fdc-10a5-455f-98e8-6c6a567a03d8 tempest-AttachVolumeNegativeTest-625165533 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:32:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-f9416553-e410-455f-b885-ae1a2856db8e req-db7f2fdc-10a5-455f-98e8-6c6a567a03d8 tempest-AttachVolumeNegativeTest-625165533 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:32:50 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-f9416553-e410-455f-b885-ae1a2856db8e req-db7f2fdc-10a5-455f-98e8-6c6a567a03d8 tempest-AttachVolumeNegativeTest-625165533 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b', 'name': 'volume-efd32569-72ef-40f2-bfb0-bc6e72e78374', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4a8ff2c2-a65c-482a-b9ce-8884bd6b9c09', 'enforce_multipath': True} {{(pid=87132) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 15:32:50 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-f9416553-e410-455f-b885-ae1a2856db8e req-db7f2fdc-10a5-455f-98e8-6c6a567a03d8 tempest-AttachVolumeNegativeTest-625165533 None] attachment_update completed successfully. Nov 06 15:32:53 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-91d243f1-a790-4686-ba66-5f35d0eb007f req-841fadac-ba7a-4b0e-972d-24764919418d tempest-AttachVolumeNegativeTest-625165533 None] Terminate volume connection completed successfully. Nov 06 15:32:53 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-91d243f1-a790-4686-ba66-5f35d0eb007f req-841fadac-ba7a-4b0e-972d-24764919418d tempest-AttachVolumeNegativeTest-625165533 None] Deleting attachment 4a8ff2c2-a65c-482a-b9ce-8884bd6b9c09. {{(pid=87132) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 06 15:32:57 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-db9baa25-cc7a-40ef-975f-932ba2ed01a8 tempest-AttachVolumeNegativeTest-625165533 None] Acquiring lock "cinder-efd32569-72ef-40f2-bfb0-bc6e72e78374-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:32:57 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-db9baa25-cc7a-40ef-975f-932ba2ed01a8 tempest-AttachVolumeNegativeTest-625165533 None] Lock "cinder-efd32569-72ef-40f2-bfb0-bc6e72e78374-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:32:57 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-db9baa25-cc7a-40ef-975f-932ba2ed01a8 tempest-AttachVolumeNegativeTest-625165533 None] Acquiring lock "cinder-quobyte-efd32569-72ef-40f2-bfb0-bc6e72e78374" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:32:57 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-db9baa25-cc7a-40ef-975f-932ba2ed01a8 tempest-AttachVolumeNegativeTest-625165533 None] Lock "cinder-quobyte-efd32569-72ef-40f2-bfb0-bc6e72e78374" acquired by "delete_volume" :: waited 0.016s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:32:57 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[c88517bd-866f-4e90-a92e-54ecacf7ef1f]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:32:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-db9baa25-cc7a-40ef-975f-932ba2ed01a8 tempest-AttachVolumeNegativeTest-625165533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-efd32569-72ef-40f2-bfb0-bc6e72e78374 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:32:57 devstack sudo[103316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-efd32569-72ef-40f2-bfb0-bc6e72e78374 Nov 06 15:32:57 devstack sudo[103316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:32:58 devstack sudo[103316]: pam_unix(sudo:session): session closed for user root Nov 06 15:32:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-db9baa25-cc7a-40ef-975f-932ba2ed01a8 tempest-AttachVolumeNegativeTest-625165533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-efd32569-72ef-40f2-bfb0-bc6e72e78374" returned: 0 in 0.366s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:32:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-db9baa25-cc7a-40ef-975f-932ba2ed01a8 tempest-AttachVolumeNegativeTest-625165533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-efd32569-72ef-40f2-bfb0-bc6e72e78374 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:32:58 devstack sudo[103322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-efd32569-72ef-40f2-bfb0-bc6e72e78374 Nov 06 15:32:58 devstack sudo[103322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:32:58 devstack sudo[103322]: pam_unix(sudo:session): session closed for user root Nov 06 15:32:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-db9baa25-cc7a-40ef-975f-932ba2ed01a8 tempest-AttachVolumeNegativeTest-625165533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-efd32569-72ef-40f2-bfb0-bc6e72e78374" returned: 0 in 0.249s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:32:58 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-db9baa25-cc7a-40ef-975f-932ba2ed01a8 tempest-AttachVolumeNegativeTest-625165533 None] Lock "cinder-quobyte-efd32569-72ef-40f2-bfb0-bc6e72e78374" released by "delete_volume" :: held 0.658s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:32:58 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-db9baa25-cc7a-40ef-975f-932ba2ed01a8 tempest-AttachVolumeNegativeTest-625165533 None] Created reservations ['93655171-6529-4477-bd7e-ad60e079185c', '2c031262-dd16-4483-826d-fa26235a46b0', '6ff19994-8686-4382-95e9-8385f3402426', '2d307fe3-87f9-43c8-9b8d-dd19fda0e25b'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:32:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-db9baa25-cc7a-40ef-975f-932ba2ed01a8 tempest-AttachVolumeNegativeTest-625165533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:32:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-db9baa25-cc7a-40ef-975f-932ba2ed01a8 tempest-AttachVolumeNegativeTest-625165533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:32:58 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-db9baa25-cc7a-40ef-975f-932ba2ed01a8 tempest-AttachVolumeNegativeTest-625165533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:32:58 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-db9baa25-cc7a-40ef-975f-932ba2ed01a8 tempest-AttachVolumeNegativeTest-625165533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:32:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-db9baa25-cc7a-40ef-975f-932ba2ed01a8 tempest-AttachVolumeNegativeTest-625165533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:32:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-db9baa25-cc7a-40ef-975f-932ba2ed01a8 tempest-AttachVolumeNegativeTest-625165533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:32:58 devstack sudo[103361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:32:58 devstack sudo[103361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:32:58 devstack sudo[103361]: pam_unix(sudo:session): session closed for user root Nov 06 15:32:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-db9baa25-cc7a-40ef-975f-932ba2ed01a8 tempest-AttachVolumeNegativeTest-625165533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.239s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:32:58 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-db9baa25-cc7a-40ef-975f-932ba2ed01a8 tempest-AttachVolumeNegativeTest-625165533 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:32:58 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-db9baa25-cc7a-40ef-975f-932ba2ed01a8 tempest-AttachVolumeNegativeTest-625165533 None] Deleted volume successfully. Nov 06 15:32:58 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-db9baa25-cc7a-40ef-975f-932ba2ed01a8 tempest-AttachVolumeNegativeTest-625165533 None] Lock "cinder-efd32569-72ef-40f2-bfb0-bc6e72e78374-delete_volume" released by "delete_volume" :: held 1.098s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:32:59 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-75adfd6f-1cbd-4139-a86b-82d10ba69f7c tempest-AttachVolumeNegativeTest-625165533 None] Acquiring lock "cinder-d7cf227d-e7c6-4f00-8710-fdc6029aa62d-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:32:59 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-75adfd6f-1cbd-4139-a86b-82d10ba69f7c tempest-AttachVolumeNegativeTest-625165533 None] Lock "cinder-d7cf227d-e7c6-4f00-8710-fdc6029aa62d-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:32:59 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-75adfd6f-1cbd-4139-a86b-82d10ba69f7c tempest-AttachVolumeNegativeTest-625165533 None] Acquiring lock "cinder-quobyte-d7cf227d-e7c6-4f00-8710-fdc6029aa62d" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:32:59 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-75adfd6f-1cbd-4139-a86b-82d10ba69f7c tempest-AttachVolumeNegativeTest-625165533 None] Lock "cinder-quobyte-d7cf227d-e7c6-4f00-8710-fdc6029aa62d" acquired by "delete_volume" :: waited 0.014s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:32:59 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[228281c0-f4fe-4496-a5b9-1662471d76a1]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:32:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-75adfd6f-1cbd-4139-a86b-82d10ba69f7c tempest-AttachVolumeNegativeTest-625165533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d7cf227d-e7c6-4f00-8710-fdc6029aa62d {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:32:59 devstack sudo[103364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d7cf227d-e7c6-4f00-8710-fdc6029aa62d Nov 06 15:32:59 devstack sudo[103364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:32:59 devstack sudo[103364]: pam_unix(sudo:session): session closed for user root Nov 06 15:32:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-75adfd6f-1cbd-4139-a86b-82d10ba69f7c tempest-AttachVolumeNegativeTest-625165533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d7cf227d-e7c6-4f00-8710-fdc6029aa62d" returned: 0 in 0.360s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:32:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-75adfd6f-1cbd-4139-a86b-82d10ba69f7c tempest-AttachVolumeNegativeTest-625165533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d7cf227d-e7c6-4f00-8710-fdc6029aa62d {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:32:59 devstack sudo[103370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d7cf227d-e7c6-4f00-8710-fdc6029aa62d Nov 06 15:32:59 devstack sudo[103370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:32:59 devstack sudo[103370]: pam_unix(sudo:session): session closed for user root Nov 06 15:32:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-75adfd6f-1cbd-4139-a86b-82d10ba69f7c tempest-AttachVolumeNegativeTest-625165533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d7cf227d-e7c6-4f00-8710-fdc6029aa62d" returned: 0 in 0.246s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:32:59 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-75adfd6f-1cbd-4139-a86b-82d10ba69f7c tempest-AttachVolumeNegativeTest-625165533 None] Lock "cinder-quobyte-d7cf227d-e7c6-4f00-8710-fdc6029aa62d" released by "delete_volume" :: held 0.647s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:32:59 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-75adfd6f-1cbd-4139-a86b-82d10ba69f7c tempest-AttachVolumeNegativeTest-625165533 None] Created reservations ['bf415048-6203-4c24-8360-a023d7293700', 'b98faca5-b304-453b-aa0f-6301ca7dfc2b', '691cb540-c368-4ddc-a102-586d140f2bd1', '765e1280-6f8c-4d11-8c09-bf106c6a57df'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:32:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-75adfd6f-1cbd-4139-a86b-82d10ba69f7c tempest-AttachVolumeNegativeTest-625165533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:32:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-75adfd6f-1cbd-4139-a86b-82d10ba69f7c tempest-AttachVolumeNegativeTest-625165533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:32:59 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-75adfd6f-1cbd-4139-a86b-82d10ba69f7c tempest-AttachVolumeNegativeTest-625165533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:32:59 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-75adfd6f-1cbd-4139-a86b-82d10ba69f7c tempest-AttachVolumeNegativeTest-625165533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:32:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-75adfd6f-1cbd-4139-a86b-82d10ba69f7c tempest-AttachVolumeNegativeTest-625165533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:32:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-75adfd6f-1cbd-4139-a86b-82d10ba69f7c tempest-AttachVolumeNegativeTest-625165533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:32:59 devstack sudo[103373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:32:59 devstack sudo[103373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:33:00 devstack sudo[103373]: pam_unix(sudo:session): session closed for user root Nov 06 15:33:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-75adfd6f-1cbd-4139-a86b-82d10ba69f7c tempest-AttachVolumeNegativeTest-625165533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.239s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:33:00 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-75adfd6f-1cbd-4139-a86b-82d10ba69f7c tempest-AttachVolumeNegativeTest-625165533 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:33:00 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-75adfd6f-1cbd-4139-a86b-82d10ba69f7c tempest-AttachVolumeNegativeTest-625165533 None] Deleted volume successfully. Nov 06 15:33:00 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-75adfd6f-1cbd-4139-a86b-82d10ba69f7c tempest-AttachVolumeNegativeTest-625165533 None] Lock "cinder-d7cf227d-e7c6-4f00-8710-fdc6029aa62d-delete_volume" released by "delete_volume" :: held 1.062s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:33:00 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-0ea9caba-def8-4da5-99c1-c23306000067 tempest-AttachVolumeNegativeTest-625165533 None] Acquiring lock "cinder-f32da07e-27a7-49d6-ae41-46fb66d4ace4-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:33:00 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-0ea9caba-def8-4da5-99c1-c23306000067 tempest-AttachVolumeNegativeTest-625165533 None] Lock "cinder-f32da07e-27a7-49d6-ae41-46fb66d4ace4-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:33:00 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-0ea9caba-def8-4da5-99c1-c23306000067 tempest-AttachVolumeNegativeTest-625165533 None] Acquiring lock "cinder-quobyte-f32da07e-27a7-49d6-ae41-46fb66d4ace4" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:33:00 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-0ea9caba-def8-4da5-99c1-c23306000067 tempest-AttachVolumeNegativeTest-625165533 None] Lock "cinder-quobyte-f32da07e-27a7-49d6-ae41-46fb66d4ace4" acquired by "delete_volume" :: waited 0.014s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:33:00 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[43e6dc93-5b86-4016-9767-8b14939c90bc]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:33:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0ea9caba-def8-4da5-99c1-c23306000067 tempest-AttachVolumeNegativeTest-625165533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f32da07e-27a7-49d6-ae41-46fb66d4ace4 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:33:00 devstack sudo[103376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f32da07e-27a7-49d6-ae41-46fb66d4ace4 Nov 06 15:33:00 devstack sudo[103376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:33:00 devstack sudo[103376]: pam_unix(sudo:session): session closed for user root Nov 06 15:33:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0ea9caba-def8-4da5-99c1-c23306000067 tempest-AttachVolumeNegativeTest-625165533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f32da07e-27a7-49d6-ae41-46fb66d4ace4" returned: 0 in 0.353s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:33:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0ea9caba-def8-4da5-99c1-c23306000067 tempest-AttachVolumeNegativeTest-625165533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f32da07e-27a7-49d6-ae41-46fb66d4ace4 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:33:00 devstack sudo[103381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f32da07e-27a7-49d6-ae41-46fb66d4ace4 Nov 06 15:33:00 devstack sudo[103381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:33:01 devstack sudo[103381]: pam_unix(sudo:session): session closed for user root Nov 06 15:33:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0ea9caba-def8-4da5-99c1-c23306000067 tempest-AttachVolumeNegativeTest-625165533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f32da07e-27a7-49d6-ae41-46fb66d4ace4" returned: 0 in 0.238s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:33:01 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-0ea9caba-def8-4da5-99c1-c23306000067 tempest-AttachVolumeNegativeTest-625165533 None] Lock "cinder-quobyte-f32da07e-27a7-49d6-ae41-46fb66d4ace4" released by "delete_volume" :: held 0.633s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:33:01 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-0ea9caba-def8-4da5-99c1-c23306000067 tempest-AttachVolumeNegativeTest-625165533 None] Created reservations ['89161634-f674-4c19-9820-e2091114151d', '73fb0f1d-9035-4abd-8bb9-bbc3da22927d', 'a05eb8e9-1f4c-4777-abe4-f149a1bf1470', '35815753-4fd7-4e95-ba0c-56501f61973f'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:33:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0ea9caba-def8-4da5-99c1-c23306000067 tempest-AttachVolumeNegativeTest-625165533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:33:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0ea9caba-def8-4da5-99c1-c23306000067 tempest-AttachVolumeNegativeTest-625165533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:33:01 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0ea9caba-def8-4da5-99c1-c23306000067 tempest-AttachVolumeNegativeTest-625165533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:33:01 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0ea9caba-def8-4da5-99c1-c23306000067 tempest-AttachVolumeNegativeTest-625165533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:33:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0ea9caba-def8-4da5-99c1-c23306000067 tempest-AttachVolumeNegativeTest-625165533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:33:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0ea9caba-def8-4da5-99c1-c23306000067 tempest-AttachVolumeNegativeTest-625165533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:33:01 devstack sudo[103384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:33:01 devstack sudo[103384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:33:01 devstack sudo[103384]: pam_unix(sudo:session): session closed for user root Nov 06 15:33:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0ea9caba-def8-4da5-99c1-c23306000067 tempest-AttachVolumeNegativeTest-625165533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.253s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:33:01 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-0ea9caba-def8-4da5-99c1-c23306000067 tempest-AttachVolumeNegativeTest-625165533 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:33:01 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-0ea9caba-def8-4da5-99c1-c23306000067 tempest-AttachVolumeNegativeTest-625165533 None] Deleted volume successfully. Nov 06 15:33:01 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-0ea9caba-def8-4da5-99c1-c23306000067 tempest-AttachVolumeNegativeTest-625165533 None] Lock "cinder-f32da07e-27a7-49d6-ae41-46fb66d4ace4-delete_volume" released by "delete_volume" :: held 1.072s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:33:08 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 15:33:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:33:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:33:08 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:33:08 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:33:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:33:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:33:08 devstack sudo[103392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:33:08 devstack sudo[103392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:33:08 devstack sudo[103392]: pam_unix(sudo:session): session closed for user root Nov 06 15:33:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.247s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:33:08 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:33:08 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Running periodic task VolumeManager._thread_info {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 15:33:08 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] thread count: 28 {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 15:33:08 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] thread info: [<_MainThread(MainThread, started 140011251929216)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 06 15:33:09 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-50ae4aeb-a73f-4afa-8796-a8817978bdd1 tempest-VolumeQuotasAdminTestJSON-525517518 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:33:09 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-50ae4aeb-a73f-4afa-8796-a8817978bdd1 tempest-VolumeQuotasAdminTestJSON-525517518 None] Flow 'volume_create_manager' (db2590cf-3655-473d-b5e0-cc620b011020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:33:09 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-50ae4aeb-a73f-4afa-8796-a8817978bdd1 tempest-VolumeQuotasAdminTestJSON-525517518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68fad146-d1cf-4220-9ec9-6595c58c9903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:33:09 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-50ae4aeb-a73f-4afa-8796-a8817978bdd1 tempest-VolumeQuotasAdminTestJSON-525517518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68fad146-d1cf-4220-9ec9-6595c58c9903) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:33:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1633812539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6659e006-a61b-42f7-9984-50c484f87079,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3f414e3d4804d17ac565d28a93624c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:33:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:33:10Z,use_quota=True,user_id='b3083477ce5f42589b61768194e014f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:33:09 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-50ae4aeb-a73f-4afa-8796-a8817978bdd1 tempest-VolumeQuotasAdminTestJSON-525517518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae322899-eac9-4589-a83d-85b68c6c99da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:33:09 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-50ae4aeb-a73f-4afa-8796-a8817978bdd1 tempest-VolumeQuotasAdminTestJSON-525517518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae322899-eac9-4589-a83d-85b68c6c99da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:33:09 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-50ae4aeb-a73f-4afa-8796-a8817978bdd1 tempest-VolumeQuotasAdminTestJSON-525517518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03557d43-23bd-4fc3-b663-73f7b8412a2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:33:09 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-50ae4aeb-a73f-4afa-8796-a8817978bdd1 tempest-VolumeQuotasAdminTestJSON-525517518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03557d43-23bd-4fc3-b663-73f7b8412a2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6659e006-a61b-42f7-9984-50c484f87079', 'volume_name': 'volume-6659e006-a61b-42f7-9984-50c484f87079', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:33:09 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-50ae4aeb-a73f-4afa-8796-a8817978bdd1 tempest-VolumeQuotasAdminTestJSON-525517518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d6f2445-167c-4339-82cb-43cc8c404520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:33:09 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-50ae4aeb-a73f-4afa-8796-a8817978bdd1 tempest-VolumeQuotasAdminTestJSON-525517518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d6f2445-167c-4339-82cb-43cc8c404520) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:33:09 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-50ae4aeb-a73f-4afa-8796-a8817978bdd1 tempest-VolumeQuotasAdminTestJSON-525517518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1860677c-9d42-4e0c-abfe-b2982cb84d37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:33:09 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-50ae4aeb-a73f-4afa-8796-a8817978bdd1 tempest-VolumeQuotasAdminTestJSON-525517518 None] Volume 6659e006-a61b-42f7-9984-50c484f87079: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6659e006-a61b-42f7-9984-50c484f87079', 'volume_size': 1} Nov 06 15:33:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-50ae4aeb-a73f-4afa-8796-a8817978bdd1 tempest-VolumeQuotasAdminTestJSON-525517518 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:33:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-50ae4aeb-a73f-4afa-8796-a8817978bdd1 tempest-VolumeQuotasAdminTestJSON-525517518 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:33:09 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-50ae4aeb-a73f-4afa-8796-a8817978bdd1 tempest-VolumeQuotasAdminTestJSON-525517518 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:33:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1633812539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6659e006-a61b-42f7-9984-50c484f87079,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3f414e3d4804d17ac565d28a93624c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:33:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:33:10Z,use_quota=True,user_id='b3083477ce5f42589b61768194e014f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:33:09 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-50ae4aeb-a73f-4afa-8796-a8817978bdd1 tempest-VolumeQuotasAdminTestJSON-525517518 None] Creating volume 6659e006-a61b-42f7-9984-50c484f87079 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:33:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-50ae4aeb-a73f-4afa-8796-a8817978bdd1 tempest-VolumeQuotasAdminTestJSON-525517518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:33:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-50ae4aeb-a73f-4afa-8796-a8817978bdd1 tempest-VolumeQuotasAdminTestJSON-525517518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:33:09 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-50ae4aeb-a73f-4afa-8796-a8817978bdd1 tempest-VolumeQuotasAdminTestJSON-525517518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:33:09 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-50ae4aeb-a73f-4afa-8796-a8817978bdd1 tempest-VolumeQuotasAdminTestJSON-525517518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:33:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-50ae4aeb-a73f-4afa-8796-a8817978bdd1 tempest-VolumeQuotasAdminTestJSON-525517518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:33:09 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-50ae4aeb-a73f-4afa-8796-a8817978bdd1 tempest-VolumeQuotasAdminTestJSON-525517518 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:33:09 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-50ae4aeb-a73f-4afa-8796-a8817978bdd1 tempest-VolumeQuotasAdminTestJSON-525517518 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:33:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-50ae4aeb-a73f-4afa-8796-a8817978bdd1 tempest-VolumeQuotasAdminTestJSON-525517518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-6659e006-a61b-42f7-9984-50c484f87079 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:33:09 devstack sudo[103395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-6659e006-a61b-42f7-9984-50c484f87079 1073741824 Nov 06 15:33:09 devstack sudo[103395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:33:10 devstack sudo[103395]: pam_unix(sudo:session): session closed for user root Nov 06 15:33:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-50ae4aeb-a73f-4afa-8796-a8817978bdd1 tempest-VolumeQuotasAdminTestJSON-525517518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-6659e006-a61b-42f7-9984-50c484f87079 1073741824" returned: 0 in 0.393s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:33:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-50ae4aeb-a73f-4afa-8796-a8817978bdd1 tempest-VolumeQuotasAdminTestJSON-525517518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-6659e006-a61b-42f7-9984-50c484f87079 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:33:10 devstack sudo[103400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-6659e006-a61b-42f7-9984-50c484f87079 Nov 06 15:33:10 devstack sudo[103400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:33:10 devstack sudo[103400]: pam_unix(sudo:session): session closed for user root Nov 06 15:33:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-50ae4aeb-a73f-4afa-8796-a8817978bdd1 tempest-VolumeQuotasAdminTestJSON-525517518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-6659e006-a61b-42f7-9984-50c484f87079" returned: 0 in 0.258s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:33:10 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-50ae4aeb-a73f-4afa-8796-a8817978bdd1 tempest-VolumeQuotasAdminTestJSON-525517518 None] <== create_volume: return (689ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:33:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-50ae4aeb-a73f-4afa-8796-a8817978bdd1 tempest-VolumeQuotasAdminTestJSON-525517518 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.693s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:33:10 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-50ae4aeb-a73f-4afa-8796-a8817978bdd1 tempest-VolumeQuotasAdminTestJSON-525517518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1860677c-9d42-4e0c-abfe-b2982cb84d37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6659e006-a61b-42f7-9984-50c484f87079', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:33:10 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-50ae4aeb-a73f-4afa-8796-a8817978bdd1 tempest-VolumeQuotasAdminTestJSON-525517518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05aedaa2-50f5-433e-80c0-cfe4a51c7ed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:33:10 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-50ae4aeb-a73f-4afa-8796-a8817978bdd1 tempest-VolumeQuotasAdminTestJSON-525517518 None] Volume volume-6659e006-a61b-42f7-9984-50c484f87079 (6659e006-a61b-42f7-9984-50c484f87079): created successfully Nov 06 15:33:10 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-50ae4aeb-a73f-4afa-8796-a8817978bdd1 tempest-VolumeQuotasAdminTestJSON-525517518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05aedaa2-50f5-433e-80c0-cfe4a51c7ed8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:33:10 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-50ae4aeb-a73f-4afa-8796-a8817978bdd1 tempest-VolumeQuotasAdminTestJSON-525517518 None] Flow 'volume_create_manager' (db2590cf-3655-473d-b5e0-cc620b011020) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:33:10 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-50ae4aeb-a73f-4afa-8796-a8817978bdd1 tempest-VolumeQuotasAdminTestJSON-525517518 None] Created volume successfully. Nov 06 15:33:10 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-73c1fefa-81c1-48a1-8afb-927ecc720a0e tempest-VolumeQuotasAdminTestJSON-525517518 None] Acquiring lock "cinder-6659e006-a61b-42f7-9984-50c484f87079-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:33:10 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-73c1fefa-81c1-48a1-8afb-927ecc720a0e tempest-VolumeQuotasAdminTestJSON-525517518 None] Lock "cinder-6659e006-a61b-42f7-9984-50c484f87079-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:33:11 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-73c1fefa-81c1-48a1-8afb-927ecc720a0e tempest-VolumeQuotasAdminTestJSON-525517518 None] Acquiring lock "cinder-quobyte-6659e006-a61b-42f7-9984-50c484f87079" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:33:11 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-73c1fefa-81c1-48a1-8afb-927ecc720a0e tempest-VolumeQuotasAdminTestJSON-525517518 None] Lock "cinder-quobyte-6659e006-a61b-42f7-9984-50c484f87079" acquired by "delete_volume" :: waited 0.014s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:33:11 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dacff56-16e0-49f2-b52b-25b9d16b192f]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:33:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-73c1fefa-81c1-48a1-8afb-927ecc720a0e tempest-VolumeQuotasAdminTestJSON-525517518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-6659e006-a61b-42f7-9984-50c484f87079 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:33:11 devstack sudo[103403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-6659e006-a61b-42f7-9984-50c484f87079 Nov 06 15:33:11 devstack sudo[103403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:33:11 devstack sudo[103403]: pam_unix(sudo:session): session closed for user root Nov 06 15:33:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-73c1fefa-81c1-48a1-8afb-927ecc720a0e tempest-VolumeQuotasAdminTestJSON-525517518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-6659e006-a61b-42f7-9984-50c484f87079" returned: 0 in 0.370s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:33:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-73c1fefa-81c1-48a1-8afb-927ecc720a0e tempest-VolumeQuotasAdminTestJSON-525517518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-6659e006-a61b-42f7-9984-50c484f87079 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:33:11 devstack sudo[103408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-6659e006-a61b-42f7-9984-50c484f87079 Nov 06 15:33:11 devstack sudo[103408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:33:11 devstack sudo[103408]: pam_unix(sudo:session): session closed for user root Nov 06 15:33:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-73c1fefa-81c1-48a1-8afb-927ecc720a0e tempest-VolumeQuotasAdminTestJSON-525517518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-6659e006-a61b-42f7-9984-50c484f87079" returned: 0 in 0.244s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:33:11 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-73c1fefa-81c1-48a1-8afb-927ecc720a0e tempest-VolumeQuotasAdminTestJSON-525517518 None] Lock "cinder-quobyte-6659e006-a61b-42f7-9984-50c484f87079" released by "delete_volume" :: held 0.652s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:33:11 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-73c1fefa-81c1-48a1-8afb-927ecc720a0e tempest-VolumeQuotasAdminTestJSON-525517518 None] Created reservations ['c48aaf83-5cad-4927-a992-c8916f436a1b', '713e5fa4-124a-4e69-b042-281259078438', 'f7657c3e-225a-423f-8266-c70cab3ad8de', 'd6a367b9-e29a-417b-b777-d8458aeb8cf7'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:33:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-73c1fefa-81c1-48a1-8afb-927ecc720a0e tempest-VolumeQuotasAdminTestJSON-525517518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:33:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-73c1fefa-81c1-48a1-8afb-927ecc720a0e tempest-VolumeQuotasAdminTestJSON-525517518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:33:11 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-73c1fefa-81c1-48a1-8afb-927ecc720a0e tempest-VolumeQuotasAdminTestJSON-525517518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:33:11 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-73c1fefa-81c1-48a1-8afb-927ecc720a0e tempest-VolumeQuotasAdminTestJSON-525517518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:33:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-73c1fefa-81c1-48a1-8afb-927ecc720a0e tempest-VolumeQuotasAdminTestJSON-525517518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:33:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-73c1fefa-81c1-48a1-8afb-927ecc720a0e tempest-VolumeQuotasAdminTestJSON-525517518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:33:11 devstack sudo[103411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:33:11 devstack sudo[103411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:33:12 devstack sudo[103411]: pam_unix(sudo:session): session closed for user root Nov 06 15:33:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-73c1fefa-81c1-48a1-8afb-927ecc720a0e tempest-VolumeQuotasAdminTestJSON-525517518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.240s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:33:12 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-73c1fefa-81c1-48a1-8afb-927ecc720a0e tempest-VolumeQuotasAdminTestJSON-525517518 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:33:12 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-73c1fefa-81c1-48a1-8afb-927ecc720a0e tempest-VolumeQuotasAdminTestJSON-525517518 None] Deleted volume successfully. Nov 06 15:33:12 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-73c1fefa-81c1-48a1-8afb-927ecc720a0e tempest-VolumeQuotasAdminTestJSON-525517518 None] Lock "cinder-6659e006-a61b-42f7-9984-50c484f87079-delete_volume" released by "delete_volume" :: held 1.075s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:33:12 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-066f7566-d287-43e6-a47b-f00a562309fb tempest-VolumeQuotasAdminTestJSON-525517518 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:33:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-066f7566-d287-43e6-a47b-f00a562309fb tempest-VolumeQuotasAdminTestJSON-525517518 None] Flow 'volume_create_manager' (2244011f-79fd-48de-a349-b686d6ca00d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:33:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-066f7566-d287-43e6-a47b-f00a562309fb tempest-VolumeQuotasAdminTestJSON-525517518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f89c48d-dc2c-451b-9c87-d08b0f27a5ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:33:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-066f7566-d287-43e6-a47b-f00a562309fb tempest-VolumeQuotasAdminTestJSON-525517518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f89c48d-dc2c-451b-9c87-d08b0f27a5ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:33:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-416201028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95aaf708-ccb8-4b20-a613-0e7a9d083275,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3f414e3d4804d17ac565d28a93624c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:33:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:33:13Z,use_quota=True,user_id='b3083477ce5f42589b61768194e014f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:33:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-066f7566-d287-43e6-a47b-f00a562309fb tempest-VolumeQuotasAdminTestJSON-525517518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7123f6c-a69b-4bf6-8753-e00677f8d88b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:33:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-066f7566-d287-43e6-a47b-f00a562309fb tempest-VolumeQuotasAdminTestJSON-525517518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7123f6c-a69b-4bf6-8753-e00677f8d88b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:33:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-066f7566-d287-43e6-a47b-f00a562309fb tempest-VolumeQuotasAdminTestJSON-525517518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (880811d7-1c86-4cfe-ac93-da319888e873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:33:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-066f7566-d287-43e6-a47b-f00a562309fb tempest-VolumeQuotasAdminTestJSON-525517518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (880811d7-1c86-4cfe-ac93-da319888e873) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95aaf708-ccb8-4b20-a613-0e7a9d083275', 'volume_name': 'volume-95aaf708-ccb8-4b20-a613-0e7a9d083275', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:33:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-066f7566-d287-43e6-a47b-f00a562309fb tempest-VolumeQuotasAdminTestJSON-525517518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aba9e94a-dad8-4830-a642-c48c0dda243c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:33:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-066f7566-d287-43e6-a47b-f00a562309fb tempest-VolumeQuotasAdminTestJSON-525517518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aba9e94a-dad8-4830-a642-c48c0dda243c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:33:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-066f7566-d287-43e6-a47b-f00a562309fb tempest-VolumeQuotasAdminTestJSON-525517518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80554250-a7e9-49d8-8c25-f15ea4c5c4dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:33:12 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-066f7566-d287-43e6-a47b-f00a562309fb tempest-VolumeQuotasAdminTestJSON-525517518 None] Volume 95aaf708-ccb8-4b20-a613-0e7a9d083275: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95aaf708-ccb8-4b20-a613-0e7a9d083275', 'volume_size': 1} Nov 06 15:33:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-066f7566-d287-43e6-a47b-f00a562309fb tempest-VolumeQuotasAdminTestJSON-525517518 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:33:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-066f7566-d287-43e6-a47b-f00a562309fb tempest-VolumeQuotasAdminTestJSON-525517518 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:33:12 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-066f7566-d287-43e6-a47b-f00a562309fb tempest-VolumeQuotasAdminTestJSON-525517518 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:33:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-416201028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95aaf708-ccb8-4b20-a613-0e7a9d083275,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3f414e3d4804d17ac565d28a93624c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:33:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:33:13Z,use_quota=True,user_id='b3083477ce5f42589b61768194e014f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:33:12 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-066f7566-d287-43e6-a47b-f00a562309fb tempest-VolumeQuotasAdminTestJSON-525517518 None] Creating volume 95aaf708-ccb8-4b20-a613-0e7a9d083275 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:33:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-066f7566-d287-43e6-a47b-f00a562309fb tempest-VolumeQuotasAdminTestJSON-525517518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:33:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-066f7566-d287-43e6-a47b-f00a562309fb tempest-VolumeQuotasAdminTestJSON-525517518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:33:12 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-066f7566-d287-43e6-a47b-f00a562309fb tempest-VolumeQuotasAdminTestJSON-525517518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:33:12 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-066f7566-d287-43e6-a47b-f00a562309fb tempest-VolumeQuotasAdminTestJSON-525517518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:33:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-066f7566-d287-43e6-a47b-f00a562309fb tempest-VolumeQuotasAdminTestJSON-525517518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:33:12 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-066f7566-d287-43e6-a47b-f00a562309fb tempest-VolumeQuotasAdminTestJSON-525517518 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:33:12 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-066f7566-d287-43e6-a47b-f00a562309fb tempest-VolumeQuotasAdminTestJSON-525517518 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:33:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-066f7566-d287-43e6-a47b-f00a562309fb tempest-VolumeQuotasAdminTestJSON-525517518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-95aaf708-ccb8-4b20-a613-0e7a9d083275 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:33:12 devstack sudo[103414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-95aaf708-ccb8-4b20-a613-0e7a9d083275 1073741824 Nov 06 15:33:12 devstack sudo[103414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:33:13 devstack sudo[103414]: pam_unix(sudo:session): session closed for user root Nov 06 15:33:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-066f7566-d287-43e6-a47b-f00a562309fb tempest-VolumeQuotasAdminTestJSON-525517518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-95aaf708-ccb8-4b20-a613-0e7a9d083275 1073741824" returned: 0 in 0.400s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:33:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-066f7566-d287-43e6-a47b-f00a562309fb tempest-VolumeQuotasAdminTestJSON-525517518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-95aaf708-ccb8-4b20-a613-0e7a9d083275 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:33:13 devstack sudo[103419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-95aaf708-ccb8-4b20-a613-0e7a9d083275 Nov 06 15:33:13 devstack sudo[103419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:33:13 devstack sudo[103419]: pam_unix(sudo:session): session closed for user root Nov 06 15:33:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-066f7566-d287-43e6-a47b-f00a562309fb tempest-VolumeQuotasAdminTestJSON-525517518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-95aaf708-ccb8-4b20-a613-0e7a9d083275" returned: 0 in 0.245s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:33:13 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-066f7566-d287-43e6-a47b-f00a562309fb tempest-VolumeQuotasAdminTestJSON-525517518 None] <== create_volume: return (681ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:33:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-066f7566-d287-43e6-a47b-f00a562309fb tempest-VolumeQuotasAdminTestJSON-525517518 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.683s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:33:13 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-066f7566-d287-43e6-a47b-f00a562309fb tempest-VolumeQuotasAdminTestJSON-525517518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80554250-a7e9-49d8-8c25-f15ea4c5c4dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95aaf708-ccb8-4b20-a613-0e7a9d083275', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:33:13 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-066f7566-d287-43e6-a47b-f00a562309fb tempest-VolumeQuotasAdminTestJSON-525517518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2793b4e-75bd-4b00-8c47-22b72297811a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:33:13 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-066f7566-d287-43e6-a47b-f00a562309fb tempest-VolumeQuotasAdminTestJSON-525517518 None] Volume volume-95aaf708-ccb8-4b20-a613-0e7a9d083275 (95aaf708-ccb8-4b20-a613-0e7a9d083275): created successfully Nov 06 15:33:13 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-066f7566-d287-43e6-a47b-f00a562309fb tempest-VolumeQuotasAdminTestJSON-525517518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2793b4e-75bd-4b00-8c47-22b72297811a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:33:13 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-066f7566-d287-43e6-a47b-f00a562309fb tempest-VolumeQuotasAdminTestJSON-525517518 None] Flow 'volume_create_manager' (2244011f-79fd-48de-a349-b686d6ca00d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:33:13 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-066f7566-d287-43e6-a47b-f00a562309fb tempest-VolumeQuotasAdminTestJSON-525517518 None] Created volume successfully. Nov 06 15:33:14 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-2c7bf0a4-dd4c-40bb-b61d-bec7d3f00634 tempest-VolumeQuotasAdminTestJSON-1936527225 None] Transfer volume completed successfully. Nov 06 15:33:14 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-25380bd8-7c78-4fe1-9def-27a49703a993 tempest-VolumeQuotasAdminTestJSON-756757773 None] Acquiring lock "cinder-95aaf708-ccb8-4b20-a613-0e7a9d083275-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:33:14 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-25380bd8-7c78-4fe1-9def-27a49703a993 tempest-VolumeQuotasAdminTestJSON-756757773 None] Lock "cinder-95aaf708-ccb8-4b20-a613-0e7a9d083275-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:33:14 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-25380bd8-7c78-4fe1-9def-27a49703a993 tempest-VolumeQuotasAdminTestJSON-756757773 None] Acquiring lock "cinder-quobyte-95aaf708-ccb8-4b20-a613-0e7a9d083275" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:33:14 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-25380bd8-7c78-4fe1-9def-27a49703a993 tempest-VolumeQuotasAdminTestJSON-756757773 None] Lock "cinder-quobyte-95aaf708-ccb8-4b20-a613-0e7a9d083275" acquired by "delete_volume" :: waited 0.015s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:33:14 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e08b025-0f42-4c27-93e3-d509c23e1a62]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:33:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-25380bd8-7c78-4fe1-9def-27a49703a993 tempest-VolumeQuotasAdminTestJSON-756757773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-95aaf708-ccb8-4b20-a613-0e7a9d083275 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:33:14 devstack sudo[103422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-95aaf708-ccb8-4b20-a613-0e7a9d083275 Nov 06 15:33:14 devstack sudo[103422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:33:14 devstack sudo[103422]: pam_unix(sudo:session): session closed for user root Nov 06 15:33:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-25380bd8-7c78-4fe1-9def-27a49703a993 tempest-VolumeQuotasAdminTestJSON-756757773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-95aaf708-ccb8-4b20-a613-0e7a9d083275" returned: 0 in 0.346s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:33:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-25380bd8-7c78-4fe1-9def-27a49703a993 tempest-VolumeQuotasAdminTestJSON-756757773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-95aaf708-ccb8-4b20-a613-0e7a9d083275 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:33:15 devstack sudo[103427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-95aaf708-ccb8-4b20-a613-0e7a9d083275 Nov 06 15:33:15 devstack sudo[103427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:33:15 devstack sudo[103427]: pam_unix(sudo:session): session closed for user root Nov 06 15:33:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-25380bd8-7c78-4fe1-9def-27a49703a993 tempest-VolumeQuotasAdminTestJSON-756757773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-95aaf708-ccb8-4b20-a613-0e7a9d083275" returned: 0 in 0.243s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:33:15 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-25380bd8-7c78-4fe1-9def-27a49703a993 tempest-VolumeQuotasAdminTestJSON-756757773 None] Lock "cinder-quobyte-95aaf708-ccb8-4b20-a613-0e7a9d083275" released by "delete_volume" :: held 0.631s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:33:15 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-25380bd8-7c78-4fe1-9def-27a49703a993 tempest-VolumeQuotasAdminTestJSON-756757773 None] Created reservations ['0f437786-bc90-4bcb-aa76-c0a416859a72', '71ad0537-4ac4-4bb7-a241-3edf1666d967', '0d0a01b0-ffab-48e8-9f23-800e94dd0eb3', 'e68855e7-6aeb-48f6-80cf-0c301a303a57'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:33:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-25380bd8-7c78-4fe1-9def-27a49703a993 tempest-VolumeQuotasAdminTestJSON-756757773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:33:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-25380bd8-7c78-4fe1-9def-27a49703a993 tempest-VolumeQuotasAdminTestJSON-756757773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:33:15 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-25380bd8-7c78-4fe1-9def-27a49703a993 tempest-VolumeQuotasAdminTestJSON-756757773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:33:15 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-25380bd8-7c78-4fe1-9def-27a49703a993 tempest-VolumeQuotasAdminTestJSON-756757773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:33:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-25380bd8-7c78-4fe1-9def-27a49703a993 tempest-VolumeQuotasAdminTestJSON-756757773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:33:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-25380bd8-7c78-4fe1-9def-27a49703a993 tempest-VolumeQuotasAdminTestJSON-756757773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:33:15 devstack sudo[103431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:33:15 devstack sudo[103431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:33:15 devstack sudo[103431]: pam_unix(sudo:session): session closed for user root Nov 06 15:33:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-25380bd8-7c78-4fe1-9def-27a49703a993 tempest-VolumeQuotasAdminTestJSON-756757773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.240s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:33:15 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-25380bd8-7c78-4fe1-9def-27a49703a993 tempest-VolumeQuotasAdminTestJSON-756757773 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:33:15 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-25380bd8-7c78-4fe1-9def-27a49703a993 tempest-VolumeQuotasAdminTestJSON-756757773 None] Deleted volume successfully. Nov 06 15:33:15 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-25380bd8-7c78-4fe1-9def-27a49703a993 tempest-VolumeQuotasAdminTestJSON-756757773 None] Lock "cinder-95aaf708-ccb8-4b20-a613-0e7a9d083275-delete_volume" released by "delete_volume" :: held 1.045s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:33:22 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bf15cdf-0da7-43d1-bcea-ccc85fdd5644 tempest-VolumeRetypeWithoutMigrationTest-1399412667 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:33:22 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5bf15cdf-0da7-43d1-bcea-ccc85fdd5644 tempest-VolumeRetypeWithoutMigrationTest-1399412667 None] Flow 'volume_create_manager' (f9f8cff1-f5bd-4a41-8f55-11835510673d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:33:22 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5bf15cdf-0da7-43d1-bcea-ccc85fdd5644 tempest-VolumeRetypeWithoutMigrationTest-1399412667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fa66d70-7695-4ae9-9938-9c00f06acd13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:33:22 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5bf15cdf-0da7-43d1-bcea-ccc85fdd5644 tempest-VolumeRetypeWithoutMigrationTest-1399412667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fa66d70-7695-4ae9-9938-9c00f06acd13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:33:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1923177484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c185fd42-7188-462f-a620-243e6d59d639,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc4d913519834921a32ec79940de29c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:33:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:33:22Z,use_quota=True,user_id='f7fa2c5789254688902b6025c03e5fc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1bca71e8-c0aa-4c70-b993-4e463fa96534),volume_type_id=1bca71e8-c0aa-4c70-b993-4e463fa96534)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:33:22 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5bf15cdf-0da7-43d1-bcea-ccc85fdd5644 tempest-VolumeRetypeWithoutMigrationTest-1399412667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15ceed39-13fb-4846-a379-71c302870f7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:33:22 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5bf15cdf-0da7-43d1-bcea-ccc85fdd5644 tempest-VolumeRetypeWithoutMigrationTest-1399412667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15ceed39-13fb-4846-a379-71c302870f7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:33:22 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5bf15cdf-0da7-43d1-bcea-ccc85fdd5644 tempest-VolumeRetypeWithoutMigrationTest-1399412667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17730931-34d4-4aca-8bac-242366746408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:33:22 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5bf15cdf-0da7-43d1-bcea-ccc85fdd5644 tempest-VolumeRetypeWithoutMigrationTest-1399412667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17730931-34d4-4aca-8bac-242366746408) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c185fd42-7188-462f-a620-243e6d59d639', 'volume_name': 'volume-c185fd42-7188-462f-a620-243e6d59d639', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:33:22 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5bf15cdf-0da7-43d1-bcea-ccc85fdd5644 tempest-VolumeRetypeWithoutMigrationTest-1399412667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56d4f6d2-a588-4e21-bbb6-1924ae6797ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:33:22 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5bf15cdf-0da7-43d1-bcea-ccc85fdd5644 tempest-VolumeRetypeWithoutMigrationTest-1399412667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56d4f6d2-a588-4e21-bbb6-1924ae6797ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:33:22 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5bf15cdf-0da7-43d1-bcea-ccc85fdd5644 tempest-VolumeRetypeWithoutMigrationTest-1399412667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a1ba880-5f0c-4dd6-9c99-5622bad8573a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:33:22 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-5bf15cdf-0da7-43d1-bcea-ccc85fdd5644 tempest-VolumeRetypeWithoutMigrationTest-1399412667 None] Volume c185fd42-7188-462f-a620-243e6d59d639: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c185fd42-7188-462f-a620-243e6d59d639', 'volume_size': 1} Nov 06 15:33:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5bf15cdf-0da7-43d1-bcea-ccc85fdd5644 tempest-VolumeRetypeWithoutMigrationTest-1399412667 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:33:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5bf15cdf-0da7-43d1-bcea-ccc85fdd5644 tempest-VolumeRetypeWithoutMigrationTest-1399412667 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:33:22 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-5bf15cdf-0da7-43d1-bcea-ccc85fdd5644 tempest-VolumeRetypeWithoutMigrationTest-1399412667 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:33:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1923177484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c185fd42-7188-462f-a620-243e6d59d639,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc4d913519834921a32ec79940de29c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:33:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:33:22Z,use_quota=True,user_id='f7fa2c5789254688902b6025c03e5fc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1bca71e8-c0aa-4c70-b993-4e463fa96534),volume_type_id=1bca71e8-c0aa-4c70-b993-4e463fa96534)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:33:22 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-5bf15cdf-0da7-43d1-bcea-ccc85fdd5644 tempest-VolumeRetypeWithoutMigrationTest-1399412667 None] Creating volume c185fd42-7188-462f-a620-243e6d59d639 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:33:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5bf15cdf-0da7-43d1-bcea-ccc85fdd5644 tempest-VolumeRetypeWithoutMigrationTest-1399412667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:33:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5bf15cdf-0da7-43d1-bcea-ccc85fdd5644 tempest-VolumeRetypeWithoutMigrationTest-1399412667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:33:22 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-5bf15cdf-0da7-43d1-bcea-ccc85fdd5644 tempest-VolumeRetypeWithoutMigrationTest-1399412667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:33:22 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-5bf15cdf-0da7-43d1-bcea-ccc85fdd5644 tempest-VolumeRetypeWithoutMigrationTest-1399412667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:33:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5bf15cdf-0da7-43d1-bcea-ccc85fdd5644 tempest-VolumeRetypeWithoutMigrationTest-1399412667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:33:22 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-5bf15cdf-0da7-43d1-bcea-ccc85fdd5644 tempest-VolumeRetypeWithoutMigrationTest-1399412667 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:33:22 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-5bf15cdf-0da7-43d1-bcea-ccc85fdd5644 tempest-VolumeRetypeWithoutMigrationTest-1399412667 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:33:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5bf15cdf-0da7-43d1-bcea-ccc85fdd5644 tempest-VolumeRetypeWithoutMigrationTest-1399412667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-c185fd42-7188-462f-a620-243e6d59d639 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:33:22 devstack sudo[103435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-c185fd42-7188-462f-a620-243e6d59d639 1073741824 Nov 06 15:33:22 devstack sudo[103435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:33:22 devstack sudo[103435]: pam_unix(sudo:session): session closed for user root Nov 06 15:33:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5bf15cdf-0da7-43d1-bcea-ccc85fdd5644 tempest-VolumeRetypeWithoutMigrationTest-1399412667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-c185fd42-7188-462f-a620-243e6d59d639 1073741824" returned: 0 in 0.405s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:33:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5bf15cdf-0da7-43d1-bcea-ccc85fdd5644 tempest-VolumeRetypeWithoutMigrationTest-1399412667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-c185fd42-7188-462f-a620-243e6d59d639 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:33:22 devstack sudo[103441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-c185fd42-7188-462f-a620-243e6d59d639 Nov 06 15:33:22 devstack sudo[103441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:33:22 devstack sudo[103441]: pam_unix(sudo:session): session closed for user root Nov 06 15:33:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5bf15cdf-0da7-43d1-bcea-ccc85fdd5644 tempest-VolumeRetypeWithoutMigrationTest-1399412667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-c185fd42-7188-462f-a620-243e6d59d639" returned: 0 in 0.251s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:33:22 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-5bf15cdf-0da7-43d1-bcea-ccc85fdd5644 tempest-VolumeRetypeWithoutMigrationTest-1399412667 None] <== create_volume: return (698ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:33:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5bf15cdf-0da7-43d1-bcea-ccc85fdd5644 tempest-VolumeRetypeWithoutMigrationTest-1399412667 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.700s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:33:23 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5bf15cdf-0da7-43d1-bcea-ccc85fdd5644 tempest-VolumeRetypeWithoutMigrationTest-1399412667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a1ba880-5f0c-4dd6-9c99-5622bad8573a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c185fd42-7188-462f-a620-243e6d59d639', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:33:23 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5bf15cdf-0da7-43d1-bcea-ccc85fdd5644 tempest-VolumeRetypeWithoutMigrationTest-1399412667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (834e817f-2399-4d87-a8ca-2be33ddc6f78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:33:23 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-5bf15cdf-0da7-43d1-bcea-ccc85fdd5644 tempest-VolumeRetypeWithoutMigrationTest-1399412667 None] Volume volume-c185fd42-7188-462f-a620-243e6d59d639 (c185fd42-7188-462f-a620-243e6d59d639): created successfully Nov 06 15:33:23 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5bf15cdf-0da7-43d1-bcea-ccc85fdd5644 tempest-VolumeRetypeWithoutMigrationTest-1399412667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (834e817f-2399-4d87-a8ca-2be33ddc6f78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:33:23 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5bf15cdf-0da7-43d1-bcea-ccc85fdd5644 tempest-VolumeRetypeWithoutMigrationTest-1399412667 None] Flow 'volume_create_manager' (f9f8cff1-f5bd-4a41-8f55-11835510673d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:33:23 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-5bf15cdf-0da7-43d1-bcea-ccc85fdd5644 tempest-VolumeRetypeWithoutMigrationTest-1399412667 None] Created volume successfully. Nov 06 15:33:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-cea44243-839b-4d46-9b36-8fb422d6acd6 tempest-VolumeRetypeWithoutMigrationTest-1399412667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:33:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-cea44243-839b-4d46-9b36-8fb422d6acd6 tempest-VolumeRetypeWithoutMigrationTest-1399412667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:33:23 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-cea44243-839b-4d46-9b36-8fb422d6acd6 tempest-VolumeRetypeWithoutMigrationTest-1399412667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:33:23 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-cea44243-839b-4d46-9b36-8fb422d6acd6 tempest-VolumeRetypeWithoutMigrationTest-1399412667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:33:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-cea44243-839b-4d46-9b36-8fb422d6acd6 tempest-VolumeRetypeWithoutMigrationTest-1399412667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:33:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-cea44243-839b-4d46-9b36-8fb422d6acd6 tempest-VolumeRetypeWithoutMigrationTest-1399412667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:33:23 devstack sudo[103444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:33:23 devstack sudo[103444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:33:23 devstack sudo[103444]: pam_unix(sudo:session): session closed for user root Nov 06 15:33:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-cea44243-839b-4d46-9b36-8fb422d6acd6 tempest-VolumeRetypeWithoutMigrationTest-1399412667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.247s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:33:23 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-cea44243-839b-4d46-9b36-8fb422d6acd6 tempest-VolumeRetypeWithoutMigrationTest-1399412667 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:33:23 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-cea44243-839b-4d46-9b36-8fb422d6acd6 tempest-VolumeRetypeWithoutMigrationTest-1399412667 None] Retype volume completed successfully. Nov 06 15:33:24 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-fc13b910-fe6c-42f9-ba6d-ec22983e76be tempest-VolumeRetypeWithoutMigrationTest-1399412667 None] Acquiring lock "cinder-c185fd42-7188-462f-a620-243e6d59d639-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:33:24 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-fc13b910-fe6c-42f9-ba6d-ec22983e76be tempest-VolumeRetypeWithoutMigrationTest-1399412667 None] Lock "cinder-c185fd42-7188-462f-a620-243e6d59d639-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:33:24 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-fc13b910-fe6c-42f9-ba6d-ec22983e76be tempest-VolumeRetypeWithoutMigrationTest-1399412667 None] Acquiring lock "cinder-quobyte-c185fd42-7188-462f-a620-243e6d59d639" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:33:24 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-fc13b910-fe6c-42f9-ba6d-ec22983e76be tempest-VolumeRetypeWithoutMigrationTest-1399412667 None] Lock "cinder-quobyte-c185fd42-7188-462f-a620-243e6d59d639" acquired by "delete_volume" :: waited 0.017s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:33:24 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[c17d6390-b2c0-42d1-8bb2-f347d0c9ed11]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:33:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-fc13b910-fe6c-42f9-ba6d-ec22983e76be tempest-VolumeRetypeWithoutMigrationTest-1399412667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-c185fd42-7188-462f-a620-243e6d59d639 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:33:25 devstack sudo[103447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-c185fd42-7188-462f-a620-243e6d59d639 Nov 06 15:33:25 devstack sudo[103447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:33:25 devstack sudo[103447]: pam_unix(sudo:session): session closed for user root Nov 06 15:33:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-fc13b910-fe6c-42f9-ba6d-ec22983e76be tempest-VolumeRetypeWithoutMigrationTest-1399412667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-c185fd42-7188-462f-a620-243e6d59d639" returned: 0 in 0.344s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:33:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-fc13b910-fe6c-42f9-ba6d-ec22983e76be tempest-VolumeRetypeWithoutMigrationTest-1399412667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-c185fd42-7188-462f-a620-243e6d59d639 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:33:25 devstack sudo[103452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-c185fd42-7188-462f-a620-243e6d59d639 Nov 06 15:33:25 devstack sudo[103452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:33:25 devstack sudo[103452]: pam_unix(sudo:session): session closed for user root Nov 06 15:33:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-fc13b910-fe6c-42f9-ba6d-ec22983e76be tempest-VolumeRetypeWithoutMigrationTest-1399412667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-c185fd42-7188-462f-a620-243e6d59d639" returned: 0 in 0.246s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:33:25 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-fc13b910-fe6c-42f9-ba6d-ec22983e76be tempest-VolumeRetypeWithoutMigrationTest-1399412667 None] Lock "cinder-quobyte-c185fd42-7188-462f-a620-243e6d59d639" released by "delete_volume" :: held 0.628s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:33:25 devstack cinder-volume[87132]: WARNING cinder.quota [None req-fc13b910-fe6c-42f9-ba6d-ec22983e76be tempest-VolumeRetypeWithoutMigrationTest-1399412667 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Nov 06 15:33:25 devstack cinder-volume[87132]: WARNING cinder.quota [None req-fc13b910-fe6c-42f9-ba6d-ec22983e76be tempest-VolumeRetypeWithoutMigrationTest-1399412667 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Nov 06 15:33:25 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-fc13b910-fe6c-42f9-ba6d-ec22983e76be tempest-VolumeRetypeWithoutMigrationTest-1399412667 None] Created reservations ['51daf4b7-051f-49d6-a296-8cca09501c97', '616287ab-7f22-475e-bbf0-79db3f73e927', 'bfacbf26-5f79-4448-b1f0-e5526fb56bb8', '3e12fb1c-0394-405c-adbe-8d88a640c86a'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:33:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-fc13b910-fe6c-42f9-ba6d-ec22983e76be tempest-VolumeRetypeWithoutMigrationTest-1399412667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:33:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-fc13b910-fe6c-42f9-ba6d-ec22983e76be tempest-VolumeRetypeWithoutMigrationTest-1399412667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:33:25 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-fc13b910-fe6c-42f9-ba6d-ec22983e76be tempest-VolumeRetypeWithoutMigrationTest-1399412667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:33:25 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-fc13b910-fe6c-42f9-ba6d-ec22983e76be tempest-VolumeRetypeWithoutMigrationTest-1399412667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:33:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-fc13b910-fe6c-42f9-ba6d-ec22983e76be tempest-VolumeRetypeWithoutMigrationTest-1399412667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:33:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-fc13b910-fe6c-42f9-ba6d-ec22983e76be tempest-VolumeRetypeWithoutMigrationTest-1399412667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:33:25 devstack sudo[103456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:33:25 devstack sudo[103456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:33:25 devstack sudo[103456]: pam_unix(sudo:session): session closed for user root Nov 06 15:33:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-fc13b910-fe6c-42f9-ba6d-ec22983e76be tempest-VolumeRetypeWithoutMigrationTest-1399412667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.237s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:33:25 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-fc13b910-fe6c-42f9-ba6d-ec22983e76be tempest-VolumeRetypeWithoutMigrationTest-1399412667 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:33:25 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-fc13b910-fe6c-42f9-ba6d-ec22983e76be tempest-VolumeRetypeWithoutMigrationTest-1399412667 None] Deleted volume successfully. Nov 06 15:33:25 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-fc13b910-fe6c-42f9-ba6d-ec22983e76be tempest-VolumeRetypeWithoutMigrationTest-1399412667 None] Lock "cinder-c185fd42-7188-462f-a620-243e6d59d639-delete_volume" released by "delete_volume" :: held 1.049s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:33:31 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c74e110-ae7e-41aa-995c-47a4abcc1fc7 tempest-VolumesServicesTestJSON-1821655650 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:33:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9c74e110-ae7e-41aa-995c-47a4abcc1fc7 tempest-VolumesServicesTestJSON-1821655650 None] Flow 'volume_create_manager' (940613a2-b82b-429c-a4e0-4fef4343e185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:33:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9c74e110-ae7e-41aa-995c-47a4abcc1fc7 tempest-VolumesServicesTestJSON-1821655650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5c5d82b-ee0d-4131-bcdc-e1f0322fbfb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:33:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9c74e110-ae7e-41aa-995c-47a4abcc1fc7 tempest-VolumesServicesTestJSON-1821655650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5c5d82b-ee0d-4131-bcdc-e1f0322fbfb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:33:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1872409411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=383e5a14-91b3-457a-9986-ef89a9597c67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ea1a8a98ea04a70ad352356c8944bda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:33:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:33:31Z,use_quota=True,user_id='80c4214db5f246408106553ecd45db91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:33:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9c74e110-ae7e-41aa-995c-47a4abcc1fc7 tempest-VolumesServicesTestJSON-1821655650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b8fa4d6-b1b6-4700-b7cf-faf5724cba5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:33:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9c74e110-ae7e-41aa-995c-47a4abcc1fc7 tempest-VolumesServicesTestJSON-1821655650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b8fa4d6-b1b6-4700-b7cf-faf5724cba5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:33:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9c74e110-ae7e-41aa-995c-47a4abcc1fc7 tempest-VolumesServicesTestJSON-1821655650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (039ad1ca-2079-4b4c-9f4d-86dab5772502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:33:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9c74e110-ae7e-41aa-995c-47a4abcc1fc7 tempest-VolumesServicesTestJSON-1821655650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (039ad1ca-2079-4b4c-9f4d-86dab5772502) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '383e5a14-91b3-457a-9986-ef89a9597c67', 'volume_name': 'volume-383e5a14-91b3-457a-9986-ef89a9597c67', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:33:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9c74e110-ae7e-41aa-995c-47a4abcc1fc7 tempest-VolumesServicesTestJSON-1821655650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c094e3e5-1a96-4a84-84db-58077d972973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:33:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9c74e110-ae7e-41aa-995c-47a4abcc1fc7 tempest-VolumesServicesTestJSON-1821655650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c094e3e5-1a96-4a84-84db-58077d972973) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:33:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9c74e110-ae7e-41aa-995c-47a4abcc1fc7 tempest-VolumesServicesTestJSON-1821655650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cdb1e83-e67d-46d1-980a-8fb14e903706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:33:31 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-9c74e110-ae7e-41aa-995c-47a4abcc1fc7 tempest-VolumesServicesTestJSON-1821655650 None] Volume 383e5a14-91b3-457a-9986-ef89a9597c67: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-383e5a14-91b3-457a-9986-ef89a9597c67', 'volume_size': 1} Nov 06 15:33:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9c74e110-ae7e-41aa-995c-47a4abcc1fc7 tempest-VolumesServicesTestJSON-1821655650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:33:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9c74e110-ae7e-41aa-995c-47a4abcc1fc7 tempest-VolumesServicesTestJSON-1821655650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:33:31 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-9c74e110-ae7e-41aa-995c-47a4abcc1fc7 tempest-VolumesServicesTestJSON-1821655650 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:33:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1872409411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=383e5a14-91b3-457a-9986-ef89a9597c67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ea1a8a98ea04a70ad352356c8944bda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:33:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:33:31Z,use_quota=True,user_id='80c4214db5f246408106553ecd45db91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:33:31 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-9c74e110-ae7e-41aa-995c-47a4abcc1fc7 tempest-VolumesServicesTestJSON-1821655650 None] Creating volume 383e5a14-91b3-457a-9986-ef89a9597c67 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:33:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9c74e110-ae7e-41aa-995c-47a4abcc1fc7 tempest-VolumesServicesTestJSON-1821655650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:33:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9c74e110-ae7e-41aa-995c-47a4abcc1fc7 tempest-VolumesServicesTestJSON-1821655650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:33:31 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-9c74e110-ae7e-41aa-995c-47a4abcc1fc7 tempest-VolumesServicesTestJSON-1821655650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:33:31 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-9c74e110-ae7e-41aa-995c-47a4abcc1fc7 tempest-VolumesServicesTestJSON-1821655650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:33:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9c74e110-ae7e-41aa-995c-47a4abcc1fc7 tempest-VolumesServicesTestJSON-1821655650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:33:31 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-9c74e110-ae7e-41aa-995c-47a4abcc1fc7 tempest-VolumesServicesTestJSON-1821655650 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:33:31 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-9c74e110-ae7e-41aa-995c-47a4abcc1fc7 tempest-VolumesServicesTestJSON-1821655650 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:33:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9c74e110-ae7e-41aa-995c-47a4abcc1fc7 tempest-VolumesServicesTestJSON-1821655650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-383e5a14-91b3-457a-9986-ef89a9597c67 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:33:31 devstack sudo[103459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-383e5a14-91b3-457a-9986-ef89a9597c67 1073741824 Nov 06 15:33:31 devstack sudo[103459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:33:31 devstack sudo[103459]: pam_unix(sudo:session): session closed for user root Nov 06 15:33:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9c74e110-ae7e-41aa-995c-47a4abcc1fc7 tempest-VolumesServicesTestJSON-1821655650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-383e5a14-91b3-457a-9986-ef89a9597c67 1073741824" returned: 0 in 0.406s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:33:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9c74e110-ae7e-41aa-995c-47a4abcc1fc7 tempest-VolumesServicesTestJSON-1821655650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-383e5a14-91b3-457a-9986-ef89a9597c67 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:33:31 devstack sudo[103464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-383e5a14-91b3-457a-9986-ef89a9597c67 Nov 06 15:33:31 devstack sudo[103464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:33:32 devstack sudo[103464]: pam_unix(sudo:session): session closed for user root Nov 06 15:33:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9c74e110-ae7e-41aa-995c-47a4abcc1fc7 tempest-VolumesServicesTestJSON-1821655650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-383e5a14-91b3-457a-9986-ef89a9597c67" returned: 0 in 0.242s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:33:32 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-9c74e110-ae7e-41aa-995c-47a4abcc1fc7 tempest-VolumesServicesTestJSON-1821655650 None] <== create_volume: return (687ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:33:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9c74e110-ae7e-41aa-995c-47a4abcc1fc7 tempest-VolumesServicesTestJSON-1821655650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.690s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:33:32 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9c74e110-ae7e-41aa-995c-47a4abcc1fc7 tempest-VolumesServicesTestJSON-1821655650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cdb1e83-e67d-46d1-980a-8fb14e903706) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-383e5a14-91b3-457a-9986-ef89a9597c67', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:33:32 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9c74e110-ae7e-41aa-995c-47a4abcc1fc7 tempest-VolumesServicesTestJSON-1821655650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0eeb5566-a439-48bd-8c35-cdd73b5b731d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:33:32 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-9c74e110-ae7e-41aa-995c-47a4abcc1fc7 tempest-VolumesServicesTestJSON-1821655650 None] Volume volume-383e5a14-91b3-457a-9986-ef89a9597c67 (383e5a14-91b3-457a-9986-ef89a9597c67): created successfully Nov 06 15:33:32 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9c74e110-ae7e-41aa-995c-47a4abcc1fc7 tempest-VolumesServicesTestJSON-1821655650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0eeb5566-a439-48bd-8c35-cdd73b5b731d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:33:32 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9c74e110-ae7e-41aa-995c-47a4abcc1fc7 tempest-VolumesServicesTestJSON-1821655650 None] Flow 'volume_create_manager' (940613a2-b82b-429c-a4e0-4fef4343e185) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:33:32 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-9c74e110-ae7e-41aa-995c-47a4abcc1fc7 tempest-VolumesServicesTestJSON-1821655650 None] Created volume successfully. Nov 06 15:33:32 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b415a654-5138-411c-8ec1-dbb7fcbf9cc1 tempest-VolumesServicesTestJSON-1821655650 None] Acquiring lock "cinder-383e5a14-91b3-457a-9986-ef89a9597c67-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:33:32 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b415a654-5138-411c-8ec1-dbb7fcbf9cc1 tempest-VolumesServicesTestJSON-1821655650 None] Lock "cinder-383e5a14-91b3-457a-9986-ef89a9597c67-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:33:32 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b415a654-5138-411c-8ec1-dbb7fcbf9cc1 tempest-VolumesServicesTestJSON-1821655650 None] Acquiring lock "cinder-quobyte-383e5a14-91b3-457a-9986-ef89a9597c67" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:33:32 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b415a654-5138-411c-8ec1-dbb7fcbf9cc1 tempest-VolumesServicesTestJSON-1821655650 None] Lock "cinder-quobyte-383e5a14-91b3-457a-9986-ef89a9597c67" acquired by "delete_volume" :: waited 0.014s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:33:32 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[31740063-f6a6-4a72-94ad-07fc9fc911a9]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:33:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b415a654-5138-411c-8ec1-dbb7fcbf9cc1 tempest-VolumesServicesTestJSON-1821655650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-383e5a14-91b3-457a-9986-ef89a9597c67 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:33:32 devstack sudo[103467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-383e5a14-91b3-457a-9986-ef89a9597c67 Nov 06 15:33:32 devstack sudo[103467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:33:32 devstack sudo[103467]: pam_unix(sudo:session): session closed for user root Nov 06 15:33:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b415a654-5138-411c-8ec1-dbb7fcbf9cc1 tempest-VolumesServicesTestJSON-1821655650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-383e5a14-91b3-457a-9986-ef89a9597c67" returned: 0 in 0.340s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:33:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b415a654-5138-411c-8ec1-dbb7fcbf9cc1 tempest-VolumesServicesTestJSON-1821655650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-383e5a14-91b3-457a-9986-ef89a9597c67 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:33:33 devstack sudo[103472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-383e5a14-91b3-457a-9986-ef89a9597c67 Nov 06 15:33:33 devstack sudo[103472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:33:33 devstack sudo[103472]: pam_unix(sudo:session): session closed for user root Nov 06 15:33:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b415a654-5138-411c-8ec1-dbb7fcbf9cc1 tempest-VolumesServicesTestJSON-1821655650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-383e5a14-91b3-457a-9986-ef89a9597c67" returned: 0 in 0.233s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:33:33 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b415a654-5138-411c-8ec1-dbb7fcbf9cc1 tempest-VolumesServicesTestJSON-1821655650 None] Lock "cinder-quobyte-383e5a14-91b3-457a-9986-ef89a9597c67" released by "delete_volume" :: held 0.609s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:33:33 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-b415a654-5138-411c-8ec1-dbb7fcbf9cc1 tempest-VolumesServicesTestJSON-1821655650 None] Created reservations ['87407367-5933-49b3-99df-8f9572e8152a', '30babcac-8427-4044-9c04-f97d4f80d6de', 'a845b3d4-eebc-4abd-9cfb-1eefe3b061e7', '291c35ae-98dd-4ff0-b2c7-58a6add0570f'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:33:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b415a654-5138-411c-8ec1-dbb7fcbf9cc1 tempest-VolumesServicesTestJSON-1821655650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:33:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b415a654-5138-411c-8ec1-dbb7fcbf9cc1 tempest-VolumesServicesTestJSON-1821655650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:33:33 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-b415a654-5138-411c-8ec1-dbb7fcbf9cc1 tempest-VolumesServicesTestJSON-1821655650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:33:33 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-b415a654-5138-411c-8ec1-dbb7fcbf9cc1 tempest-VolumesServicesTestJSON-1821655650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:33:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b415a654-5138-411c-8ec1-dbb7fcbf9cc1 tempest-VolumesServicesTestJSON-1821655650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:33:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b415a654-5138-411c-8ec1-dbb7fcbf9cc1 tempest-VolumesServicesTestJSON-1821655650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:33:33 devstack sudo[103475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:33:33 devstack sudo[103475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:33:33 devstack sudo[103475]: pam_unix(sudo:session): session closed for user root Nov 06 15:33:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b415a654-5138-411c-8ec1-dbb7fcbf9cc1 tempest-VolumesServicesTestJSON-1821655650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.258s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:33:33 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-b415a654-5138-411c-8ec1-dbb7fcbf9cc1 tempest-VolumesServicesTestJSON-1821655650 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:33:33 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-b415a654-5138-411c-8ec1-dbb7fcbf9cc1 tempest-VolumesServicesTestJSON-1821655650 None] Deleted volume successfully. Nov 06 15:33:33 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b415a654-5138-411c-8ec1-dbb7fcbf9cc1 tempest-VolumesServicesTestJSON-1821655650 None] Lock "cinder-383e5a14-91b3-457a-9986-ef89a9597c67-delete_volume" released by "delete_volume" :: held 1.052s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:33:43 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:SELECT=55,cinder:UPDATE=81,cinder:INSERT=16,cinder:DELETE=7 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 15:33:43 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:SELECT=66,cinder:UPDATE=74,cinder:DELETE=5,cinder:INSERT=17 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 15:33:54 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3b6d132-4f4d-4cfb-876a-c552f1beccbf tempest-VolumesTransfersV355Test-1540036705 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:33:54 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e3b6d132-4f4d-4cfb-876a-c552f1beccbf tempest-VolumesTransfersV355Test-1540036705 None] Flow 'volume_create_manager' (3bc140ee-8cc6-46af-bae4-35b1852a2926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:33:54 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e3b6d132-4f4d-4cfb-876a-c552f1beccbf tempest-VolumesTransfersV355Test-1540036705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e806730-23ef-4dc3-b479-4006ab458ba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:33:54 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e3b6d132-4f4d-4cfb-876a-c552f1beccbf tempest-VolumesTransfersV355Test-1540036705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e806730-23ef-4dc3-b479-4006ab458ba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:33:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-794717934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=762344a7-082a-4321-b2b4-dd5bcd2de4e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68fa2628c4f64dab98218a8caed00612',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:33:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:33:55Z,use_quota=True,user_id='f416e6bd95be4ad38acf2a7d7eb83a7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:33:54 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e3b6d132-4f4d-4cfb-876a-c552f1beccbf tempest-VolumesTransfersV355Test-1540036705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (324f78b0-3cbc-4610-bf9e-43eda5d110d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:33:54 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e3b6d132-4f4d-4cfb-876a-c552f1beccbf tempest-VolumesTransfersV355Test-1540036705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (324f78b0-3cbc-4610-bf9e-43eda5d110d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:33:54 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e3b6d132-4f4d-4cfb-876a-c552f1beccbf tempest-VolumesTransfersV355Test-1540036705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d00865ba-0144-4785-a704-a0780dab6467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:33:54 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e3b6d132-4f4d-4cfb-876a-c552f1beccbf tempest-VolumesTransfersV355Test-1540036705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d00865ba-0144-4785-a704-a0780dab6467) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '762344a7-082a-4321-b2b4-dd5bcd2de4e5', 'volume_name': 'volume-762344a7-082a-4321-b2b4-dd5bcd2de4e5', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:33:54 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e3b6d132-4f4d-4cfb-876a-c552f1beccbf tempest-VolumesTransfersV355Test-1540036705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c4bfa85-6a2e-4f5a-9111-62762bc032b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:33:54 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e3b6d132-4f4d-4cfb-876a-c552f1beccbf tempest-VolumesTransfersV355Test-1540036705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c4bfa85-6a2e-4f5a-9111-62762bc032b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:33:54 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e3b6d132-4f4d-4cfb-876a-c552f1beccbf tempest-VolumesTransfersV355Test-1540036705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3aba5423-4ff3-40ba-947e-db1a6a078c7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:33:54 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-e3b6d132-4f4d-4cfb-876a-c552f1beccbf tempest-VolumesTransfersV355Test-1540036705 None] Volume 762344a7-082a-4321-b2b4-dd5bcd2de4e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-762344a7-082a-4321-b2b4-dd5bcd2de4e5', 'volume_size': 1} Nov 06 15:33:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e3b6d132-4f4d-4cfb-876a-c552f1beccbf tempest-VolumesTransfersV355Test-1540036705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:33:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e3b6d132-4f4d-4cfb-876a-c552f1beccbf tempest-VolumesTransfersV355Test-1540036705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:33:54 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e3b6d132-4f4d-4cfb-876a-c552f1beccbf tempest-VolumesTransfersV355Test-1540036705 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:33:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-794717934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=762344a7-082a-4321-b2b4-dd5bcd2de4e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68fa2628c4f64dab98218a8caed00612',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:33:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:33:55Z,use_quota=True,user_id='f416e6bd95be4ad38acf2a7d7eb83a7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:33:54 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-e3b6d132-4f4d-4cfb-876a-c552f1beccbf tempest-VolumesTransfersV355Test-1540036705 None] Creating volume 762344a7-082a-4321-b2b4-dd5bcd2de4e5 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:33:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e3b6d132-4f4d-4cfb-876a-c552f1beccbf tempest-VolumesTransfersV355Test-1540036705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:33:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e3b6d132-4f4d-4cfb-876a-c552f1beccbf tempest-VolumesTransfersV355Test-1540036705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:33:54 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e3b6d132-4f4d-4cfb-876a-c552f1beccbf tempest-VolumesTransfersV355Test-1540036705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:33:54 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e3b6d132-4f4d-4cfb-876a-c552f1beccbf tempest-VolumesTransfersV355Test-1540036705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:33:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e3b6d132-4f4d-4cfb-876a-c552f1beccbf tempest-VolumesTransfersV355Test-1540036705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:33:54 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e3b6d132-4f4d-4cfb-876a-c552f1beccbf tempest-VolumesTransfersV355Test-1540036705 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:33:54 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-e3b6d132-4f4d-4cfb-876a-c552f1beccbf tempest-VolumesTransfersV355Test-1540036705 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:33:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e3b6d132-4f4d-4cfb-876a-c552f1beccbf tempest-VolumesTransfersV355Test-1540036705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-762344a7-082a-4321-b2b4-dd5bcd2de4e5 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:33:54 devstack sudo[103483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-762344a7-082a-4321-b2b4-dd5bcd2de4e5 1073741824 Nov 06 15:33:54 devstack sudo[103483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:33:55 devstack sudo[103483]: pam_unix(sudo:session): session closed for user root Nov 06 15:33:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e3b6d132-4f4d-4cfb-876a-c552f1beccbf tempest-VolumesTransfersV355Test-1540036705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-762344a7-082a-4321-b2b4-dd5bcd2de4e5 1073741824" returned: 0 in 0.405s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:33:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e3b6d132-4f4d-4cfb-876a-c552f1beccbf tempest-VolumesTransfersV355Test-1540036705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-762344a7-082a-4321-b2b4-dd5bcd2de4e5 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:33:55 devstack sudo[103488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-762344a7-082a-4321-b2b4-dd5bcd2de4e5 Nov 06 15:33:55 devstack sudo[103488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:33:55 devstack sudo[103488]: pam_unix(sudo:session): session closed for user root Nov 06 15:33:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e3b6d132-4f4d-4cfb-876a-c552f1beccbf tempest-VolumesTransfersV355Test-1540036705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-762344a7-082a-4321-b2b4-dd5bcd2de4e5" returned: 0 in 0.232s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:33:55 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e3b6d132-4f4d-4cfb-876a-c552f1beccbf tempest-VolumesTransfersV355Test-1540036705 None] <== create_volume: return (680ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:33:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e3b6d132-4f4d-4cfb-876a-c552f1beccbf tempest-VolumesTransfersV355Test-1540036705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.683s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:33:55 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e3b6d132-4f4d-4cfb-876a-c552f1beccbf tempest-VolumesTransfersV355Test-1540036705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3aba5423-4ff3-40ba-947e-db1a6a078c7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-762344a7-082a-4321-b2b4-dd5bcd2de4e5', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:33:55 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e3b6d132-4f4d-4cfb-876a-c552f1beccbf tempest-VolumesTransfersV355Test-1540036705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36a27ce5-75dc-4a3a-8819-0703b3bfb7c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:33:55 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-e3b6d132-4f4d-4cfb-876a-c552f1beccbf tempest-VolumesTransfersV355Test-1540036705 None] Volume volume-762344a7-082a-4321-b2b4-dd5bcd2de4e5 (762344a7-082a-4321-b2b4-dd5bcd2de4e5): created successfully Nov 06 15:33:55 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e3b6d132-4f4d-4cfb-876a-c552f1beccbf tempest-VolumesTransfersV355Test-1540036705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36a27ce5-75dc-4a3a-8819-0703b3bfb7c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:33:55 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e3b6d132-4f4d-4cfb-876a-c552f1beccbf tempest-VolumesTransfersV355Test-1540036705 None] Flow 'volume_create_manager' (3bc140ee-8cc6-46af-bae4-35b1852a2926) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:33:55 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-e3b6d132-4f4d-4cfb-876a-c552f1beccbf tempest-VolumesTransfersV355Test-1540036705 None] Created volume successfully. Nov 06 15:33:56 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-d85d1dbb-15f3-4754-8ec5-39235105b25b tempest-VolumesTransfersV355Test-143400994 None] Transfer volume completed successfully. Nov 06 15:33:56 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-209ee168-666c-4c42-9768-3a0401ea9ee2 tempest-VolumesTransfersV355Test-568851328 None] Acquiring lock "cinder-762344a7-082a-4321-b2b4-dd5bcd2de4e5-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:33:56 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-209ee168-666c-4c42-9768-3a0401ea9ee2 tempest-VolumesTransfersV355Test-568851328 None] Lock "cinder-762344a7-082a-4321-b2b4-dd5bcd2de4e5-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:33:56 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-209ee168-666c-4c42-9768-3a0401ea9ee2 tempest-VolumesTransfersV355Test-568851328 None] Acquiring lock "cinder-quobyte-762344a7-082a-4321-b2b4-dd5bcd2de4e5" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:33:56 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-209ee168-666c-4c42-9768-3a0401ea9ee2 tempest-VolumesTransfersV355Test-568851328 None] Lock "cinder-quobyte-762344a7-082a-4321-b2b4-dd5bcd2de4e5" acquired by "delete_volume" :: waited 0.019s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:33:56 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[7306f32d-20fe-4daf-9327-e25e900b59f6]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:33:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-209ee168-666c-4c42-9768-3a0401ea9ee2 tempest-VolumesTransfersV355Test-568851328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-762344a7-082a-4321-b2b4-dd5bcd2de4e5 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:33:56 devstack sudo[103492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-762344a7-082a-4321-b2b4-dd5bcd2de4e5 Nov 06 15:33:56 devstack sudo[103492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:33:57 devstack sudo[103492]: pam_unix(sudo:session): session closed for user root Nov 06 15:33:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-209ee168-666c-4c42-9768-3a0401ea9ee2 tempest-VolumesTransfersV355Test-568851328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-762344a7-082a-4321-b2b4-dd5bcd2de4e5" returned: 0 in 0.346s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:33:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-209ee168-666c-4c42-9768-3a0401ea9ee2 tempest-VolumesTransfersV355Test-568851328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-762344a7-082a-4321-b2b4-dd5bcd2de4e5 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:33:57 devstack sudo[103497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-762344a7-082a-4321-b2b4-dd5bcd2de4e5 Nov 06 15:33:57 devstack sudo[103497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:33:57 devstack sudo[103497]: pam_unix(sudo:session): session closed for user root Nov 06 15:33:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-209ee168-666c-4c42-9768-3a0401ea9ee2 tempest-VolumesTransfersV355Test-568851328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-762344a7-082a-4321-b2b4-dd5bcd2de4e5" returned: 0 in 0.232s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:33:57 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-209ee168-666c-4c42-9768-3a0401ea9ee2 tempest-VolumesTransfersV355Test-568851328 None] Lock "cinder-quobyte-762344a7-082a-4321-b2b4-dd5bcd2de4e5" released by "delete_volume" :: held 0.615s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:33:57 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-209ee168-666c-4c42-9768-3a0401ea9ee2 tempest-VolumesTransfersV355Test-568851328 None] Created reservations ['d64e5bf9-2047-429a-87ce-b7b7830349de', '30ce33e6-32b3-44fe-9692-983bec8a88da', '94806e4a-5eed-4d05-9b8a-803f363856a2', '29646539-47a9-4068-99b5-bf2e50bc46e7'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:33:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-209ee168-666c-4c42-9768-3a0401ea9ee2 tempest-VolumesTransfersV355Test-568851328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:33:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-209ee168-666c-4c42-9768-3a0401ea9ee2 tempest-VolumesTransfersV355Test-568851328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:33:57 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-209ee168-666c-4c42-9768-3a0401ea9ee2 tempest-VolumesTransfersV355Test-568851328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:33:57 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-209ee168-666c-4c42-9768-3a0401ea9ee2 tempest-VolumesTransfersV355Test-568851328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:33:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-209ee168-666c-4c42-9768-3a0401ea9ee2 tempest-VolumesTransfersV355Test-568851328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:33:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-209ee168-666c-4c42-9768-3a0401ea9ee2 tempest-VolumesTransfersV355Test-568851328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:33:57 devstack sudo[103500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:33:57 devstack sudo[103500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:33:57 devstack sudo[103500]: pam_unix(sudo:session): session closed for user root Nov 06 15:33:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-209ee168-666c-4c42-9768-3a0401ea9ee2 tempest-VolumesTransfersV355Test-568851328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.232s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:33:57 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-209ee168-666c-4c42-9768-3a0401ea9ee2 tempest-VolumesTransfersV355Test-568851328 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:33:57 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-209ee168-666c-4c42-9768-3a0401ea9ee2 tempest-VolumesTransfersV355Test-568851328 None] Deleted volume successfully. Nov 06 15:33:57 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-209ee168-666c-4c42-9768-3a0401ea9ee2 tempest-VolumesTransfersV355Test-568851328 None] Lock "cinder-762344a7-082a-4321-b2b4-dd5bcd2de4e5-delete_volume" released by "delete_volume" :: held 1.032s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:33:58 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-012a8e8b-3601-4ea2-a0ef-eb30044d0bd9 tempest-VolumesTransfersV355Test-1540036705 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:33:58 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-012a8e8b-3601-4ea2-a0ef-eb30044d0bd9 tempest-VolumesTransfersV355Test-1540036705 None] Flow 'volume_create_manager' (65166b16-b764-4db7-8a20-7acba6b0e48b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:33:58 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-012a8e8b-3601-4ea2-a0ef-eb30044d0bd9 tempest-VolumesTransfersV355Test-1540036705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a679196c-9a23-4c4a-bfdd-ccf82b9a0448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:33:58 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-012a8e8b-3601-4ea2-a0ef-eb30044d0bd9 tempest-VolumesTransfersV355Test-1540036705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a679196c-9a23-4c4a-bfdd-ccf82b9a0448) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:33:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-135857498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a60e87c-0d0a-4d1e-8bf9-718b7d2da940,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68fa2628c4f64dab98218a8caed00612',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:33:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:33:58Z,use_quota=True,user_id='f416e6bd95be4ad38acf2a7d7eb83a7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:33:58 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-012a8e8b-3601-4ea2-a0ef-eb30044d0bd9 tempest-VolumesTransfersV355Test-1540036705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d0fb6bf-6b0d-4e91-a28c-32b67256f8e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:33:58 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-012a8e8b-3601-4ea2-a0ef-eb30044d0bd9 tempest-VolumesTransfersV355Test-1540036705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d0fb6bf-6b0d-4e91-a28c-32b67256f8e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:33:58 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-012a8e8b-3601-4ea2-a0ef-eb30044d0bd9 tempest-VolumesTransfersV355Test-1540036705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c97c5587-3668-4677-8e64-496295770603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:33:58 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-012a8e8b-3601-4ea2-a0ef-eb30044d0bd9 tempest-VolumesTransfersV355Test-1540036705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c97c5587-3668-4677-8e64-496295770603) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a60e87c-0d0a-4d1e-8bf9-718b7d2da940', 'volume_name': 'volume-5a60e87c-0d0a-4d1e-8bf9-718b7d2da940', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:33:58 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-012a8e8b-3601-4ea2-a0ef-eb30044d0bd9 tempest-VolumesTransfersV355Test-1540036705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d8e257e-a783-4115-93c7-016e7ea6bb93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:33:58 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-012a8e8b-3601-4ea2-a0ef-eb30044d0bd9 tempest-VolumesTransfersV355Test-1540036705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d8e257e-a783-4115-93c7-016e7ea6bb93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:33:58 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-012a8e8b-3601-4ea2-a0ef-eb30044d0bd9 tempest-VolumesTransfersV355Test-1540036705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66d1325c-d3cd-4f45-87e0-493e13caac4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:33:58 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-012a8e8b-3601-4ea2-a0ef-eb30044d0bd9 tempest-VolumesTransfersV355Test-1540036705 None] Volume 5a60e87c-0d0a-4d1e-8bf9-718b7d2da940: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a60e87c-0d0a-4d1e-8bf9-718b7d2da940', 'volume_size': 1} Nov 06 15:33:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-012a8e8b-3601-4ea2-a0ef-eb30044d0bd9 tempest-VolumesTransfersV355Test-1540036705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:33:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-012a8e8b-3601-4ea2-a0ef-eb30044d0bd9 tempest-VolumesTransfersV355Test-1540036705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:33:58 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-012a8e8b-3601-4ea2-a0ef-eb30044d0bd9 tempest-VolumesTransfersV355Test-1540036705 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:33:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-135857498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a60e87c-0d0a-4d1e-8bf9-718b7d2da940,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68fa2628c4f64dab98218a8caed00612',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:33:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:33:58Z,use_quota=True,user_id='f416e6bd95be4ad38acf2a7d7eb83a7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:33:58 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-012a8e8b-3601-4ea2-a0ef-eb30044d0bd9 tempest-VolumesTransfersV355Test-1540036705 None] Creating volume 5a60e87c-0d0a-4d1e-8bf9-718b7d2da940 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:33:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-012a8e8b-3601-4ea2-a0ef-eb30044d0bd9 tempest-VolumesTransfersV355Test-1540036705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:33:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-012a8e8b-3601-4ea2-a0ef-eb30044d0bd9 tempest-VolumesTransfersV355Test-1540036705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:33:58 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-012a8e8b-3601-4ea2-a0ef-eb30044d0bd9 tempest-VolumesTransfersV355Test-1540036705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:33:58 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-012a8e8b-3601-4ea2-a0ef-eb30044d0bd9 tempest-VolumesTransfersV355Test-1540036705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:33:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-012a8e8b-3601-4ea2-a0ef-eb30044d0bd9 tempest-VolumesTransfersV355Test-1540036705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:33:58 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-012a8e8b-3601-4ea2-a0ef-eb30044d0bd9 tempest-VolumesTransfersV355Test-1540036705 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:33:58 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-012a8e8b-3601-4ea2-a0ef-eb30044d0bd9 tempest-VolumesTransfersV355Test-1540036705 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:33:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-012a8e8b-3601-4ea2-a0ef-eb30044d0bd9 tempest-VolumesTransfersV355Test-1540036705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-5a60e87c-0d0a-4d1e-8bf9-718b7d2da940 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:33:58 devstack sudo[103509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-5a60e87c-0d0a-4d1e-8bf9-718b7d2da940 1073741824 Nov 06 15:33:58 devstack sudo[103509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:33:58 devstack sudo[103509]: pam_unix(sudo:session): session closed for user root Nov 06 15:33:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-012a8e8b-3601-4ea2-a0ef-eb30044d0bd9 tempest-VolumesTransfersV355Test-1540036705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-5a60e87c-0d0a-4d1e-8bf9-718b7d2da940 1073741824" returned: 0 in 0.420s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:33:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-012a8e8b-3601-4ea2-a0ef-eb30044d0bd9 tempest-VolumesTransfersV355Test-1540036705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-5a60e87c-0d0a-4d1e-8bf9-718b7d2da940 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:33:58 devstack sudo[103549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-5a60e87c-0d0a-4d1e-8bf9-718b7d2da940 Nov 06 15:33:58 devstack sudo[103549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:33:59 devstack sudo[103549]: pam_unix(sudo:session): session closed for user root Nov 06 15:33:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-012a8e8b-3601-4ea2-a0ef-eb30044d0bd9 tempest-VolumesTransfersV355Test-1540036705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-5a60e87c-0d0a-4d1e-8bf9-718b7d2da940" returned: 0 in 0.245s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:33:59 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-012a8e8b-3601-4ea2-a0ef-eb30044d0bd9 tempest-VolumesTransfersV355Test-1540036705 None] <== create_volume: return (709ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:33:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-012a8e8b-3601-4ea2-a0ef-eb30044d0bd9 tempest-VolumesTransfersV355Test-1540036705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.712s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:33:59 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-012a8e8b-3601-4ea2-a0ef-eb30044d0bd9 tempest-VolumesTransfersV355Test-1540036705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66d1325c-d3cd-4f45-87e0-493e13caac4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a60e87c-0d0a-4d1e-8bf9-718b7d2da940', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:33:59 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-012a8e8b-3601-4ea2-a0ef-eb30044d0bd9 tempest-VolumesTransfersV355Test-1540036705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9291ff66-1786-4772-8c40-0712556a9114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:33:59 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-012a8e8b-3601-4ea2-a0ef-eb30044d0bd9 tempest-VolumesTransfersV355Test-1540036705 None] Volume volume-5a60e87c-0d0a-4d1e-8bf9-718b7d2da940 (5a60e87c-0d0a-4d1e-8bf9-718b7d2da940): created successfully Nov 06 15:33:59 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-012a8e8b-3601-4ea2-a0ef-eb30044d0bd9 tempest-VolumesTransfersV355Test-1540036705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9291ff66-1786-4772-8c40-0712556a9114) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:33:59 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-012a8e8b-3601-4ea2-a0ef-eb30044d0bd9 tempest-VolumesTransfersV355Test-1540036705 None] Flow 'volume_create_manager' (65166b16-b764-4db7-8a20-7acba6b0e48b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:33:59 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-012a8e8b-3601-4ea2-a0ef-eb30044d0bd9 tempest-VolumesTransfersV355Test-1540036705 None] Created volume successfully. Nov 06 15:33:59 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-ffe5422a-e127-4f03-bf19-7579d2d3d5ac tempest-VolumesTransfersV355Test-568851328 None] Acquiring lock "cinder-5a60e87c-0d0a-4d1e-8bf9-718b7d2da940-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:33:59 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-ffe5422a-e127-4f03-bf19-7579d2d3d5ac tempest-VolumesTransfersV355Test-568851328 None] Lock "cinder-5a60e87c-0d0a-4d1e-8bf9-718b7d2da940-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:33:59 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-ffe5422a-e127-4f03-bf19-7579d2d3d5ac tempest-VolumesTransfersV355Test-568851328 None] Acquiring lock "cinder-quobyte-5a60e87c-0d0a-4d1e-8bf9-718b7d2da940" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:33:59 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-ffe5422a-e127-4f03-bf19-7579d2d3d5ac tempest-VolumesTransfersV355Test-568851328 None] Lock "cinder-quobyte-5a60e87c-0d0a-4d1e-8bf9-718b7d2da940" acquired by "delete_volume" :: waited 0.014s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:33:59 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[279f17a9-dd36-455d-9148-bfb055e483f1]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:33:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ffe5422a-e127-4f03-bf19-7579d2d3d5ac tempest-VolumesTransfersV355Test-568851328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-5a60e87c-0d0a-4d1e-8bf9-718b7d2da940 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:33:59 devstack sudo[103554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-5a60e87c-0d0a-4d1e-8bf9-718b7d2da940 Nov 06 15:33:59 devstack sudo[103554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:33:59 devstack sudo[103554]: pam_unix(sudo:session): session closed for user root Nov 06 15:33:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ffe5422a-e127-4f03-bf19-7579d2d3d5ac tempest-VolumesTransfersV355Test-568851328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-5a60e87c-0d0a-4d1e-8bf9-718b7d2da940" returned: 0 in 0.344s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:33:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ffe5422a-e127-4f03-bf19-7579d2d3d5ac tempest-VolumesTransfersV355Test-568851328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-5a60e87c-0d0a-4d1e-8bf9-718b7d2da940 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:33:59 devstack sudo[103559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-5a60e87c-0d0a-4d1e-8bf9-718b7d2da940 Nov 06 15:33:59 devstack sudo[103559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:34:00 devstack sudo[103559]: pam_unix(sudo:session): session closed for user root Nov 06 15:34:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ffe5422a-e127-4f03-bf19-7579d2d3d5ac tempest-VolumesTransfersV355Test-568851328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-5a60e87c-0d0a-4d1e-8bf9-718b7d2da940" returned: 0 in 0.249s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:34:00 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-ffe5422a-e127-4f03-bf19-7579d2d3d5ac tempest-VolumesTransfersV355Test-568851328 None] Lock "cinder-quobyte-5a60e87c-0d0a-4d1e-8bf9-718b7d2da940" released by "delete_volume" :: held 0.629s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:34:00 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-ffe5422a-e127-4f03-bf19-7579d2d3d5ac tempest-VolumesTransfersV355Test-568851328 None] Created reservations ['cbdddf17-6e67-4419-8362-1e50e667583e', '4d0ef7b5-84fb-4f27-97ae-5bf2246a60d9', '6b095ef8-ec32-4282-8e14-691c544dd926', '76b74d52-ac28-400f-a1fe-e58677a1b7a4'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:34:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ffe5422a-e127-4f03-bf19-7579d2d3d5ac tempest-VolumesTransfersV355Test-568851328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:34:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ffe5422a-e127-4f03-bf19-7579d2d3d5ac tempest-VolumesTransfersV355Test-568851328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:34:00 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-ffe5422a-e127-4f03-bf19-7579d2d3d5ac tempest-VolumesTransfersV355Test-568851328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:34:00 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-ffe5422a-e127-4f03-bf19-7579d2d3d5ac tempest-VolumesTransfersV355Test-568851328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:34:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ffe5422a-e127-4f03-bf19-7579d2d3d5ac tempest-VolumesTransfersV355Test-568851328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:34:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ffe5422a-e127-4f03-bf19-7579d2d3d5ac tempest-VolumesTransfersV355Test-568851328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:34:00 devstack sudo[103562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:34:00 devstack sudo[103562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:34:00 devstack sudo[103562]: pam_unix(sudo:session): session closed for user root Nov 06 15:34:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ffe5422a-e127-4f03-bf19-7579d2d3d5ac tempest-VolumesTransfersV355Test-568851328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.240s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:34:00 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-ffe5422a-e127-4f03-bf19-7579d2d3d5ac tempest-VolumesTransfersV355Test-568851328 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:34:00 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-ffe5422a-e127-4f03-bf19-7579d2d3d5ac tempest-VolumesTransfersV355Test-568851328 None] Deleted volume successfully. Nov 06 15:34:00 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-ffe5422a-e127-4f03-bf19-7579d2d3d5ac tempest-VolumesTransfersV355Test-568851328 None] Lock "cinder-5a60e87c-0d0a-4d1e-8bf9-718b7d2da940-delete_volume" released by "delete_volume" :: held 1.058s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:34:06 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-98bf6513-d07d-45bf-b0f9-7f4aed217ccb tempest-VolumesCloneTest-793414480 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:34:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-98bf6513-d07d-45bf-b0f9-7f4aed217ccb tempest-VolumesCloneTest-793414480 None] Flow 'volume_create_manager' (3e21729e-3451-4284-83c3-232cb6911a21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:34:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-98bf6513-d07d-45bf-b0f9-7f4aed217ccb tempest-VolumesCloneTest-793414480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (507924dc-5175-4db6-acde-bac3d72ea75f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:34:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-98bf6513-d07d-45bf-b0f9-7f4aed217ccb tempest-VolumesCloneTest-793414480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (507924dc-5175-4db6-acde-bac3d72ea75f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:34:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1039658399',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfd36843-2f31-4f80-ab67-badef1dca3de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c2db855ad1545ae949c27a1914acada',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:34:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:34:06Z,use_quota=True,user_id='b0d795cc27ec42f89cf0d76d5acc9edc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:34:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-98bf6513-d07d-45bf-b0f9-7f4aed217ccb tempest-VolumesCloneTest-793414480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82fad566-4211-4acc-8011-76684b2512d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:34:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-98bf6513-d07d-45bf-b0f9-7f4aed217ccb tempest-VolumesCloneTest-793414480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82fad566-4211-4acc-8011-76684b2512d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:34:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-98bf6513-d07d-45bf-b0f9-7f4aed217ccb tempest-VolumesCloneTest-793414480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c13394f0-719d-4227-9ff1-6b205b149161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:34:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-98bf6513-d07d-45bf-b0f9-7f4aed217ccb tempest-VolumesCloneTest-793414480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c13394f0-719d-4227-9ff1-6b205b149161) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bfd36843-2f31-4f80-ab67-badef1dca3de', 'volume_name': 'volume-bfd36843-2f31-4f80-ab67-badef1dca3de', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:34:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-98bf6513-d07d-45bf-b0f9-7f4aed217ccb tempest-VolumesCloneTest-793414480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7442ff5e-85b8-4f54-8eaf-accae64ed6e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:34:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-98bf6513-d07d-45bf-b0f9-7f4aed217ccb tempest-VolumesCloneTest-793414480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7442ff5e-85b8-4f54-8eaf-accae64ed6e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:34:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-98bf6513-d07d-45bf-b0f9-7f4aed217ccb tempest-VolumesCloneTest-793414480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29f42af5-43d1-4e34-af81-c1b8c44bdf37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:34:06 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-98bf6513-d07d-45bf-b0f9-7f4aed217ccb tempest-VolumesCloneTest-793414480 None] Volume bfd36843-2f31-4f80-ab67-badef1dca3de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bfd36843-2f31-4f80-ab67-badef1dca3de', 'volume_size': 1} Nov 06 15:34:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-98bf6513-d07d-45bf-b0f9-7f4aed217ccb tempest-VolumesCloneTest-793414480 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:34:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-98bf6513-d07d-45bf-b0f9-7f4aed217ccb tempest-VolumesCloneTest-793414480 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:34:06 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-98bf6513-d07d-45bf-b0f9-7f4aed217ccb tempest-VolumesCloneTest-793414480 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:34:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1039658399',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfd36843-2f31-4f80-ab67-badef1dca3de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c2db855ad1545ae949c27a1914acada',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:34:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:34:06Z,use_quota=True,user_id='b0d795cc27ec42f89cf0d76d5acc9edc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:34:06 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-98bf6513-d07d-45bf-b0f9-7f4aed217ccb tempest-VolumesCloneTest-793414480 None] Creating volume bfd36843-2f31-4f80-ab67-badef1dca3de {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:34:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-98bf6513-d07d-45bf-b0f9-7f4aed217ccb tempest-VolumesCloneTest-793414480 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:34:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-98bf6513-d07d-45bf-b0f9-7f4aed217ccb tempest-VolumesCloneTest-793414480 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:34:06 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-98bf6513-d07d-45bf-b0f9-7f4aed217ccb tempest-VolumesCloneTest-793414480 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:34:06 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-98bf6513-d07d-45bf-b0f9-7f4aed217ccb tempest-VolumesCloneTest-793414480 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:34:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-98bf6513-d07d-45bf-b0f9-7f4aed217ccb tempest-VolumesCloneTest-793414480 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:34:06 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-98bf6513-d07d-45bf-b0f9-7f4aed217ccb tempest-VolumesCloneTest-793414480 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:34:06 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-98bf6513-d07d-45bf-b0f9-7f4aed217ccb tempest-VolumesCloneTest-793414480 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:34:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-98bf6513-d07d-45bf-b0f9-7f4aed217ccb tempest-VolumesCloneTest-793414480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-bfd36843-2f31-4f80-ab67-badef1dca3de 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:34:06 devstack sudo[103568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-bfd36843-2f31-4f80-ab67-badef1dca3de 1073741824 Nov 06 15:34:06 devstack sudo[103568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:34:06 devstack sudo[103568]: pam_unix(sudo:session): session closed for user root Nov 06 15:34:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-98bf6513-d07d-45bf-b0f9-7f4aed217ccb tempest-VolumesCloneTest-793414480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-bfd36843-2f31-4f80-ab67-badef1dca3de 1073741824" returned: 0 in 0.392s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:34:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-98bf6513-d07d-45bf-b0f9-7f4aed217ccb tempest-VolumesCloneTest-793414480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-bfd36843-2f31-4f80-ab67-badef1dca3de {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:34:06 devstack sudo[103574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-bfd36843-2f31-4f80-ab67-badef1dca3de Nov 06 15:34:06 devstack sudo[103574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:34:07 devstack sudo[103574]: pam_unix(sudo:session): session closed for user root Nov 06 15:34:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-98bf6513-d07d-45bf-b0f9-7f4aed217ccb tempest-VolumesCloneTest-793414480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-bfd36843-2f31-4f80-ab67-badef1dca3de" returned: 0 in 0.246s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:34:07 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-98bf6513-d07d-45bf-b0f9-7f4aed217ccb tempest-VolumesCloneTest-793414480 None] <== create_volume: return (676ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:34:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-98bf6513-d07d-45bf-b0f9-7f4aed217ccb tempest-VolumesCloneTest-793414480 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.679s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:34:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-98bf6513-d07d-45bf-b0f9-7f4aed217ccb tempest-VolumesCloneTest-793414480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29f42af5-43d1-4e34-af81-c1b8c44bdf37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bfd36843-2f31-4f80-ab67-badef1dca3de', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:34:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-98bf6513-d07d-45bf-b0f9-7f4aed217ccb tempest-VolumesCloneTest-793414480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e35ee9e-bf01-4c81-b732-864e419b0ffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:34:07 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-98bf6513-d07d-45bf-b0f9-7f4aed217ccb tempest-VolumesCloneTest-793414480 None] Volume volume-bfd36843-2f31-4f80-ab67-badef1dca3de (bfd36843-2f31-4f80-ab67-badef1dca3de): created successfully Nov 06 15:34:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-98bf6513-d07d-45bf-b0f9-7f4aed217ccb tempest-VolumesCloneTest-793414480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e35ee9e-bf01-4c81-b732-864e419b0ffd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:34:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-98bf6513-d07d-45bf-b0f9-7f4aed217ccb tempest-VolumesCloneTest-793414480 None] Flow 'volume_create_manager' (3e21729e-3451-4284-83c3-232cb6911a21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:34:07 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-98bf6513-d07d-45bf-b0f9-7f4aed217ccb tempest-VolumesCloneTest-793414480 None] Created volume successfully. Nov 06 15:34:07 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b19b55b-53e0-4f14-aa1f-3bc2a10e8a43 tempest-VolumesCloneTest-793414480 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:34:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3b19b55b-53e0-4f14-aa1f-3bc2a10e8a43 tempest-VolumesCloneTest-793414480 None] Flow 'volume_create_manager' (b0e44c8c-11f4-484d-a944-dd08cb7c7379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:34:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3b19b55b-53e0-4f14-aa1f-3bc2a10e8a43 tempest-VolumesCloneTest-793414480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f661502e-e4c2-46d3-8e73-e66149ecb604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:34:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3b19b55b-53e0-4f14-aa1f-3bc2a10e8a43 tempest-VolumesCloneTest-793414480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f661502e-e4c2-46d3-8e73-e66149ecb604) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:34:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1639372397',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb5f76bc-818d-45dc-b1d1-a4186868c60a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c2db855ad1545ae949c27a1914acada',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:34:08Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=bfd36843-2f31-4f80-ab67-badef1dca3de,status='creating',terminated_at=None,updated_at=2026-11-06T14:34:08Z,use_quota=True,user_id='b0d795cc27ec42f89cf0d76d5acc9edc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:34:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3b19b55b-53e0-4f14-aa1f-3bc2a10e8a43 tempest-VolumesCloneTest-793414480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df124459-1493-4e5d-b40d-61a0fb5ef226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:34:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3b19b55b-53e0-4f14-aa1f-3bc2a10e8a43 tempest-VolumesCloneTest-793414480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df124459-1493-4e5d-b40d-61a0fb5ef226) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:34:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3b19b55b-53e0-4f14-aa1f-3bc2a10e8a43 tempest-VolumesCloneTest-793414480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ef80548-9825-42fb-97e5-357f19ad3acd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:34:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3b19b55b-53e0-4f14-aa1f-3bc2a10e8a43 tempest-VolumesCloneTest-793414480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ef80548-9825-42fb-97e5-357f19ad3acd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'fb5f76bc-818d-45dc-b1d1-a4186868c60a', 'volume_name': 'volume-fb5f76bc-818d-45dc-b1d1-a4186868c60a', 'volume_size': 2, 'source_volid': 'bfd36843-2f31-4f80-ab67-badef1dca3de', 'source_volstatus': 'available'}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:34:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3b19b55b-53e0-4f14-aa1f-3bc2a10e8a43 tempest-VolumesCloneTest-793414480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a1457dd-fb26-4ecd-a650-b2cc692246e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:34:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3b19b55b-53e0-4f14-aa1f-3bc2a10e8a43 tempest-VolumesCloneTest-793414480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a1457dd-fb26-4ecd-a650-b2cc692246e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:34:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3b19b55b-53e0-4f14-aa1f-3bc2a10e8a43 tempest-VolumesCloneTest-793414480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12281fd0-0d9e-447b-8da5-6c2a3564b26f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:34:07 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-3b19b55b-53e0-4f14-aa1f-3bc2a10e8a43 tempest-VolumesCloneTest-793414480 None] Volume fb5f76bc-818d-45dc-b1d1-a4186868c60a: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-fb5f76bc-818d-45dc-b1d1-a4186868c60a', 'volume_size': 2, 'source_volid': 'bfd36843-2f31-4f80-ab67-badef1dca3de', 'source_volstatus': 'available'} Nov 06 15:34:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3b19b55b-53e0-4f14-aa1f-3bc2a10e8a43 tempest-VolumesCloneTest-793414480 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:34:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3b19b55b-53e0-4f14-aa1f-3bc2a10e8a43 tempest-VolumesCloneTest-793414480 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:34:07 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-3b19b55b-53e0-4f14-aa1f-3bc2a10e8a43 tempest-VolumesCloneTest-793414480 None] Cloning volume bfd36843-2f31-4f80-ab67-badef1dca3de to volume fb5f76bc-818d-45dc-b1d1-a4186868c60a Nov 06 15:34:07 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-3b19b55b-53e0-4f14-aa1f-3bc2a10e8a43 tempest-VolumesCloneTest-793414480 None] Creating offline snapshot ff082c98-32a9-4666-a89c-6daa35c18e29 of volume bfd36843-2f31-4f80-ab67-badef1dca3de {{(pid=87132) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 15:34:08 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ffbcd8b-ef8f-48d6-a3ba-cb7c349b4651]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:34:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3b19b55b-53e0-4f14-aa1f-3bc2a10e8a43 tempest-VolumesCloneTest-793414480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-bfd36843-2f31-4f80-ab67-badef1dca3de {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:34:08 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 15:34:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:34:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:34:08 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:34:08 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:34:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:34:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:34:08 devstack sudo[103578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:34:08 devstack sudo[103578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:34:08 devstack sudo[103577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-bfd36843-2f31-4f80-ab67-badef1dca3de Nov 06 15:34:08 devstack sudo[103577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:34:08 devstack sudo[103578]: pam_unix(sudo:session): session closed for user root Nov 06 15:34:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.255s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:34:08 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:34:08 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Running periodic task VolumeManager._thread_info {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 15:34:08 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] thread count: 28 {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 15:34:08 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] thread info: [<_MainThread(MainThread, started 140011251929216)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 06 15:34:08 devstack sudo[103577]: pam_unix(sudo:session): session closed for user root Nov 06 15:34:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3b19b55b-53e0-4f14-aa1f-3bc2a10e8a43 tempest-VolumesCloneTest-793414480 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-bfd36843-2f31-4f80-ab67-badef1dca3de" returned: 0 in 0.360s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:34:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3b19b55b-53e0-4f14-aa1f-3bc2a10e8a43 tempest-VolumesCloneTest-793414480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-bfd36843-2f31-4f80-ab67-badef1dca3de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-bfd36843-2f31-4f80-ab67-badef1dca3de.ff082c98-32a9-4666-a89c-6daa35c18e29 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:34:08 devstack sudo[103585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-bfd36843-2f31-4f80-ab67-badef1dca3de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-bfd36843-2f31-4f80-ab67-badef1dca3de.ff082c98-32a9-4666-a89c-6daa35c18e29 1G Nov 06 15:34:08 devstack sudo[103585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:34:08 devstack sudo[103585]: pam_unix(sudo:session): session closed for user root Nov 06 15:34:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3b19b55b-53e0-4f14-aa1f-3bc2a10e8a43 tempest-VolumesCloneTest-793414480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-bfd36843-2f31-4f80-ab67-badef1dca3de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-bfd36843-2f31-4f80-ab67-badef1dca3de.ff082c98-32a9-4666-a89c-6daa35c18e29 1G" returned: 0 in 0.392s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:34:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3b19b55b-53e0-4f14-aa1f-3bc2a10e8a43 tempest-VolumesCloneTest-793414480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bfd36843-2f31-4f80-ab67-badef1dca3de -F qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-bfd36843-2f31-4f80-ab67-badef1dca3de.ff082c98-32a9-4666-a89c-6daa35c18e29 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:34:08 devstack sudo[103590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bfd36843-2f31-4f80-ab67-badef1dca3de -F qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-bfd36843-2f31-4f80-ab67-badef1dca3de.ff082c98-32a9-4666-a89c-6daa35c18e29 Nov 06 15:34:08 devstack sudo[103590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:34:09 devstack sudo[103590]: pam_unix(sudo:session): session closed for user root Nov 06 15:34:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3b19b55b-53e0-4f14-aa1f-3bc2a10e8a43 tempest-VolumesCloneTest-793414480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bfd36843-2f31-4f80-ab67-badef1dca3de -F qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-bfd36843-2f31-4f80-ab67-badef1dca3de.ff082c98-32a9-4666-a89c-6daa35c18e29" returned: 0 in 0.280s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:34:09 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-3b19b55b-53e0-4f14-aa1f-3bc2a10e8a43 tempest-VolumesCloneTest-793414480 None] /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-bfd36843-2f31-4f80-ab67-badef1dca3de.ff082c98-32a9-4666-a89c-6daa35c18e29 is being set with open permissions: ugo+rw Nov 06 15:34:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3b19b55b-53e0-4f14-aa1f-3bc2a10e8a43 tempest-VolumesCloneTest-793414480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-bfd36843-2f31-4f80-ab67-badef1dca3de.ff082c98-32a9-4666-a89c-6daa35c18e29 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:34:09 devstack sudo[103595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-bfd36843-2f31-4f80-ab67-badef1dca3de.ff082c98-32a9-4666-a89c-6daa35c18e29 Nov 06 15:34:09 devstack sudo[103595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:34:09 devstack sudo[103595]: pam_unix(sudo:session): session closed for user root Nov 06 15:34:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3b19b55b-53e0-4f14-aa1f-3bc2a10e8a43 tempest-VolumesCloneTest-793414480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-bfd36843-2f31-4f80-ab67-badef1dca3de.ff082c98-32a9-4666-a89c-6daa35c18e29" returned: 0 in 0.244s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:34:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3b19b55b-53e0-4f14-aa1f-3bc2a10e8a43 tempest-VolumesCloneTest-793414480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-bfd36843-2f31-4f80-ab67-badef1dca3de.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:34:09 devstack sudo[103598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-bfd36843-2f31-4f80-ab67-badef1dca3de.info Nov 06 15:34:09 devstack sudo[103598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:34:09 devstack sudo[103598]: pam_unix(sudo:session): session closed for user root Nov 06 15:34:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3b19b55b-53e0-4f14-aa1f-3bc2a10e8a43 tempest-VolumesCloneTest-793414480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-bfd36843-2f31-4f80-ab67-badef1dca3de.info" returned: 0 in 0.245s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:34:09 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-3b19b55b-53e0-4f14-aa1f-3bc2a10e8a43 tempest-VolumesCloneTest-793414480 None] /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-bfd36843-2f31-4f80-ab67-badef1dca3de.info is being set with open permissions: ugo+rw Nov 06 15:34:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3b19b55b-53e0-4f14-aa1f-3bc2a10e8a43 tempest-VolumesCloneTest-793414480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-bfd36843-2f31-4f80-ab67-badef1dca3de.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:34:09 devstack sudo[103601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-bfd36843-2f31-4f80-ab67-badef1dca3de.info Nov 06 15:34:09 devstack sudo[103601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:34:09 devstack sudo[103601]: pam_unix(sudo:session): session closed for user root Nov 06 15:34:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3b19b55b-53e0-4f14-aa1f-3bc2a10e8a43 tempest-VolumesCloneTest-793414480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-bfd36843-2f31-4f80-ab67-badef1dca3de.info" returned: 0 in 0.239s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:34:09 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-3b19b55b-53e0-4f14-aa1f-3bc2a10e8a43 tempest-VolumesCloneTest-793414480 None] Acquiring lock "cinder-quobyte-fb5f76bc-818d-45dc-b1d1-a4186868c60a" by "_copy_volume_from_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:34:09 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-3b19b55b-53e0-4f14-aa1f-3bc2a10e8a43 tempest-VolumesCloneTest-793414480 None] Lock "cinder-quobyte-fb5f76bc-818d-45dc-b1d1-a4186868c60a" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:34:09 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3b19b55b-53e0-4f14-aa1f-3bc2a10e8a43 tempest-VolumesCloneTest-793414480 None] snapshot: ff082c98-32a9-4666-a89c-6daa35c18e29, volume: fb5f76bc-818d-45dc-b1d1-a4186868c60a, {{(pid=87132) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 06 15:34:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3b19b55b-53e0-4f14-aa1f-3bc2a10e8a43 tempest-VolumesCloneTest-793414480 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:34:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3b19b55b-53e0-4f14-aa1f-3bc2a10e8a43 tempest-VolumesCloneTest-793414480 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:34:09 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3b19b55b-53e0-4f14-aa1f-3bc2a10e8a43 tempest-VolumesCloneTest-793414480 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:34:09 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3b19b55b-53e0-4f14-aa1f-3bc2a10e8a43 tempest-VolumesCloneTest-793414480 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:34:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3b19b55b-53e0-4f14-aa1f-3bc2a10e8a43 tempest-VolumesCloneTest-793414480 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:34:09 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[88b2e65b-8be4-4a9e-8b08-54eb2a45f265]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:34:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3b19b55b-53e0-4f14-aa1f-3bc2a10e8a43 tempest-VolumesCloneTest-793414480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-bfd36843-2f31-4f80-ab67-badef1dca3de.ff082c98-32a9-4666-a89c-6daa35c18e29 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:34:09 devstack sudo[103604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-bfd36843-2f31-4f80-ab67-badef1dca3de.ff082c98-32a9-4666-a89c-6daa35c18e29 Nov 06 15:34:09 devstack sudo[103604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:34:10 devstack sudo[103604]: pam_unix(sudo:session): session closed for user root Nov 06 15:34:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3b19b55b-53e0-4f14-aa1f-3bc2a10e8a43 tempest-VolumesCloneTest-793414480 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-bfd36843-2f31-4f80-ab67-badef1dca3de.ff082c98-32a9-4666-a89c-6daa35c18e29" returned: 0 in 0.340s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:34:10 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-3b19b55b-53e0-4f14-aa1f-3bc2a10e8a43 tempest-VolumesCloneTest-793414480 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bfd36843-2f31-4f80-ab67-badef1dca3de(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 15:34:10 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[56df6d23-b873-4f61-98d1-8a297909f631]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:34:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3b19b55b-53e0-4f14-aa1f-3bc2a10e8a43 tempest-VolumesCloneTest-793414480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-bfd36843-2f31-4f80-ab67-badef1dca3de {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:34:10 devstack sudo[103609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-bfd36843-2f31-4f80-ab67-badef1dca3de Nov 06 15:34:10 devstack sudo[103609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:34:10 devstack sudo[103609]: pam_unix(sudo:session): session closed for user root Nov 06 15:34:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3b19b55b-53e0-4f14-aa1f-3bc2a10e8a43 tempest-VolumesCloneTest-793414480 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-bfd36843-2f31-4f80-ab67-badef1dca3de" returned: 0 in 0.343s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:34:10 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3b19b55b-53e0-4f14-aa1f-3bc2a10e8a43 tempest-VolumesCloneTest-793414480 None] will copy from snapshot at /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-bfd36843-2f31-4f80-ab67-badef1dca3de {{(pid=87132) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 06 15:34:10 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3b19b55b-53e0-4f14-aa1f-3bc2a10e8a43 tempest-VolumesCloneTest-793414480 None] Creating direct copy from snapshot {{(pid=87132) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 06 15:34:10 devstack cinder-volume[87132]: DEBUG cinder.utils [None req-3b19b55b-53e0-4f14-aa1f-3bc2a10e8a43 tempest-VolumesCloneTest-793414480 None] Path /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-fb5f76bc-818d-45dc-b1d1-a4186868c60a not found in is_blk_device check {{(pid=87132) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 06 15:34:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3b19b55b-53e0-4f14-aa1f-3bc2a10e8a43 tempest-VolumesCloneTest-793414480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-bfd36843-2f31-4f80-ab67-badef1dca3de /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-fb5f76bc-818d-45dc-b1d1-a4186868c60a {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:34:10 devstack sudo[103614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-bfd36843-2f31-4f80-ab67-badef1dca3de /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-fb5f76bc-818d-45dc-b1d1-a4186868c60a Nov 06 15:34:10 devstack sudo[103614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:34:16 devstack sudo[103614]: pam_unix(sudo:session): session closed for user root Nov 06 15:34:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3b19b55b-53e0-4f14-aa1f-3bc2a10e8a43 tempest-VolumesCloneTest-793414480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-bfd36843-2f31-4f80-ab67-badef1dca3de /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-fb5f76bc-818d-45dc-b1d1-a4186868c60a" returned: 0 in 5.889s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:34:16 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-3b19b55b-53e0-4f14-aa1f-3bc2a10e8a43 tempest-VolumesCloneTest-793414480 None] Image conversion details: src /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-bfd36843-2f31-4f80-ab67-badef1dca3de, size 1024.00 MB, duration 5.89 sec, destination /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-fb5f76bc-818d-45dc-b1d1-a4186868c60a {{(pid=87132) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 06 15:34:16 devstack cinder-volume[87132]: INFO cinder.image.image_utils [None req-3b19b55b-53e0-4f14-aa1f-3bc2a10e8a43 tempest-VolumesCloneTest-793414480 None] Converted 1024.00 MB image at 173.84 MB/s Nov 06 15:34:16 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-3b19b55b-53e0-4f14-aa1f-3bc2a10e8a43 tempest-VolumesCloneTest-793414480 None] /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-fb5f76bc-818d-45dc-b1d1-a4186868c60a is being set with open permissions: ugo+rw Nov 06 15:34:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3b19b55b-53e0-4f14-aa1f-3bc2a10e8a43 tempest-VolumesCloneTest-793414480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-fb5f76bc-818d-45dc-b1d1-a4186868c60a {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:34:16 devstack sudo[103628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-fb5f76bc-818d-45dc-b1d1-a4186868c60a Nov 06 15:34:16 devstack sudo[103628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:34:16 devstack sudo[103628]: pam_unix(sudo:session): session closed for user root Nov 06 15:34:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3b19b55b-53e0-4f14-aa1f-3bc2a10e8a43 tempest-VolumesCloneTest-793414480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-fb5f76bc-818d-45dc-b1d1-a4186868c60a" returned: 0 in 0.230s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:34:16 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-3b19b55b-53e0-4f14-aa1f-3bc2a10e8a43 tempest-VolumesCloneTest-793414480 None] Lock "cinder-quobyte-fb5f76bc-818d-45dc-b1d1-a4186868c60a" released by "_copy_volume_from_snapshot" :: held 6.871s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:34:16 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-3b19b55b-53e0-4f14-aa1f-3bc2a10e8a43 tempest-VolumesCloneTest-793414480 None] Acquiring lock "cinder-quobyte-ff082c98-32a9-4666-a89c-6daa35c18e29" by "_delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:34:16 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-3b19b55b-53e0-4f14-aa1f-3bc2a10e8a43 tempest-VolumesCloneTest-793414480 None] Lock "cinder-quobyte-ff082c98-32a9-4666-a89c-6daa35c18e29" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:34:16 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-3b19b55b-53e0-4f14-aa1f-3bc2a10e8a43 tempest-VolumesCloneTest-793414480 None] Deleting offline snapshot ff082c98-32a9-4666-a89c-6daa35c18e29 of volume bfd36843-2f31-4f80-ab67-badef1dca3de {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 15:34:16 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-3b19b55b-53e0-4f14-aa1f-3bc2a10e8a43 tempest-VolumesCloneTest-793414480 None] snapshot_file for this snap is: volume-bfd36843-2f31-4f80-ab67-badef1dca3de.ff082c98-32a9-4666-a89c-6daa35c18e29 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 15:34:16 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb6f2163-ecc8-4334-aee2-de554196593b]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:34:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3b19b55b-53e0-4f14-aa1f-3bc2a10e8a43 tempest-VolumesCloneTest-793414480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-bfd36843-2f31-4f80-ab67-badef1dca3de.ff082c98-32a9-4666-a89c-6daa35c18e29 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:34:16 devstack sudo[103631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-bfd36843-2f31-4f80-ab67-badef1dca3de.ff082c98-32a9-4666-a89c-6daa35c18e29 Nov 06 15:34:16 devstack sudo[103631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:34:17 devstack sudo[103631]: pam_unix(sudo:session): session closed for user root Nov 06 15:34:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3b19b55b-53e0-4f14-aa1f-3bc2a10e8a43 tempest-VolumesCloneTest-793414480 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-bfd36843-2f31-4f80-ab67-badef1dca3de.ff082c98-32a9-4666-a89c-6daa35c18e29" returned: 0 in 0.354s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:34:17 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-3b19b55b-53e0-4f14-aa1f-3bc2a10e8a43 tempest-VolumesCloneTest-793414480 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bfd36843-2f31-4f80-ab67-badef1dca3de(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 15:34:17 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[19ef4510-f4f3-4a12-8ba5-99fe3cfb1a64]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:34:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3b19b55b-53e0-4f14-aa1f-3bc2a10e8a43 tempest-VolumesCloneTest-793414480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-bfd36843-2f31-4f80-ab67-badef1dca3de {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:34:17 devstack sudo[103636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-bfd36843-2f31-4f80-ab67-badef1dca3de Nov 06 15:34:17 devstack sudo[103636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:34:17 devstack sudo[103636]: pam_unix(sudo:session): session closed for user root Nov 06 15:34:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3b19b55b-53e0-4f14-aa1f-3bc2a10e8a43 tempest-VolumesCloneTest-793414480 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-bfd36843-2f31-4f80-ab67-badef1dca3de" returned: 0 in 0.525s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:34:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3b19b55b-53e0-4f14-aa1f-3bc2a10e8a43 tempest-VolumesCloneTest-793414480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-bfd36843-2f31-4f80-ab67-badef1dca3de.ff082c98-32a9-4666-a89c-6daa35c18e29 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:34:17 devstack sudo[103641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-bfd36843-2f31-4f80-ab67-badef1dca3de.ff082c98-32a9-4666-a89c-6daa35c18e29 Nov 06 15:34:17 devstack sudo[103641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:34:17 devstack sudo[103641]: pam_unix(sudo:session): session closed for user root Nov 06 15:34:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3b19b55b-53e0-4f14-aa1f-3bc2a10e8a43 tempest-VolumesCloneTest-793414480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-bfd36843-2f31-4f80-ab67-badef1dca3de.ff082c98-32a9-4666-a89c-6daa35c18e29" returned: 0 in 0.323s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:34:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3b19b55b-53e0-4f14-aa1f-3bc2a10e8a43 tempest-VolumesCloneTest-793414480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-bfd36843-2f31-4f80-ab67-badef1dca3de.ff082c98-32a9-4666-a89c-6daa35c18e29 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:34:18 devstack sudo[103647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-bfd36843-2f31-4f80-ab67-badef1dca3de.ff082c98-32a9-4666-a89c-6daa35c18e29 Nov 06 15:34:18 devstack sudo[103647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:34:18 devstack sudo[103647]: pam_unix(sudo:session): session closed for user root Nov 06 15:34:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3b19b55b-53e0-4f14-aa1f-3bc2a10e8a43 tempest-VolumesCloneTest-793414480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-bfd36843-2f31-4f80-ab67-badef1dca3de.ff082c98-32a9-4666-a89c-6daa35c18e29" returned: 0 in 0.250s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:34:18 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-3b19b55b-53e0-4f14-aa1f-3bc2a10e8a43 tempest-VolumesCloneTest-793414480 None] Lock "cinder-quobyte-ff082c98-32a9-4666-a89c-6daa35c18e29" released by "_delete_snapshot" :: held 1.537s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:34:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3b19b55b-53e0-4f14-aa1f-3bc2a10e8a43 tempest-VolumesCloneTest-793414480 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.342s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:34:18 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3b19b55b-53e0-4f14-aa1f-3bc2a10e8a43 tempest-VolumesCloneTest-793414480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12281fd0-0d9e-447b-8da5-6c2a3564b26f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb5f76bc-818d-45dc-b1d1-a4186868c60a', 'volume_size': 2, 'source_volid': 'bfd36843-2f31-4f80-ab67-badef1dca3de', 'source_volstatus': 'available'}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:34:18 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3b19b55b-53e0-4f14-aa1f-3bc2a10e8a43 tempest-VolumesCloneTest-793414480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc9999c2-52d5-4d68-8a1b-b9e12c67d020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:34:18 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-3b19b55b-53e0-4f14-aa1f-3bc2a10e8a43 tempest-VolumesCloneTest-793414480 None] Volume volume-fb5f76bc-818d-45dc-b1d1-a4186868c60a (fb5f76bc-818d-45dc-b1d1-a4186868c60a): created successfully Nov 06 15:34:18 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3b19b55b-53e0-4f14-aa1f-3bc2a10e8a43 tempest-VolumesCloneTest-793414480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc9999c2-52d5-4d68-8a1b-b9e12c67d020) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:34:18 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3b19b55b-53e0-4f14-aa1f-3bc2a10e8a43 tempest-VolumesCloneTest-793414480 None] Flow 'volume_create_manager' (b0e44c8c-11f4-484d-a944-dd08cb7c7379) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:34:18 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-3b19b55b-53e0-4f14-aa1f-3bc2a10e8a43 tempest-VolumesCloneTest-793414480 None] Created volume successfully. Nov 06 15:34:18 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b22ca6f8-d3b0-4598-a2a2-b4e5aa12ee02 tempest-VolumesCloneTest-793414480 None] Acquiring lock "cinder-fb5f76bc-818d-45dc-b1d1-a4186868c60a-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:34:18 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b22ca6f8-d3b0-4598-a2a2-b4e5aa12ee02 tempest-VolumesCloneTest-793414480 None] Lock "cinder-fb5f76bc-818d-45dc-b1d1-a4186868c60a-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:34:18 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b22ca6f8-d3b0-4598-a2a2-b4e5aa12ee02 tempest-VolumesCloneTest-793414480 None] Acquiring lock "cinder-quobyte-fb5f76bc-818d-45dc-b1d1-a4186868c60a" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:34:18 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b22ca6f8-d3b0-4598-a2a2-b4e5aa12ee02 tempest-VolumesCloneTest-793414480 None] Lock "cinder-quobyte-fb5f76bc-818d-45dc-b1d1-a4186868c60a" acquired by "delete_volume" :: waited 0.013s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:34:18 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[236b670d-9131-42ac-a5e0-1fc5ab8f6632]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:34:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b22ca6f8-d3b0-4598-a2a2-b4e5aa12ee02 tempest-VolumesCloneTest-793414480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-fb5f76bc-818d-45dc-b1d1-a4186868c60a {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:34:18 devstack sudo[103650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-fb5f76bc-818d-45dc-b1d1-a4186868c60a Nov 06 15:34:18 devstack sudo[103650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:34:19 devstack sudo[103650]: pam_unix(sudo:session): session closed for user root Nov 06 15:34:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b22ca6f8-d3b0-4598-a2a2-b4e5aa12ee02 tempest-VolumesCloneTest-793414480 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-fb5f76bc-818d-45dc-b1d1-a4186868c60a" returned: 0 in 0.352s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:34:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b22ca6f8-d3b0-4598-a2a2-b4e5aa12ee02 tempest-VolumesCloneTest-793414480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-fb5f76bc-818d-45dc-b1d1-a4186868c60a {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:34:19 devstack sudo[103655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-fb5f76bc-818d-45dc-b1d1-a4186868c60a Nov 06 15:34:19 devstack sudo[103655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:34:19 devstack sudo[103655]: pam_unix(sudo:session): session closed for user root Nov 06 15:34:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b22ca6f8-d3b0-4598-a2a2-b4e5aa12ee02 tempest-VolumesCloneTest-793414480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-fb5f76bc-818d-45dc-b1d1-a4186868c60a" returned: 0 in 0.243s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:34:19 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b22ca6f8-d3b0-4598-a2a2-b4e5aa12ee02 tempest-VolumesCloneTest-793414480 None] Lock "cinder-quobyte-fb5f76bc-818d-45dc-b1d1-a4186868c60a" released by "delete_volume" :: held 0.635s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:34:19 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-b22ca6f8-d3b0-4598-a2a2-b4e5aa12ee02 tempest-VolumesCloneTest-793414480 None] Created reservations ['9c093a3e-27af-43d7-8249-a2558f189150', '05f4d23f-3249-4d02-b9a8-0a5642aa2ad8', 'be177c7f-51ba-4b6b-a73f-65e3517dc483', '0f9a4d1c-dc85-44b3-8b6e-780fb27f5e98'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:34:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b22ca6f8-d3b0-4598-a2a2-b4e5aa12ee02 tempest-VolumesCloneTest-793414480 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:34:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b22ca6f8-d3b0-4598-a2a2-b4e5aa12ee02 tempest-VolumesCloneTest-793414480 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:34:19 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-b22ca6f8-d3b0-4598-a2a2-b4e5aa12ee02 tempest-VolumesCloneTest-793414480 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:34:19 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-b22ca6f8-d3b0-4598-a2a2-b4e5aa12ee02 tempest-VolumesCloneTest-793414480 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:34:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b22ca6f8-d3b0-4598-a2a2-b4e5aa12ee02 tempest-VolumesCloneTest-793414480 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:34:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b22ca6f8-d3b0-4598-a2a2-b4e5aa12ee02 tempest-VolumesCloneTest-793414480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:34:19 devstack sudo[103658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:34:19 devstack sudo[103658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:34:19 devstack sudo[103658]: pam_unix(sudo:session): session closed for user root Nov 06 15:34:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b22ca6f8-d3b0-4598-a2a2-b4e5aa12ee02 tempest-VolumesCloneTest-793414480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.246s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:34:19 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-b22ca6f8-d3b0-4598-a2a2-b4e5aa12ee02 tempest-VolumesCloneTest-793414480 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:34:19 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-b22ca6f8-d3b0-4598-a2a2-b4e5aa12ee02 tempest-VolumesCloneTest-793414480 None] Deleted volume successfully. Nov 06 15:34:19 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b22ca6f8-d3b0-4598-a2a2-b4e5aa12ee02 tempest-VolumesCloneTest-793414480 None] Lock "cinder-fb5f76bc-818d-45dc-b1d1-a4186868c60a-delete_volume" released by "delete_volume" :: held 1.072s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:34:19 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a3b16d28-b542-4dd2-84bb-94eee0e1efc8 tempest-VolumesCloneTest-793414480 None] Acquiring lock "cinder-bfd36843-2f31-4f80-ab67-badef1dca3de-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:34:19 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a3b16d28-b542-4dd2-84bb-94eee0e1efc8 tempest-VolumesCloneTest-793414480 None] Lock "cinder-bfd36843-2f31-4f80-ab67-badef1dca3de-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:34:20 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a3b16d28-b542-4dd2-84bb-94eee0e1efc8 tempest-VolumesCloneTest-793414480 None] Acquiring lock "cinder-quobyte-bfd36843-2f31-4f80-ab67-badef1dca3de" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:34:20 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a3b16d28-b542-4dd2-84bb-94eee0e1efc8 tempest-VolumesCloneTest-793414480 None] Lock "cinder-quobyte-bfd36843-2f31-4f80-ab67-badef1dca3de" acquired by "delete_volume" :: waited 0.016s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:34:20 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[5812a85a-8514-477b-ad12-c091efb442c2]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:34:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a3b16d28-b542-4dd2-84bb-94eee0e1efc8 tempest-VolumesCloneTest-793414480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-bfd36843-2f31-4f80-ab67-badef1dca3de {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:34:20 devstack sudo[103661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-bfd36843-2f31-4f80-ab67-badef1dca3de Nov 06 15:34:20 devstack sudo[103661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:34:20 devstack sudo[103661]: pam_unix(sudo:session): session closed for user root Nov 06 15:34:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a3b16d28-b542-4dd2-84bb-94eee0e1efc8 tempest-VolumesCloneTest-793414480 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-bfd36843-2f31-4f80-ab67-badef1dca3de" returned: 0 in 0.345s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:34:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a3b16d28-b542-4dd2-84bb-94eee0e1efc8 tempest-VolumesCloneTest-793414480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-bfd36843-2f31-4f80-ab67-badef1dca3de {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:34:20 devstack sudo[103666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-bfd36843-2f31-4f80-ab67-badef1dca3de Nov 06 15:34:20 devstack sudo[103666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:34:20 devstack sudo[103666]: pam_unix(sudo:session): session closed for user root Nov 06 15:34:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a3b16d28-b542-4dd2-84bb-94eee0e1efc8 tempest-VolumesCloneTest-793414480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-bfd36843-2f31-4f80-ab67-badef1dca3de" returned: 0 in 0.244s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:34:20 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a3b16d28-b542-4dd2-84bb-94eee0e1efc8 tempest-VolumesCloneTest-793414480 None] Lock "cinder-quobyte-bfd36843-2f31-4f80-ab67-badef1dca3de" released by "delete_volume" :: held 0.645s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:34:20 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-a3b16d28-b542-4dd2-84bb-94eee0e1efc8 tempest-VolumesCloneTest-793414480 None] Created reservations ['e804aa27-3cca-4860-b2a7-f1ad66db280b', '18d586ab-2e53-466d-95ca-c3b6c48f88f5', '22d58b22-42fe-45e8-9fa7-61337736bd9f', '0f53ec46-1ce6-4868-80a9-452299778286'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:34:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a3b16d28-b542-4dd2-84bb-94eee0e1efc8 tempest-VolumesCloneTest-793414480 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:34:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a3b16d28-b542-4dd2-84bb-94eee0e1efc8 tempest-VolumesCloneTest-793414480 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:34:20 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-a3b16d28-b542-4dd2-84bb-94eee0e1efc8 tempest-VolumesCloneTest-793414480 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:34:20 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-a3b16d28-b542-4dd2-84bb-94eee0e1efc8 tempest-VolumesCloneTest-793414480 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:34:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a3b16d28-b542-4dd2-84bb-94eee0e1efc8 tempest-VolumesCloneTest-793414480 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:34:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a3b16d28-b542-4dd2-84bb-94eee0e1efc8 tempest-VolumesCloneTest-793414480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:34:20 devstack sudo[103669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:34:20 devstack sudo[103669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:34:21 devstack sudo[103669]: pam_unix(sudo:session): session closed for user root Nov 06 15:34:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a3b16d28-b542-4dd2-84bb-94eee0e1efc8 tempest-VolumesCloneTest-793414480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.240s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:34:21 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-a3b16d28-b542-4dd2-84bb-94eee0e1efc8 tempest-VolumesCloneTest-793414480 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:34:21 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-a3b16d28-b542-4dd2-84bb-94eee0e1efc8 tempest-VolumesCloneTest-793414480 None] Deleted volume successfully. Nov 06 15:34:21 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a3b16d28-b542-4dd2-84bb-94eee0e1efc8 tempest-VolumesCloneTest-793414480 None] Lock "cinder-bfd36843-2f31-4f80-ab67-badef1dca3de-delete_volume" released by "delete_volume" :: held 1.069s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:34:24 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdd558bc-916f-4e14-9320-46a3db86f926 tempest-VolumesExtendTest-1647343130 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:34:24 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-bdd558bc-916f-4e14-9320-46a3db86f926 tempest-VolumesExtendTest-1647343130 None] Flow 'volume_create_manager' (0e87b785-3cb6-46c8-9a18-7bb63bc760b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:34:24 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-bdd558bc-916f-4e14-9320-46a3db86f926 tempest-VolumesExtendTest-1647343130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e031490-a87a-46a7-834b-9c3d42367c1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:34:24 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-bdd558bc-916f-4e14-9320-46a3db86f926 tempest-VolumesExtendTest-1647343130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e031490-a87a-46a7-834b-9c3d42367c1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:34:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-941278482',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=501e7bd1-56c7-4a71-8840-7ce16cc91e39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf8bb5d879e242d2ad8a34b743786649',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:34:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:34:25Z,use_quota=True,user_id='71a380bf9f7a488fb63f4b7c6018d0a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:34:24 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-bdd558bc-916f-4e14-9320-46a3db86f926 tempest-VolumesExtendTest-1647343130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7343e2d-4871-4662-a2ab-b9ae873c343c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:34:24 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-bdd558bc-916f-4e14-9320-46a3db86f926 tempest-VolumesExtendTest-1647343130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7343e2d-4871-4662-a2ab-b9ae873c343c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:34:24 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-bdd558bc-916f-4e14-9320-46a3db86f926 tempest-VolumesExtendTest-1647343130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cc4450f-d2ba-4df5-8f6e-4eb52318d242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:34:24 devstack cinder-volume[87132]: DEBUG cinder.image.glance [None req-bdd558bc-916f-4e14-9320-46a3db86f926 tempest-VolumesExtendTest-1647343130 None] Creating Keystone auth plugin from conf {{(pid=87132) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 06 15:34:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-bdd558bc-916f-4e14-9320-46a3db86f926 tempest-VolumesExtendTest-1647343130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cc4450f-d2ba-4df5-8f6e-4eb52318d242) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '501e7bd1-56c7-4a71-8840-7ce16cc91e39', 'volume_name': 'volume-501e7bd1-56c7-4a71-8840-7ce16cc91e39', 'volume_size': 1, 'image_id': '3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c02e84193ee841ccb304f909f5951fd0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83', 'created_at': datetime.datetime(2026, 11, 6, 14, 12, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 14, 12, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:34:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-bdd558bc-916f-4e14-9320-46a3db86f926 tempest-VolumesExtendTest-1647343130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55bda0c3-f2b8-4f5c-8725-91026489319c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:34:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-bdd558bc-916f-4e14-9320-46a3db86f926 tempest-VolumesExtendTest-1647343130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55bda0c3-f2b8-4f5c-8725-91026489319c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:34:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-bdd558bc-916f-4e14-9320-46a3db86f926 tempest-VolumesExtendTest-1647343130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d90dc017-767b-47f9-943d-b6bd48ea74e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:34:25 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-bdd558bc-916f-4e14-9320-46a3db86f926 tempest-VolumesExtendTest-1647343130 None] Volume 501e7bd1-56c7-4a71-8840-7ce16cc91e39: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-501e7bd1-56c7-4a71-8840-7ce16cc91e39', 'volume_size': 1, 'image_id': '3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c02e84193ee841ccb304f909f5951fd0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83', 'created_at': datetime.datetime(2026, 11, 6, 14, 12, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 14, 12, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 06 15:34:25 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdd558bc-916f-4e14-9320-46a3db86f926 tempest-VolumesExtendTest-1647343130 None] Trying to clone 501e7bd1-56c7-4a71-8840-7ce16cc91e39 from image 3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83 at location (None, [{'url': 'file:///opt/stack/data/glance/images/3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83', 'metadata': {}}]). {{(pid=87132) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 06 15:34:25 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-bdd558bc-916f-4e14-9320-46a3db86f926 tempest-VolumesExtendTest-1647343130 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83_cn4ai0txdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87132) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 06 15:34:25 devstack cinder-volume[87132]: INFO cinder.image.image_utils [None req-bdd558bc-916f-4e14-9320-46a3db86f926 tempest-VolumesExtendTest-1647343130 None] Image download 20.69 MB at 20.69 MB/s Nov 06 15:34:25 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a5eb299-fe39-4980-8f4e-a47638a4abd4]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:34:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bdd558bc-916f-4e14-9320-46a3db86f926 tempest-VolumesExtendTest-1647343130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83_cn4ai0txdevstack@QuobyteHD {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:34:25 devstack sudo[103673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83_cn4ai0txdevstack@QuobyteHD Nov 06 15:34:25 devstack sudo[103673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:34:25 devstack sudo[103673]: pam_unix(sudo:session): session closed for user root Nov 06 15:34:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bdd558bc-916f-4e14-9320-46a3db86f926 tempest-VolumesExtendTest-1647343130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83_cn4ai0txdevstack@QuobyteHD" returned: 0 in 0.320s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:34:25 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-bdd558bc-916f-4e14-9320-46a3db86f926 tempest-VolumesExtendTest-1647343130 None] Temporary image 3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83 is fetched for user 71a380bf9f7a488fb63f4b7c6018d0a7. {{(pid=87132) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 06 15:34:25 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe52b4e4-2df7-4ef9-828f-66b31c8e9e26]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:34:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bdd558bc-916f-4e14-9320-46a3db86f926 tempest-VolumesExtendTest-1647343130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83_cn4ai0txdevstack@QuobyteHD {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:34:25 devstack sudo[103679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83_cn4ai0txdevstack@QuobyteHD Nov 06 15:34:25 devstack sudo[103679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:34:26 devstack sudo[103679]: pam_unix(sudo:session): session closed for user root Nov 06 15:34:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bdd558bc-916f-4e14-9320-46a3db86f926 tempest-VolumesExtendTest-1647343130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83_cn4ai0txdevstack@QuobyteHD" returned: 0 in 0.316s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:34:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-bdd558bc-916f-4e14-9320-46a3db86f926 tempest-VolumesExtendTest-1647343130 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:34:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-bdd558bc-916f-4e14-9320-46a3db86f926 tempest-VolumesExtendTest-1647343130 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:34:26 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-bdd558bc-916f-4e14-9320-46a3db86f926 tempest-VolumesExtendTest-1647343130 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:34:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-941278482',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=501e7bd1-56c7-4a71-8840-7ce16cc91e39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf8bb5d879e242d2ad8a34b743786649',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:34:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:34:25Z,use_quota=True,user_id='71a380bf9f7a488fb63f4b7c6018d0a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:34:26 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-bdd558bc-916f-4e14-9320-46a3db86f926 tempest-VolumesExtendTest-1647343130 None] Creating volume 501e7bd1-56c7-4a71-8840-7ce16cc91e39 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:34:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-bdd558bc-916f-4e14-9320-46a3db86f926 tempest-VolumesExtendTest-1647343130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:34:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-bdd558bc-916f-4e14-9320-46a3db86f926 tempest-VolumesExtendTest-1647343130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:34:26 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-bdd558bc-916f-4e14-9320-46a3db86f926 tempest-VolumesExtendTest-1647343130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:34:26 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-bdd558bc-916f-4e14-9320-46a3db86f926 tempest-VolumesExtendTest-1647343130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:34:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-bdd558bc-916f-4e14-9320-46a3db86f926 tempest-VolumesExtendTest-1647343130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:34:26 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-bdd558bc-916f-4e14-9320-46a3db86f926 tempest-VolumesExtendTest-1647343130 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:34:26 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-bdd558bc-916f-4e14-9320-46a3db86f926 tempest-VolumesExtendTest-1647343130 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:34:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bdd558bc-916f-4e14-9320-46a3db86f926 tempest-VolumesExtendTest-1647343130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-501e7bd1-56c7-4a71-8840-7ce16cc91e39 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:34:26 devstack sudo[103684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-501e7bd1-56c7-4a71-8840-7ce16cc91e39 1073741824 Nov 06 15:34:26 devstack sudo[103684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:34:26 devstack sudo[103684]: pam_unix(sudo:session): session closed for user root Nov 06 15:34:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bdd558bc-916f-4e14-9320-46a3db86f926 tempest-VolumesExtendTest-1647343130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-501e7bd1-56c7-4a71-8840-7ce16cc91e39 1073741824" returned: 0 in 0.400s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:34:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bdd558bc-916f-4e14-9320-46a3db86f926 tempest-VolumesExtendTest-1647343130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-501e7bd1-56c7-4a71-8840-7ce16cc91e39 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:34:26 devstack sudo[103689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-501e7bd1-56c7-4a71-8840-7ce16cc91e39 Nov 06 15:34:26 devstack sudo[103689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:34:26 devstack sudo[103689]: pam_unix(sudo:session): session closed for user root Nov 06 15:34:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bdd558bc-916f-4e14-9320-46a3db86f926 tempest-VolumesExtendTest-1647343130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-501e7bd1-56c7-4a71-8840-7ce16cc91e39" returned: 0 in 0.241s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:34:26 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-bdd558bc-916f-4e14-9320-46a3db86f926 tempest-VolumesExtendTest-1647343130 None] <== create_volume: return (682ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:34:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-bdd558bc-916f-4e14-9320-46a3db86f926 tempest-VolumesExtendTest-1647343130 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.685s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:34:26 devstack cinder-volume[87132]: DEBUG cinder.volume.volume_utils [None req-bdd558bc-916f-4e14-9320-46a3db86f926 tempest-VolumesExtendTest-1647343130 None] Attempting download of 3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83 ((None, [{'url': 'file:///opt/stack/data/glance/images/3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83', 'metadata': {}}])) to volume 501e7bd1-56c7-4a71-8840-7ce16cc91e39. {{(pid=87132) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 06 15:34:26 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[23d304ca-9a5b-4e81-9f81-09551d420982]: (4, 'raw') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:34:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bdd558bc-916f-4e14-9320-46a3db86f926 tempest-VolumesExtendTest-1647343130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83_oa1gbphu {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:34:27 devstack sudo[103692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83_oa1gbphu Nov 06 15:34:27 devstack sudo[103692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:34:27 devstack sudo[103692]: pam_unix(sudo:session): session closed for user root Nov 06 15:34:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bdd558bc-916f-4e14-9320-46a3db86f926 tempest-VolumesExtendTest-1647343130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83_oa1gbphu" returned: 0 in 0.319s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:34:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bdd558bc-916f-4e14-9320-46a3db86f926 tempest-VolumesExtendTest-1647343130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83_oa1gbphu {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:34:27 devstack sudo[103696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83_oa1gbphu Nov 06 15:34:27 devstack sudo[103696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:34:27 devstack sudo[103696]: pam_unix(sudo:session): session closed for user root Nov 06 15:34:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bdd558bc-916f-4e14-9320-46a3db86f926 tempest-VolumesExtendTest-1647343130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83_oa1gbphu" returned: 1 in 0.310s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:34:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bdd558bc-916f-4e14-9320-46a3db86f926 tempest-VolumesExtendTest-1647343130 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83_oa1gbphu' failed. Not Retrying. {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 15:34:27 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9151083-735a-4231-8686-0b97409b98af]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:34:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bdd558bc-916f-4e14-9320-46a3db86f926 tempest-VolumesExtendTest-1647343130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83_cn4ai0txdevstack@QuobyteHD {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:34:27 devstack sudo[103700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83_cn4ai0txdevstack@QuobyteHD Nov 06 15:34:27 devstack sudo[103700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:34:27 devstack sudo[103700]: pam_unix(sudo:session): session closed for user root Nov 06 15:34:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bdd558bc-916f-4e14-9320-46a3db86f926 tempest-VolumesExtendTest-1647343130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83_cn4ai0txdevstack@QuobyteHD" returned: 0 in 0.316s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:34:27 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-bdd558bc-916f-4e14-9320-46a3db86f926 tempest-VolumesExtendTest-1647343130 None] 3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83 was qcow2, converting to qcow2 {{(pid=87132) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 06 15:34:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bdd558bc-916f-4e14-9320-46a3db86f926 tempest-VolumesExtendTest-1647343130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83_cn4ai0txdevstack@QuobyteHD /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-501e7bd1-56c7-4a71-8840-7ce16cc91e39 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:34:27 devstack sudo[103705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83_cn4ai0txdevstack@QuobyteHD /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-501e7bd1-56c7-4a71-8840-7ce16cc91e39 Nov 06 15:34:27 devstack sudo[103705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:34:29 devstack sudo[103705]: pam_unix(sudo:session): session closed for user root Nov 06 15:34:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bdd558bc-916f-4e14-9320-46a3db86f926 tempest-VolumesExtendTest-1647343130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83_cn4ai0txdevstack@QuobyteHD /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-501e7bd1-56c7-4a71-8840-7ce16cc91e39" returned: 0 in 1.692s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:34:29 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-bdd558bc-916f-4e14-9320-46a3db86f926 tempest-VolumesExtendTest-1647343130 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83_cn4ai0txdevstack@QuobyteHD, size 112.00 MB, duration 1.69 sec, destination /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-501e7bd1-56c7-4a71-8840-7ce16cc91e39 {{(pid=87132) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 06 15:34:29 devstack cinder-volume[87132]: INFO cinder.image.image_utils [None req-bdd558bc-916f-4e14-9320-46a3db86f926 tempest-VolumesExtendTest-1647343130 None] Converted 112.00 MB image at 66.15 MB/s Nov 06 15:34:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bdd558bc-916f-4e14-9320-46a3db86f926 tempest-VolumesExtendTest-1647343130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-501e7bd1-56c7-4a71-8840-7ce16cc91e39 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:34:29 devstack sudo[103713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-501e7bd1-56c7-4a71-8840-7ce16cc91e39 1G Nov 06 15:34:29 devstack sudo[103713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:34:29 devstack sudo[103713]: pam_unix(sudo:session): session closed for user root Nov 06 15:34:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bdd558bc-916f-4e14-9320-46a3db86f926 tempest-VolumesExtendTest-1647343130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-501e7bd1-56c7-4a71-8840-7ce16cc91e39 1G" returned: 0 in 0.303s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:34:29 devstack cinder-volume[87132]: DEBUG cinder.volume.volume_utils [None req-bdd558bc-916f-4e14-9320-46a3db86f926 tempest-VolumesExtendTest-1647343130 None] Downloaded image 3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83 ((None, [{'url': 'file:///opt/stack/data/glance/images/3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83', 'metadata': {}}])) to volume 501e7bd1-56c7-4a71-8840-7ce16cc91e39 successfully. {{(pid=87132) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 06 15:34:29 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-bdd558bc-916f-4e14-9320-46a3db86f926 tempest-VolumesExtendTest-1647343130 None] Temporary image 3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83 for user 71a380bf9f7a488fb63f4b7c6018d0a7 is deleted. {{(pid=87132) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 06 15:34:29 devstack cinder-volume[87132]: DEBUG cinder.volume.volume_utils [None req-bdd558bc-916f-4e14-9320-46a3db86f926 tempest-VolumesExtendTest-1647343130 None] Marking volume 501e7bd1-56c7-4a71-8840-7ce16cc91e39 as bootable. {{(pid=87132) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 06 15:34:29 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdd558bc-916f-4e14-9320-46a3db86f926 tempest-VolumesExtendTest-1647343130 None] Copying metadata from image 3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83 to 501e7bd1-56c7-4a71-8840-7ce16cc91e39. {{(pid=87132) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 06 15:34:29 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdd558bc-916f-4e14-9320-46a3db86f926 tempest-VolumesExtendTest-1647343130 None] Creating volume glance metadata for volume 501e7bd1-56c7-4a71-8840-7ce16cc91e39 backed by image 3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87132) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 06 15:34:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-bdd558bc-916f-4e14-9320-46a3db86f926 tempest-VolumesExtendTest-1647343130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d90dc017-767b-47f9-943d-b6bd48ea74e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-501e7bd1-56c7-4a71-8840-7ce16cc91e39', 'volume_size': 1, 'image_id': '3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c02e84193ee841ccb304f909f5951fd0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83', 'created_at': datetime.datetime(2026, 11, 6, 14, 12, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 14, 12, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:34:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-bdd558bc-916f-4e14-9320-46a3db86f926 tempest-VolumesExtendTest-1647343130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b3cca3d-6505-4e60-9167-98328fcfd811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:34:30 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-bdd558bc-916f-4e14-9320-46a3db86f926 tempest-VolumesExtendTest-1647343130 None] Volume volume-501e7bd1-56c7-4a71-8840-7ce16cc91e39 (501e7bd1-56c7-4a71-8840-7ce16cc91e39): created successfully Nov 06 15:34:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-bdd558bc-916f-4e14-9320-46a3db86f926 tempest-VolumesExtendTest-1647343130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b3cca3d-6505-4e60-9167-98328fcfd811) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:34:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-bdd558bc-916f-4e14-9320-46a3db86f926 tempest-VolumesExtendTest-1647343130 None] Flow 'volume_create_manager' (0e87b785-3cb6-46c8-9a18-7bb63bc760b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:34:30 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-bdd558bc-916f-4e14-9320-46a3db86f926 tempest-VolumesExtendTest-1647343130 None] Created volume successfully. Nov 06 15:34:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7a3f6927-51e0-4816-a420-250dc42599bd tempest-VolumesExtendTest-1647343130 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:34:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7a3f6927-51e0-4816-a420-250dc42599bd tempest-VolumesExtendTest-1647343130 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:34:31 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d76dda4-6380-455a-9459-9f3881fe8a34]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:34:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7a3f6927-51e0-4816-a420-250dc42599bd tempest-VolumesExtendTest-1647343130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-501e7bd1-56c7-4a71-8840-7ce16cc91e39 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:34:31 devstack sudo[103719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-501e7bd1-56c7-4a71-8840-7ce16cc91e39 Nov 06 15:34:31 devstack sudo[103719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:34:31 devstack sudo[103719]: pam_unix(sudo:session): session closed for user root Nov 06 15:34:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7a3f6927-51e0-4816-a420-250dc42599bd tempest-VolumesExtendTest-1647343130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-501e7bd1-56c7-4a71-8840-7ce16cc91e39" returned: 0 in 0.350s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:34:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7a3f6927-51e0-4816-a420-250dc42599bd tempest-VolumesExtendTest-1647343130 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-501e7bd1-56c7-4a71-8840-7ce16cc91e39 2G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:34:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7a3f6927-51e0-4816-a420-250dc42599bd tempest-VolumesExtendTest-1647343130 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-501e7bd1-56c7-4a71-8840-7ce16cc91e39 2G" returned: 0 in 0.087s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:34:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7a3f6927-51e0-4816-a420-250dc42599bd tempest-VolumesExtendTest-1647343130 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.460s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:34:31 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-7a3f6927-51e0-4816-a420-250dc42599bd tempest-VolumesExtendTest-1647343130 None] Extend volume completed successfully. Nov 06 15:34:32 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-fde771e7-c19b-49d3-83db-d638b870852e tempest-VolumesExtendTest-1647343130 None] Acquiring lock "cinder-501e7bd1-56c7-4a71-8840-7ce16cc91e39-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:34:32 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-fde771e7-c19b-49d3-83db-d638b870852e tempest-VolumesExtendTest-1647343130 None] Lock "cinder-501e7bd1-56c7-4a71-8840-7ce16cc91e39-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:34:32 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-fde771e7-c19b-49d3-83db-d638b870852e tempest-VolumesExtendTest-1647343130 None] Acquiring lock "cinder-quobyte-501e7bd1-56c7-4a71-8840-7ce16cc91e39" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:34:32 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-fde771e7-c19b-49d3-83db-d638b870852e tempest-VolumesExtendTest-1647343130 None] Lock "cinder-quobyte-501e7bd1-56c7-4a71-8840-7ce16cc91e39" acquired by "delete_volume" :: waited 0.015s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:34:32 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[14079a76-8949-4130-835d-71ec9ccbcf4c]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:34:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-fde771e7-c19b-49d3-83db-d638b870852e tempest-VolumesExtendTest-1647343130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-501e7bd1-56c7-4a71-8840-7ce16cc91e39 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:34:32 devstack sudo[103727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-501e7bd1-56c7-4a71-8840-7ce16cc91e39 Nov 06 15:34:32 devstack sudo[103727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:34:32 devstack sudo[103727]: pam_unix(sudo:session): session closed for user root Nov 06 15:34:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-fde771e7-c19b-49d3-83db-d638b870852e tempest-VolumesExtendTest-1647343130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-501e7bd1-56c7-4a71-8840-7ce16cc91e39" returned: 0 in 0.354s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:34:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-fde771e7-c19b-49d3-83db-d638b870852e tempest-VolumesExtendTest-1647343130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-501e7bd1-56c7-4a71-8840-7ce16cc91e39 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:34:32 devstack sudo[103732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-501e7bd1-56c7-4a71-8840-7ce16cc91e39 Nov 06 15:34:32 devstack sudo[103732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:34:33 devstack sudo[103732]: pam_unix(sudo:session): session closed for user root Nov 06 15:34:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-fde771e7-c19b-49d3-83db-d638b870852e tempest-VolumesExtendTest-1647343130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-501e7bd1-56c7-4a71-8840-7ce16cc91e39" returned: 0 in 0.248s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:34:33 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-fde771e7-c19b-49d3-83db-d638b870852e tempest-VolumesExtendTest-1647343130 None] Lock "cinder-quobyte-501e7bd1-56c7-4a71-8840-7ce16cc91e39" released by "delete_volume" :: held 0.638s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:34:33 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-fde771e7-c19b-49d3-83db-d638b870852e tempest-VolumesExtendTest-1647343130 None] Created reservations ['2b2157ac-2c8b-4ea4-b21e-f5c91f0601de', '91f46adb-3a7c-45be-b968-1fb9df4b9c6a', 'dc6f49d3-b3f0-4a9b-a00b-e0ba8253833e', '6381f884-8175-49e5-bcc0-142cc4c97015'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:34:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-fde771e7-c19b-49d3-83db-d638b870852e tempest-VolumesExtendTest-1647343130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:34:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-fde771e7-c19b-49d3-83db-d638b870852e tempest-VolumesExtendTest-1647343130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:34:33 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-fde771e7-c19b-49d3-83db-d638b870852e tempest-VolumesExtendTest-1647343130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:34:33 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-fde771e7-c19b-49d3-83db-d638b870852e tempest-VolumesExtendTest-1647343130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:34:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-fde771e7-c19b-49d3-83db-d638b870852e tempest-VolumesExtendTest-1647343130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:34:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-fde771e7-c19b-49d3-83db-d638b870852e tempest-VolumesExtendTest-1647343130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:34:33 devstack sudo[103735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:34:33 devstack sudo[103735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:34:33 devstack sudo[103735]: pam_unix(sudo:session): session closed for user root Nov 06 15:34:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-fde771e7-c19b-49d3-83db-d638b870852e tempest-VolumesExtendTest-1647343130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.241s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:34:33 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-fde771e7-c19b-49d3-83db-d638b870852e tempest-VolumesExtendTest-1647343130 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:34:33 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-fde771e7-c19b-49d3-83db-d638b870852e tempest-VolumesExtendTest-1647343130 None] Deleted volume successfully. Nov 06 15:34:33 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-fde771e7-c19b-49d3-83db-d638b870852e tempest-VolumesExtendTest-1647343130 None] Lock "cinder-501e7bd1-56c7-4a71-8840-7ce16cc91e39-delete_volume" released by "delete_volume" :: held 1.063s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:34:34 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-c684351c-2714-4e84-8edc-aebafa049a72 tempest-VolumesExtendTest-1647343130 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:34:34 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c684351c-2714-4e84-8edc-aebafa049a72 tempest-VolumesExtendTest-1647343130 None] Flow 'volume_create_manager' (a5de8f14-809a-44f2-8a5f-c080934fcbd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:34:34 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c684351c-2714-4e84-8edc-aebafa049a72 tempest-VolumesExtendTest-1647343130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d31b9428-f2c0-4d8c-8ca7-6f4e48e64089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:34:34 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c684351c-2714-4e84-8edc-aebafa049a72 tempest-VolumesExtendTest-1647343130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d31b9428-f2c0-4d8c-8ca7-6f4e48e64089) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:34:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1940278844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be688f90-f068-45a5-8e1f-bccb2b21a7b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf8bb5d879e242d2ad8a34b743786649',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:34:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:34:34Z,use_quota=True,user_id='71a380bf9f7a488fb63f4b7c6018d0a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:34:34 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c684351c-2714-4e84-8edc-aebafa049a72 tempest-VolumesExtendTest-1647343130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (981a7efc-8a4b-4b8a-8bec-46ac2fae0543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:34:34 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c684351c-2714-4e84-8edc-aebafa049a72 tempest-VolumesExtendTest-1647343130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (981a7efc-8a4b-4b8a-8bec-46ac2fae0543) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:34:34 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c684351c-2714-4e84-8edc-aebafa049a72 tempest-VolumesExtendTest-1647343130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (040dbad1-f2b6-4b2a-9712-e751366feb2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:34:34 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c684351c-2714-4e84-8edc-aebafa049a72 tempest-VolumesExtendTest-1647343130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (040dbad1-f2b6-4b2a-9712-e751366feb2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be688f90-f068-45a5-8e1f-bccb2b21a7b1', 'volume_name': 'volume-be688f90-f068-45a5-8e1f-bccb2b21a7b1', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:34:34 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c684351c-2714-4e84-8edc-aebafa049a72 tempest-VolumesExtendTest-1647343130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91d4273d-12bc-4896-b2c7-8829f9a13dd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:34:34 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c684351c-2714-4e84-8edc-aebafa049a72 tempest-VolumesExtendTest-1647343130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91d4273d-12bc-4896-b2c7-8829f9a13dd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:34:34 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c684351c-2714-4e84-8edc-aebafa049a72 tempest-VolumesExtendTest-1647343130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8429cf9-29ef-4bc3-ae52-cc930498cbc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:34:34 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-c684351c-2714-4e84-8edc-aebafa049a72 tempest-VolumesExtendTest-1647343130 None] Volume be688f90-f068-45a5-8e1f-bccb2b21a7b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be688f90-f068-45a5-8e1f-bccb2b21a7b1', 'volume_size': 1} Nov 06 15:34:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c684351c-2714-4e84-8edc-aebafa049a72 tempest-VolumesExtendTest-1647343130 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:34:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c684351c-2714-4e84-8edc-aebafa049a72 tempest-VolumesExtendTest-1647343130 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:34:34 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c684351c-2714-4e84-8edc-aebafa049a72 tempest-VolumesExtendTest-1647343130 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:34:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1940278844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be688f90-f068-45a5-8e1f-bccb2b21a7b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf8bb5d879e242d2ad8a34b743786649',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:34:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:34:34Z,use_quota=True,user_id='71a380bf9f7a488fb63f4b7c6018d0a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:34:34 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-c684351c-2714-4e84-8edc-aebafa049a72 tempest-VolumesExtendTest-1647343130 None] Creating volume be688f90-f068-45a5-8e1f-bccb2b21a7b1 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:34:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c684351c-2714-4e84-8edc-aebafa049a72 tempest-VolumesExtendTest-1647343130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:34:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c684351c-2714-4e84-8edc-aebafa049a72 tempest-VolumesExtendTest-1647343130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:34:34 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c684351c-2714-4e84-8edc-aebafa049a72 tempest-VolumesExtendTest-1647343130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:34:34 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c684351c-2714-4e84-8edc-aebafa049a72 tempest-VolumesExtendTest-1647343130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:34:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c684351c-2714-4e84-8edc-aebafa049a72 tempest-VolumesExtendTest-1647343130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:34:34 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c684351c-2714-4e84-8edc-aebafa049a72 tempest-VolumesExtendTest-1647343130 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:34:34 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-c684351c-2714-4e84-8edc-aebafa049a72 tempest-VolumesExtendTest-1647343130 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:34:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c684351c-2714-4e84-8edc-aebafa049a72 tempest-VolumesExtendTest-1647343130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-be688f90-f068-45a5-8e1f-bccb2b21a7b1 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:34:34 devstack sudo[103738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-be688f90-f068-45a5-8e1f-bccb2b21a7b1 1073741824 Nov 06 15:34:34 devstack sudo[103738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:34:34 devstack sudo[103738]: pam_unix(sudo:session): session closed for user root Nov 06 15:34:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c684351c-2714-4e84-8edc-aebafa049a72 tempest-VolumesExtendTest-1647343130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-be688f90-f068-45a5-8e1f-bccb2b21a7b1 1073741824" returned: 0 in 0.406s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:34:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c684351c-2714-4e84-8edc-aebafa049a72 tempest-VolumesExtendTest-1647343130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-be688f90-f068-45a5-8e1f-bccb2b21a7b1 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:34:34 devstack sudo[103743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-be688f90-f068-45a5-8e1f-bccb2b21a7b1 Nov 06 15:34:34 devstack sudo[103743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:34:34 devstack sudo[103743]: pam_unix(sudo:session): session closed for user root Nov 06 15:34:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c684351c-2714-4e84-8edc-aebafa049a72 tempest-VolumesExtendTest-1647343130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-be688f90-f068-45a5-8e1f-bccb2b21a7b1" returned: 0 in 0.238s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:34:34 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c684351c-2714-4e84-8edc-aebafa049a72 tempest-VolumesExtendTest-1647343130 None] <== create_volume: return (682ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:34:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c684351c-2714-4e84-8edc-aebafa049a72 tempest-VolumesExtendTest-1647343130 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.685s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:34:34 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c684351c-2714-4e84-8edc-aebafa049a72 tempest-VolumesExtendTest-1647343130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8429cf9-29ef-4bc3-ae52-cc930498cbc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be688f90-f068-45a5-8e1f-bccb2b21a7b1', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:34:34 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c684351c-2714-4e84-8edc-aebafa049a72 tempest-VolumesExtendTest-1647343130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6a64ac6-cefb-4096-9532-a9dcb310718c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:34:34 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-c684351c-2714-4e84-8edc-aebafa049a72 tempest-VolumesExtendTest-1647343130 None] Volume volume-be688f90-f068-45a5-8e1f-bccb2b21a7b1 (be688f90-f068-45a5-8e1f-bccb2b21a7b1): created successfully Nov 06 15:34:34 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c684351c-2714-4e84-8edc-aebafa049a72 tempest-VolumesExtendTest-1647343130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6a64ac6-cefb-4096-9532-a9dcb310718c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:34:34 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c684351c-2714-4e84-8edc-aebafa049a72 tempest-VolumesExtendTest-1647343130 None] Flow 'volume_create_manager' (a5de8f14-809a-44f2-8a5f-c080934fcbd0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:34:34 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-c684351c-2714-4e84-8edc-aebafa049a72 tempest-VolumesExtendTest-1647343130 None] Created volume successfully. Nov 06 15:34:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e6f40da9-29c8-4304-9948-95ee5bcf8577 tempest-VolumesExtendTest-1647343130 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:34:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e6f40da9-29c8-4304-9948-95ee5bcf8577 tempest-VolumesExtendTest-1647343130 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:34:35 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-e6f40da9-29c8-4304-9948-95ee5bcf8577 tempest-VolumesExtendTest-1647343130 None] Creating offline snapshot e6b5417b-a7a6-4fa6-b6de-90664333ff40 of volume be688f90-f068-45a5-8e1f-bccb2b21a7b1 {{(pid=87132) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 15:34:35 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[63c24d51-8be1-45cd-a99a-cc40e842a75d]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:34:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e6f40da9-29c8-4304-9948-95ee5bcf8577 tempest-VolumesExtendTest-1647343130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-be688f90-f068-45a5-8e1f-bccb2b21a7b1 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:34:35 devstack sudo[103746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-be688f90-f068-45a5-8e1f-bccb2b21a7b1 Nov 06 15:34:35 devstack sudo[103746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:34:35 devstack sudo[103746]: pam_unix(sudo:session): session closed for user root Nov 06 15:34:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e6f40da9-29c8-4304-9948-95ee5bcf8577 tempest-VolumesExtendTest-1647343130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-be688f90-f068-45a5-8e1f-bccb2b21a7b1" returned: 0 in 0.365s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:34:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e6f40da9-29c8-4304-9948-95ee5bcf8577 tempest-VolumesExtendTest-1647343130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-be688f90-f068-45a5-8e1f-bccb2b21a7b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-be688f90-f068-45a5-8e1f-bccb2b21a7b1.e6b5417b-a7a6-4fa6-b6de-90664333ff40 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:34:35 devstack sudo[103752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-be688f90-f068-45a5-8e1f-bccb2b21a7b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-be688f90-f068-45a5-8e1f-bccb2b21a7b1.e6b5417b-a7a6-4fa6-b6de-90664333ff40 1G Nov 06 15:34:35 devstack sudo[103752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:34:36 devstack sudo[103752]: pam_unix(sudo:session): session closed for user root Nov 06 15:34:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e6f40da9-29c8-4304-9948-95ee5bcf8577 tempest-VolumesExtendTest-1647343130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-be688f90-f068-45a5-8e1f-bccb2b21a7b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-be688f90-f068-45a5-8e1f-bccb2b21a7b1.e6b5417b-a7a6-4fa6-b6de-90664333ff40 1G" returned: 0 in 0.406s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:34:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e6f40da9-29c8-4304-9948-95ee5bcf8577 tempest-VolumesExtendTest-1647343130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be688f90-f068-45a5-8e1f-bccb2b21a7b1 -F qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-be688f90-f068-45a5-8e1f-bccb2b21a7b1.e6b5417b-a7a6-4fa6-b6de-90664333ff40 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:34:36 devstack sudo[103758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be688f90-f068-45a5-8e1f-bccb2b21a7b1 -F qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-be688f90-f068-45a5-8e1f-bccb2b21a7b1.e6b5417b-a7a6-4fa6-b6de-90664333ff40 Nov 06 15:34:36 devstack sudo[103758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:34:36 devstack sudo[103758]: pam_unix(sudo:session): session closed for user root Nov 06 15:34:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e6f40da9-29c8-4304-9948-95ee5bcf8577 tempest-VolumesExtendTest-1647343130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be688f90-f068-45a5-8e1f-bccb2b21a7b1 -F qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-be688f90-f068-45a5-8e1f-bccb2b21a7b1.e6b5417b-a7a6-4fa6-b6de-90664333ff40" returned: 0 in 0.275s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:34:36 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-e6f40da9-29c8-4304-9948-95ee5bcf8577 tempest-VolumesExtendTest-1647343130 None] /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-be688f90-f068-45a5-8e1f-bccb2b21a7b1.e6b5417b-a7a6-4fa6-b6de-90664333ff40 is being set with open permissions: ugo+rw Nov 06 15:34:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e6f40da9-29c8-4304-9948-95ee5bcf8577 tempest-VolumesExtendTest-1647343130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-be688f90-f068-45a5-8e1f-bccb2b21a7b1.e6b5417b-a7a6-4fa6-b6de-90664333ff40 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:34:36 devstack sudo[103763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-be688f90-f068-45a5-8e1f-bccb2b21a7b1.e6b5417b-a7a6-4fa6-b6de-90664333ff40 Nov 06 15:34:36 devstack sudo[103763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:34:36 devstack sudo[103763]: pam_unix(sudo:session): session closed for user root Nov 06 15:34:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e6f40da9-29c8-4304-9948-95ee5bcf8577 tempest-VolumesExtendTest-1647343130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-be688f90-f068-45a5-8e1f-bccb2b21a7b1.e6b5417b-a7a6-4fa6-b6de-90664333ff40" returned: 0 in 0.240s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:34:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e6f40da9-29c8-4304-9948-95ee5bcf8577 tempest-VolumesExtendTest-1647343130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-be688f90-f068-45a5-8e1f-bccb2b21a7b1.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:34:36 devstack sudo[103766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-be688f90-f068-45a5-8e1f-bccb2b21a7b1.info Nov 06 15:34:36 devstack sudo[103766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:34:36 devstack sudo[103766]: pam_unix(sudo:session): session closed for user root Nov 06 15:34:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e6f40da9-29c8-4304-9948-95ee5bcf8577 tempest-VolumesExtendTest-1647343130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-be688f90-f068-45a5-8e1f-bccb2b21a7b1.info" returned: 0 in 0.249s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:34:36 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-e6f40da9-29c8-4304-9948-95ee5bcf8577 tempest-VolumesExtendTest-1647343130 None] /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-be688f90-f068-45a5-8e1f-bccb2b21a7b1.info is being set with open permissions: ugo+rw Nov 06 15:34:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e6f40da9-29c8-4304-9948-95ee5bcf8577 tempest-VolumesExtendTest-1647343130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-be688f90-f068-45a5-8e1f-bccb2b21a7b1.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:34:36 devstack sudo[103769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-be688f90-f068-45a5-8e1f-bccb2b21a7b1.info Nov 06 15:34:36 devstack sudo[103769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:34:37 devstack sudo[103769]: pam_unix(sudo:session): session closed for user root Nov 06 15:34:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e6f40da9-29c8-4304-9948-95ee5bcf8577 tempest-VolumesExtendTest-1647343130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-be688f90-f068-45a5-8e1f-bccb2b21a7b1.info" returned: 0 in 0.239s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:34:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e6f40da9-29c8-4304-9948-95ee5bcf8577 tempest-VolumesExtendTest-1647343130 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.855s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:34:37 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-e6f40da9-29c8-4304-9948-95ee5bcf8577 tempest-VolumesExtendTest-1647343130 None] Create snapshot completed successfully Nov 06 15:34:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f3b6cf19-a1cc-4cf2-b576-5f43882ba414 tempest-VolumesExtendTest-1647343130 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:34:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f3b6cf19-a1cc-4cf2-b576-5f43882ba414 tempest-VolumesExtendTest-1647343130 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:34:37 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9e57b14-0076-4c0d-a1f0-abb28f95097f]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:34:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f3b6cf19-a1cc-4cf2-b576-5f43882ba414 tempest-VolumesExtendTest-1647343130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-be688f90-f068-45a5-8e1f-bccb2b21a7b1 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:34:37 devstack sudo[103772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-be688f90-f068-45a5-8e1f-bccb2b21a7b1 Nov 06 15:34:37 devstack sudo[103772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:34:37 devstack sudo[103772]: pam_unix(sudo:session): session closed for user root Nov 06 15:34:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f3b6cf19-a1cc-4cf2-b576-5f43882ba414 tempest-VolumesExtendTest-1647343130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-be688f90-f068-45a5-8e1f-bccb2b21a7b1" returned: 0 in 0.359s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:34:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f3b6cf19-a1cc-4cf2-b576-5f43882ba414 tempest-VolumesExtendTest-1647343130 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-be688f90-f068-45a5-8e1f-bccb2b21a7b1.e6b5417b-a7a6-4fa6-b6de-90664333ff40 2G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:34:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f3b6cf19-a1cc-4cf2-b576-5f43882ba414 tempest-VolumesExtendTest-1647343130 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-be688f90-f068-45a5-8e1f-bccb2b21a7b1.e6b5417b-a7a6-4fa6-b6de-90664333ff40 2G" returned: 0 in 0.114s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:34:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f3b6cf19-a1cc-4cf2-b576-5f43882ba414 tempest-VolumesExtendTest-1647343130 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.508s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:34:37 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-f3b6cf19-a1cc-4cf2-b576-5f43882ba414 tempest-VolumesExtendTest-1647343130 None] Extend volume completed successfully. Nov 06 15:34:38 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-9a273f4d-edb3-4c15-a916-aa44c67c7319 tempest-VolumesExtendTest-1647343130 None] Acquiring lock "cinder-e6b5417b-a7a6-4fa6-b6de-90664333ff40-delete_snapshot" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:34:38 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-9a273f4d-edb3-4c15-a916-aa44c67c7319 tempest-VolumesExtendTest-1647343130 None] Lock "cinder-e6b5417b-a7a6-4fa6-b6de-90664333ff40-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:34:38 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-9a273f4d-edb3-4c15-a916-aa44c67c7319 tempest-VolumesExtendTest-1647343130 None] Acquiring lock "cinder-quobyte-be688f90-f068-45a5-8e1f-bccb2b21a7b1" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:34:38 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-9a273f4d-edb3-4c15-a916-aa44c67c7319 tempest-VolumesExtendTest-1647343130 None] Lock "cinder-quobyte-be688f90-f068-45a5-8e1f-bccb2b21a7b1" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:34:38 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-9a273f4d-edb3-4c15-a916-aa44c67c7319 tempest-VolumesExtendTest-1647343130 None] Acquiring lock "cinder-quobyte-e6b5417b-a7a6-4fa6-b6de-90664333ff40" by "_delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:34:38 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-9a273f4d-edb3-4c15-a916-aa44c67c7319 tempest-VolumesExtendTest-1647343130 None] Lock "cinder-quobyte-e6b5417b-a7a6-4fa6-b6de-90664333ff40" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:34:38 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-9a273f4d-edb3-4c15-a916-aa44c67c7319 tempest-VolumesExtendTest-1647343130 None] Deleting offline snapshot e6b5417b-a7a6-4fa6-b6de-90664333ff40 of volume be688f90-f068-45a5-8e1f-bccb2b21a7b1 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 15:34:38 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-9a273f4d-edb3-4c15-a916-aa44c67c7319 tempest-VolumesExtendTest-1647343130 None] snapshot_file for this snap is: volume-be688f90-f068-45a5-8e1f-bccb2b21a7b1.e6b5417b-a7a6-4fa6-b6de-90664333ff40 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 15:34:38 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5a94e6b-a1f1-4547-b854-11658ef13df8]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:34:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9a273f4d-edb3-4c15-a916-aa44c67c7319 tempest-VolumesExtendTest-1647343130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-be688f90-f068-45a5-8e1f-bccb2b21a7b1.e6b5417b-a7a6-4fa6-b6de-90664333ff40 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:34:38 devstack sudo[103780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-be688f90-f068-45a5-8e1f-bccb2b21a7b1.e6b5417b-a7a6-4fa6-b6de-90664333ff40 Nov 06 15:34:38 devstack sudo[103780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:34:39 devstack sudo[103780]: pam_unix(sudo:session): session closed for user root Nov 06 15:34:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9a273f4d-edb3-4c15-a916-aa44c67c7319 tempest-VolumesExtendTest-1647343130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-be688f90-f068-45a5-8e1f-bccb2b21a7b1.e6b5417b-a7a6-4fa6-b6de-90664333ff40" returned: 0 in 0.350s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:34:39 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-9a273f4d-edb3-4c15-a916-aa44c67c7319 tempest-VolumesExtendTest-1647343130 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-be688f90-f068-45a5-8e1f-bccb2b21a7b1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 15:34:39 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc4ba964-89a5-48fc-96d1-adf0a5818d54]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:34:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9a273f4d-edb3-4c15-a916-aa44c67c7319 tempest-VolumesExtendTest-1647343130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-be688f90-f068-45a5-8e1f-bccb2b21a7b1 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:34:39 devstack sudo[103785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-be688f90-f068-45a5-8e1f-bccb2b21a7b1 Nov 06 15:34:39 devstack sudo[103785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:34:39 devstack sudo[103785]: pam_unix(sudo:session): session closed for user root Nov 06 15:34:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9a273f4d-edb3-4c15-a916-aa44c67c7319 tempest-VolumesExtendTest-1647343130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-be688f90-f068-45a5-8e1f-bccb2b21a7b1" returned: 0 in 0.345s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:34:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9a273f4d-edb3-4c15-a916-aa44c67c7319 tempest-VolumesExtendTest-1647343130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-be688f90-f068-45a5-8e1f-bccb2b21a7b1.e6b5417b-a7a6-4fa6-b6de-90664333ff40 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:34:39 devstack sudo[103790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-be688f90-f068-45a5-8e1f-bccb2b21a7b1.e6b5417b-a7a6-4fa6-b6de-90664333ff40 Nov 06 15:34:39 devstack sudo[103790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:34:39 devstack sudo[103790]: pam_unix(sudo:session): session closed for user root Nov 06 15:34:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9a273f4d-edb3-4c15-a916-aa44c67c7319 tempest-VolumesExtendTest-1647343130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-be688f90-f068-45a5-8e1f-bccb2b21a7b1.e6b5417b-a7a6-4fa6-b6de-90664333ff40" returned: 0 in 0.359s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:34:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9a273f4d-edb3-4c15-a916-aa44c67c7319 tempest-VolumesExtendTest-1647343130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-be688f90-f068-45a5-8e1f-bccb2b21a7b1.e6b5417b-a7a6-4fa6-b6de-90664333ff40 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:34:39 devstack sudo[103796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-be688f90-f068-45a5-8e1f-bccb2b21a7b1.e6b5417b-a7a6-4fa6-b6de-90664333ff40 Nov 06 15:34:39 devstack sudo[103796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:34:40 devstack sudo[103796]: pam_unix(sudo:session): session closed for user root Nov 06 15:34:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9a273f4d-edb3-4c15-a916-aa44c67c7319 tempest-VolumesExtendTest-1647343130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-be688f90-f068-45a5-8e1f-bccb2b21a7b1.e6b5417b-a7a6-4fa6-b6de-90664333ff40" returned: 0 in 0.236s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:34:40 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-9a273f4d-edb3-4c15-a916-aa44c67c7319 tempest-VolumesExtendTest-1647343130 None] Lock "cinder-quobyte-e6b5417b-a7a6-4fa6-b6de-90664333ff40" released by "_delete_snapshot" :: held 1.389s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:34:40 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-9a273f4d-edb3-4c15-a916-aa44c67c7319 tempest-VolumesExtendTest-1647343130 None] Lock "cinder-quobyte-be688f90-f068-45a5-8e1f-bccb2b21a7b1" released by "delete_snapshot" :: held 1.409s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:34:40 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-9a273f4d-edb3-4c15-a916-aa44c67c7319 tempest-VolumesExtendTest-1647343130 None] Created reservations ['ed0c549e-96a5-4115-b255-aec6dec866e2', 'fd33c058-1465-4b91-b1de-c6f9a5e2059e', '6c0f8bc1-6843-445e-8a23-43f5bec0f316', '4b9acf60-93e1-495d-b742-b80b295e3cb0'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:34:40 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-9a273f4d-edb3-4c15-a916-aa44c67c7319 tempest-VolumesExtendTest-1647343130 None] Delete snapshot completed successfully. Nov 06 15:34:40 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-9a273f4d-edb3-4c15-a916-aa44c67c7319 tempest-VolumesExtendTest-1647343130 None] Lock "cinder-e6b5417b-a7a6-4fa6-b6de-90664333ff40-delete_snapshot" released by "delete_snapshot" :: held 1.534s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:34:40 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-7263aada-64e1-4f46-9af9-53bedda4b80f tempest-VolumesExtendTest-1647343130 None] Acquiring lock "cinder-be688f90-f068-45a5-8e1f-bccb2b21a7b1-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:34:40 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-7263aada-64e1-4f46-9af9-53bedda4b80f tempest-VolumesExtendTest-1647343130 None] Lock "cinder-be688f90-f068-45a5-8e1f-bccb2b21a7b1-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:34:40 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-7263aada-64e1-4f46-9af9-53bedda4b80f tempest-VolumesExtendTest-1647343130 None] Acquiring lock "cinder-quobyte-be688f90-f068-45a5-8e1f-bccb2b21a7b1" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:34:40 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-7263aada-64e1-4f46-9af9-53bedda4b80f tempest-VolumesExtendTest-1647343130 None] Lock "cinder-quobyte-be688f90-f068-45a5-8e1f-bccb2b21a7b1" acquired by "delete_volume" :: waited 0.015s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:34:40 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa836baa-decd-45a2-bb13-d2458ac5dd56]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:34:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7263aada-64e1-4f46-9af9-53bedda4b80f tempest-VolumesExtendTest-1647343130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-be688f90-f068-45a5-8e1f-bccb2b21a7b1 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:34:41 devstack sudo[103799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-be688f90-f068-45a5-8e1f-bccb2b21a7b1 Nov 06 15:34:41 devstack sudo[103799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:34:41 devstack sudo[103799]: pam_unix(sudo:session): session closed for user root Nov 06 15:34:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7263aada-64e1-4f46-9af9-53bedda4b80f tempest-VolumesExtendTest-1647343130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-be688f90-f068-45a5-8e1f-bccb2b21a7b1" returned: 0 in 0.343s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:34:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7263aada-64e1-4f46-9af9-53bedda4b80f tempest-VolumesExtendTest-1647343130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-be688f90-f068-45a5-8e1f-bccb2b21a7b1 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:34:41 devstack sudo[103804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-be688f90-f068-45a5-8e1f-bccb2b21a7b1 Nov 06 15:34:41 devstack sudo[103804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:34:41 devstack sudo[103804]: pam_unix(sudo:session): session closed for user root Nov 06 15:34:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7263aada-64e1-4f46-9af9-53bedda4b80f tempest-VolumesExtendTest-1647343130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-be688f90-f068-45a5-8e1f-bccb2b21a7b1" returned: 0 in 0.239s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:34:41 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-7263aada-64e1-4f46-9af9-53bedda4b80f tempest-VolumesExtendTest-1647343130 None] Lock "cinder-quobyte-be688f90-f068-45a5-8e1f-bccb2b21a7b1" released by "delete_volume" :: held 0.641s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:34:41 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-7263aada-64e1-4f46-9af9-53bedda4b80f tempest-VolumesExtendTest-1647343130 None] Created reservations ['0e5bdda3-3bf6-4b62-b3cb-e9d0c4a669c2', 'aa653ee8-1841-43e6-ae73-b20a8cf86a40', 'dcc573c5-8d5a-4f3b-9ee4-1ae42aeb52dc', 'b9776830-a954-4898-b99b-ac54c9f8ee1d'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:34:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7263aada-64e1-4f46-9af9-53bedda4b80f tempest-VolumesExtendTest-1647343130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:34:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7263aada-64e1-4f46-9af9-53bedda4b80f tempest-VolumesExtendTest-1647343130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:34:41 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-7263aada-64e1-4f46-9af9-53bedda4b80f tempest-VolumesExtendTest-1647343130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:34:41 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-7263aada-64e1-4f46-9af9-53bedda4b80f tempest-VolumesExtendTest-1647343130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:34:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7263aada-64e1-4f46-9af9-53bedda4b80f tempest-VolumesExtendTest-1647343130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:34:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7263aada-64e1-4f46-9af9-53bedda4b80f tempest-VolumesExtendTest-1647343130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:34:41 devstack sudo[103807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:34:41 devstack sudo[103807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:34:41 devstack sudo[103807]: pam_unix(sudo:session): session closed for user root Nov 06 15:34:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7263aada-64e1-4f46-9af9-53bedda4b80f tempest-VolumesExtendTest-1647343130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.243s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:34:41 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-7263aada-64e1-4f46-9af9-53bedda4b80f tempest-VolumesExtendTest-1647343130 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:34:41 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-7263aada-64e1-4f46-9af9-53bedda4b80f tempest-VolumesExtendTest-1647343130 None] Deleted volume successfully. Nov 06 15:34:41 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-7263aada-64e1-4f46-9af9-53bedda4b80f tempest-VolumesExtendTest-1647343130 None] Lock "cinder-be688f90-f068-45a5-8e1f-bccb2b21a7b1-delete_volume" released by "delete_volume" :: held 1.063s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:34:45 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-a066972d-c878-4e86-af93-96ab73487176 tempest-VolumesNegativeTest-1042074192 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:34:45 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a066972d-c878-4e86-af93-96ab73487176 tempest-VolumesNegativeTest-1042074192 None] Flow 'volume_create_manager' (20f7dd38-2bcd-451a-bddb-fef926bf8aa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:34:45 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a066972d-c878-4e86-af93-96ab73487176 tempest-VolumesNegativeTest-1042074192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ddfbd09-2aba-4b18-b947-36c6d6ed9a3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:34:45 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a066972d-c878-4e86-af93-96ab73487176 tempest-VolumesNegativeTest-1042074192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ddfbd09-2aba-4b18-b947-36c6d6ed9a3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:34:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1411245036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3afcf56b-2615-498e-bba0-bdb099faef43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7d97dcf744842c19e877a18288a7ace',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:34:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:34:45Z,use_quota=True,user_id='bcf588129dd349588d7a072465a86a6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:34:45 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a066972d-c878-4e86-af93-96ab73487176 tempest-VolumesNegativeTest-1042074192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ceb099bf-8ab7-4389-a611-c87e7bc49689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:34:45 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a066972d-c878-4e86-af93-96ab73487176 tempest-VolumesNegativeTest-1042074192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ceb099bf-8ab7-4389-a611-c87e7bc49689) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:34:45 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a066972d-c878-4e86-af93-96ab73487176 tempest-VolumesNegativeTest-1042074192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (656b1882-8e24-48b2-b609-5ba9838d2a7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:34:45 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a066972d-c878-4e86-af93-96ab73487176 tempest-VolumesNegativeTest-1042074192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (656b1882-8e24-48b2-b609-5ba9838d2a7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3afcf56b-2615-498e-bba0-bdb099faef43', 'volume_name': 'volume-3afcf56b-2615-498e-bba0-bdb099faef43', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:34:45 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a066972d-c878-4e86-af93-96ab73487176 tempest-VolumesNegativeTest-1042074192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4ed056c-cfca-44bc-8609-55108bcdbc22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:34:45 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a066972d-c878-4e86-af93-96ab73487176 tempest-VolumesNegativeTest-1042074192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4ed056c-cfca-44bc-8609-55108bcdbc22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:34:45 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a066972d-c878-4e86-af93-96ab73487176 tempest-VolumesNegativeTest-1042074192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7133b81d-1e4e-43c6-8ceb-ef1e8866baf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:34:45 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-a066972d-c878-4e86-af93-96ab73487176 tempest-VolumesNegativeTest-1042074192 None] Volume 3afcf56b-2615-498e-bba0-bdb099faef43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3afcf56b-2615-498e-bba0-bdb099faef43', 'volume_size': 1} Nov 06 15:34:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a066972d-c878-4e86-af93-96ab73487176 tempest-VolumesNegativeTest-1042074192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:34:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a066972d-c878-4e86-af93-96ab73487176 tempest-VolumesNegativeTest-1042074192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:34:45 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-a066972d-c878-4e86-af93-96ab73487176 tempest-VolumesNegativeTest-1042074192 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:34:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1411245036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3afcf56b-2615-498e-bba0-bdb099faef43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7d97dcf744842c19e877a18288a7ace',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:34:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:34:45Z,use_quota=True,user_id='bcf588129dd349588d7a072465a86a6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:34:45 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-a066972d-c878-4e86-af93-96ab73487176 tempest-VolumesNegativeTest-1042074192 None] Creating volume 3afcf56b-2615-498e-bba0-bdb099faef43 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:34:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a066972d-c878-4e86-af93-96ab73487176 tempest-VolumesNegativeTest-1042074192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:34:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a066972d-c878-4e86-af93-96ab73487176 tempest-VolumesNegativeTest-1042074192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:34:45 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-a066972d-c878-4e86-af93-96ab73487176 tempest-VolumesNegativeTest-1042074192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:34:45 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-a066972d-c878-4e86-af93-96ab73487176 tempest-VolumesNegativeTest-1042074192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:34:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a066972d-c878-4e86-af93-96ab73487176 tempest-VolumesNegativeTest-1042074192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:34:45 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-a066972d-c878-4e86-af93-96ab73487176 tempest-VolumesNegativeTest-1042074192 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:34:45 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-a066972d-c878-4e86-af93-96ab73487176 tempest-VolumesNegativeTest-1042074192 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:34:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a066972d-c878-4e86-af93-96ab73487176 tempest-VolumesNegativeTest-1042074192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-3afcf56b-2615-498e-bba0-bdb099faef43 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:34:45 devstack sudo[103810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-3afcf56b-2615-498e-bba0-bdb099faef43 1073741824 Nov 06 15:34:45 devstack sudo[103810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:34:45 devstack sudo[103810]: pam_unix(sudo:session): session closed for user root Nov 06 15:34:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a066972d-c878-4e86-af93-96ab73487176 tempest-VolumesNegativeTest-1042074192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-3afcf56b-2615-498e-bba0-bdb099faef43 1073741824" returned: 0 in 0.390s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:34:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a066972d-c878-4e86-af93-96ab73487176 tempest-VolumesNegativeTest-1042074192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-3afcf56b-2615-498e-bba0-bdb099faef43 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:34:45 devstack sudo[103816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-3afcf56b-2615-498e-bba0-bdb099faef43 Nov 06 15:34:45 devstack sudo[103816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:34:46 devstack sudo[103816]: pam_unix(sudo:session): session closed for user root Nov 06 15:34:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a066972d-c878-4e86-af93-96ab73487176 tempest-VolumesNegativeTest-1042074192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-3afcf56b-2615-498e-bba0-bdb099faef43" returned: 0 in 0.234s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:34:46 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-a066972d-c878-4e86-af93-96ab73487176 tempest-VolumesNegativeTest-1042074192 None] <== create_volume: return (660ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:34:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a066972d-c878-4e86-af93-96ab73487176 tempest-VolumesNegativeTest-1042074192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.663s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:34:46 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a066972d-c878-4e86-af93-96ab73487176 tempest-VolumesNegativeTest-1042074192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7133b81d-1e4e-43c6-8ceb-ef1e8866baf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3afcf56b-2615-498e-bba0-bdb099faef43', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:34:46 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a066972d-c878-4e86-af93-96ab73487176 tempest-VolumesNegativeTest-1042074192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22107686-be38-468c-8d1a-d66cf6284497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:34:46 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-a066972d-c878-4e86-af93-96ab73487176 tempest-VolumesNegativeTest-1042074192 None] Volume volume-3afcf56b-2615-498e-bba0-bdb099faef43 (3afcf56b-2615-498e-bba0-bdb099faef43): created successfully Nov 06 15:34:46 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a066972d-c878-4e86-af93-96ab73487176 tempest-VolumesNegativeTest-1042074192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22107686-be38-468c-8d1a-d66cf6284497) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:34:46 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a066972d-c878-4e86-af93-96ab73487176 tempest-VolumesNegativeTest-1042074192 None] Flow 'volume_create_manager' (20f7dd38-2bcd-451a-bddb-fef926bf8aa8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:34:46 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-a066972d-c878-4e86-af93-96ab73487176 tempest-VolumesNegativeTest-1042074192 None] Created volume successfully. Nov 06 15:34:54 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:SELECT=75,cinder:INSERT=28,cinder:UPDATE=75,cinder:DELETE=7 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 15:34:54 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:UPDATE=94,cinder:SELECT=60,cinder:DELETE=7,cinder:INSERT=23 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 15:35:01 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-eed9474b-7fbe-435e-8356-17a6c3a71729 tempest-VolumesNegativeTest-1042074192 None] Acquiring lock "cinder-3afcf56b-2615-498e-bba0-bdb099faef43-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:35:01 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-eed9474b-7fbe-435e-8356-17a6c3a71729 tempest-VolumesNegativeTest-1042074192 None] Lock "cinder-3afcf56b-2615-498e-bba0-bdb099faef43-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:35:01 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-eed9474b-7fbe-435e-8356-17a6c3a71729 tempest-VolumesNegativeTest-1042074192 None] Acquiring lock "cinder-quobyte-3afcf56b-2615-498e-bba0-bdb099faef43" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:35:01 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-eed9474b-7fbe-435e-8356-17a6c3a71729 tempest-VolumesNegativeTest-1042074192 None] Lock "cinder-quobyte-3afcf56b-2615-498e-bba0-bdb099faef43" acquired by "delete_volume" :: waited 0.014s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:35:01 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[2014b0b6-6df4-425a-8b21-0ea3d546f47a]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:35:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-eed9474b-7fbe-435e-8356-17a6c3a71729 tempest-VolumesNegativeTest-1042074192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-3afcf56b-2615-498e-bba0-bdb099faef43 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:35:01 devstack sudo[103980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-3afcf56b-2615-498e-bba0-bdb099faef43 Nov 06 15:35:01 devstack sudo[103980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:35:01 devstack sudo[103980]: pam_unix(sudo:session): session closed for user root Nov 06 15:35:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-eed9474b-7fbe-435e-8356-17a6c3a71729 tempest-VolumesNegativeTest-1042074192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-3afcf56b-2615-498e-bba0-bdb099faef43" returned: 0 in 0.356s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:35:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-eed9474b-7fbe-435e-8356-17a6c3a71729 tempest-VolumesNegativeTest-1042074192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-3afcf56b-2615-498e-bba0-bdb099faef43 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:35:01 devstack sudo[103985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-3afcf56b-2615-498e-bba0-bdb099faef43 Nov 06 15:35:01 devstack sudo[103985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:35:01 devstack sudo[103985]: pam_unix(sudo:session): session closed for user root Nov 06 15:35:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-eed9474b-7fbe-435e-8356-17a6c3a71729 tempest-VolumesNegativeTest-1042074192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-3afcf56b-2615-498e-bba0-bdb099faef43" returned: 0 in 0.238s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:35:01 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-eed9474b-7fbe-435e-8356-17a6c3a71729 tempest-VolumesNegativeTest-1042074192 None] Lock "cinder-quobyte-3afcf56b-2615-498e-bba0-bdb099faef43" released by "delete_volume" :: held 0.635s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:35:01 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-eed9474b-7fbe-435e-8356-17a6c3a71729 tempest-VolumesNegativeTest-1042074192 None] Created reservations ['124c18df-ddbf-431d-8019-ce7e33568b85', '4e13d21c-6f34-412e-8028-ee8729603a1a', 'd56508dc-f651-46e9-8d7d-c46b47dbd349', '6e8798a1-dbcb-4226-8a27-d8ed56da31b2'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:35:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-eed9474b-7fbe-435e-8356-17a6c3a71729 tempest-VolumesNegativeTest-1042074192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:35:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-eed9474b-7fbe-435e-8356-17a6c3a71729 tempest-VolumesNegativeTest-1042074192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:35:01 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-eed9474b-7fbe-435e-8356-17a6c3a71729 tempest-VolumesNegativeTest-1042074192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:35:01 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-eed9474b-7fbe-435e-8356-17a6c3a71729 tempest-VolumesNegativeTest-1042074192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:35:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-eed9474b-7fbe-435e-8356-17a6c3a71729 tempest-VolumesNegativeTest-1042074192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:35:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-eed9474b-7fbe-435e-8356-17a6c3a71729 tempest-VolumesNegativeTest-1042074192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:35:02 devstack sudo[103988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:35:02 devstack sudo[103988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:35:02 devstack sudo[103988]: pam_unix(sudo:session): session closed for user root Nov 06 15:35:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-eed9474b-7fbe-435e-8356-17a6c3a71729 tempest-VolumesNegativeTest-1042074192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.235s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:35:02 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-eed9474b-7fbe-435e-8356-17a6c3a71729 tempest-VolumesNegativeTest-1042074192 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:35:02 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-eed9474b-7fbe-435e-8356-17a6c3a71729 tempest-VolumesNegativeTest-1042074192 None] Deleted volume successfully. Nov 06 15:35:02 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-eed9474b-7fbe-435e-8356-17a6c3a71729 tempest-VolumesNegativeTest-1042074192 None] Lock "cinder-3afcf56b-2615-498e-bba0-bdb099faef43-delete_volume" released by "delete_volume" :: held 1.049s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:35:08 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 15:35:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:35:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:35:08 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:35:08 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:35:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:35:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:35:08 devstack sudo[103995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:35:08 devstack sudo[103995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:35:08 devstack sudo[103995]: pam_unix(sudo:session): session closed for user root Nov 06 15:35:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.245s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:35:08 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:35:08 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Running periodic task VolumeManager._thread_info {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 15:35:08 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] thread count: 28 {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 15:35:08 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] thread info: [<_MainThread(MainThread, started 140011251929216)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 06 15:35:11 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:UPDATE=9,cinder:SELECT=3,cinder:INSERT=2 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 15:35:12 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:SELECT=7,cinder:INSERT=2,cinder:UPDATE=7,cinder:DELETE=1 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 15:35:50 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-1acb984f-149a-4de2-a69b-442fe0ee2de3 tempest-TestServerVolumeAttachScenarioOldVersion-900234539 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:35:50 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1acb984f-149a-4de2-a69b-442fe0ee2de3 tempest-TestServerVolumeAttachScenarioOldVersion-900234539 None] Flow 'volume_create_manager' (7756b2ff-6e00-4675-a83e-8f5a8b72d6b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:35:50 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1acb984f-149a-4de2-a69b-442fe0ee2de3 tempest-TestServerVolumeAttachScenarioOldVersion-900234539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47b54351-0e98-4fc1-8ccb-41174d61e172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:35:50 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1acb984f-149a-4de2-a69b-442fe0ee2de3 tempest-TestServerVolumeAttachScenarioOldVersion-900234539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47b54351-0e98-4fc1-8ccb-41174d61e172) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:35:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1264791281',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ef53bda-416f-449d-a43c-19ead106931c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fc6681d18a3494a9f9ba1d55909af3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:35:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:35:51Z,use_quota=True,user_id='3b83a4a5ef464b3c9d67f6bd08d08fcb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:35:50 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1acb984f-149a-4de2-a69b-442fe0ee2de3 tempest-TestServerVolumeAttachScenarioOldVersion-900234539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac1ff83c-6e28-4068-9858-22f888108e82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:35:50 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1acb984f-149a-4de2-a69b-442fe0ee2de3 tempest-TestServerVolumeAttachScenarioOldVersion-900234539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac1ff83c-6e28-4068-9858-22f888108e82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:35:50 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1acb984f-149a-4de2-a69b-442fe0ee2de3 tempest-TestServerVolumeAttachScenarioOldVersion-900234539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ea51868-9e5f-4d85-897f-91846cd0b53f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:35:50 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1acb984f-149a-4de2-a69b-442fe0ee2de3 tempest-TestServerVolumeAttachScenarioOldVersion-900234539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ea51868-9e5f-4d85-897f-91846cd0b53f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ef53bda-416f-449d-a43c-19ead106931c', 'volume_name': 'volume-4ef53bda-416f-449d-a43c-19ead106931c', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:35:50 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1acb984f-149a-4de2-a69b-442fe0ee2de3 tempest-TestServerVolumeAttachScenarioOldVersion-900234539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad0f3593-0951-44bf-8827-83cb655d3c44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:35:50 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1acb984f-149a-4de2-a69b-442fe0ee2de3 tempest-TestServerVolumeAttachScenarioOldVersion-900234539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad0f3593-0951-44bf-8827-83cb655d3c44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:35:50 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1acb984f-149a-4de2-a69b-442fe0ee2de3 tempest-TestServerVolumeAttachScenarioOldVersion-900234539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c034b6e9-1d9b-45c1-b2e0-8e775401c148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:35:50 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-1acb984f-149a-4de2-a69b-442fe0ee2de3 tempest-TestServerVolumeAttachScenarioOldVersion-900234539 None] Volume 4ef53bda-416f-449d-a43c-19ead106931c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ef53bda-416f-449d-a43c-19ead106931c', 'volume_size': 1} Nov 06 15:35:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1acb984f-149a-4de2-a69b-442fe0ee2de3 tempest-TestServerVolumeAttachScenarioOldVersion-900234539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:35:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1acb984f-149a-4de2-a69b-442fe0ee2de3 tempest-TestServerVolumeAttachScenarioOldVersion-900234539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:35:50 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1acb984f-149a-4de2-a69b-442fe0ee2de3 tempest-TestServerVolumeAttachScenarioOldVersion-900234539 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:35:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1264791281',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ef53bda-416f-449d-a43c-19ead106931c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fc6681d18a3494a9f9ba1d55909af3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:35:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:35:51Z,use_quota=True,user_id='3b83a4a5ef464b3c9d67f6bd08d08fcb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:35:50 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-1acb984f-149a-4de2-a69b-442fe0ee2de3 tempest-TestServerVolumeAttachScenarioOldVersion-900234539 None] Creating volume 4ef53bda-416f-449d-a43c-19ead106931c {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:35:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1acb984f-149a-4de2-a69b-442fe0ee2de3 tempest-TestServerVolumeAttachScenarioOldVersion-900234539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:35:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1acb984f-149a-4de2-a69b-442fe0ee2de3 tempest-TestServerVolumeAttachScenarioOldVersion-900234539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:35:50 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1acb984f-149a-4de2-a69b-442fe0ee2de3 tempest-TestServerVolumeAttachScenarioOldVersion-900234539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:35:50 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1acb984f-149a-4de2-a69b-442fe0ee2de3 tempest-TestServerVolumeAttachScenarioOldVersion-900234539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:35:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1acb984f-149a-4de2-a69b-442fe0ee2de3 tempest-TestServerVolumeAttachScenarioOldVersion-900234539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:35:50 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1acb984f-149a-4de2-a69b-442fe0ee2de3 tempest-TestServerVolumeAttachScenarioOldVersion-900234539 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:35:50 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-1acb984f-149a-4de2-a69b-442fe0ee2de3 tempest-TestServerVolumeAttachScenarioOldVersion-900234539 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:35:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1acb984f-149a-4de2-a69b-442fe0ee2de3 tempest-TestServerVolumeAttachScenarioOldVersion-900234539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-4ef53bda-416f-449d-a43c-19ead106931c 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:35:50 devstack sudo[104109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-4ef53bda-416f-449d-a43c-19ead106931c 1073741824 Nov 06 15:35:50 devstack sudo[104109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:35:51 devstack sudo[104109]: pam_unix(sudo:session): session closed for user root Nov 06 15:35:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1acb984f-149a-4de2-a69b-442fe0ee2de3 tempest-TestServerVolumeAttachScenarioOldVersion-900234539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-4ef53bda-416f-449d-a43c-19ead106931c 1073741824" returned: 0 in 0.418s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:35:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1acb984f-149a-4de2-a69b-442fe0ee2de3 tempest-TestServerVolumeAttachScenarioOldVersion-900234539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-4ef53bda-416f-449d-a43c-19ead106931c {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:35:51 devstack sudo[104115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-4ef53bda-416f-449d-a43c-19ead106931c Nov 06 15:35:51 devstack sudo[104115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:35:51 devstack sudo[104115]: pam_unix(sudo:session): session closed for user root Nov 06 15:35:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1acb984f-149a-4de2-a69b-442fe0ee2de3 tempest-TestServerVolumeAttachScenarioOldVersion-900234539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-4ef53bda-416f-449d-a43c-19ead106931c" returned: 0 in 0.247s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:35:51 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1acb984f-149a-4de2-a69b-442fe0ee2de3 tempest-TestServerVolumeAttachScenarioOldVersion-900234539 None] <== create_volume: return (704ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:35:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1acb984f-149a-4de2-a69b-442fe0ee2de3 tempest-TestServerVolumeAttachScenarioOldVersion-900234539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.707s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:35:51 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1acb984f-149a-4de2-a69b-442fe0ee2de3 tempest-TestServerVolumeAttachScenarioOldVersion-900234539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c034b6e9-1d9b-45c1-b2e0-8e775401c148) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ef53bda-416f-449d-a43c-19ead106931c', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:35:51 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1acb984f-149a-4de2-a69b-442fe0ee2de3 tempest-TestServerVolumeAttachScenarioOldVersion-900234539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9038923-1b4c-4171-afef-ea395d406453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:35:51 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-1acb984f-149a-4de2-a69b-442fe0ee2de3 tempest-TestServerVolumeAttachScenarioOldVersion-900234539 None] Volume volume-4ef53bda-416f-449d-a43c-19ead106931c (4ef53bda-416f-449d-a43c-19ead106931c): created successfully Nov 06 15:35:51 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1acb984f-149a-4de2-a69b-442fe0ee2de3 tempest-TestServerVolumeAttachScenarioOldVersion-900234539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9038923-1b4c-4171-afef-ea395d406453) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:35:51 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1acb984f-149a-4de2-a69b-442fe0ee2de3 tempest-TestServerVolumeAttachScenarioOldVersion-900234539 None] Flow 'volume_create_manager' (7756b2ff-6e00-4675-a83e-8f5a8b72d6b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:35:51 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-1acb984f-149a-4de2-a69b-442fe0ee2de3 tempest-TestServerVolumeAttachScenarioOldVersion-900234539 None] Created volume successfully. Nov 06 15:35:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-9e0e2cdc-fc8b-4945-a42c-5060565e6ce9 req-2a44c472-a4b2-4805-ba93-9634302ce635 tempest-TestServerVolumeAttachScenarioOldVersion-900234539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:35:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-9e0e2cdc-fc8b-4945-a42c-5060565e6ce9 req-2a44c472-a4b2-4805-ba93-9634302ce635 tempest-TestServerVolumeAttachScenarioOldVersion-900234539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:35:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-9e0e2cdc-fc8b-4945-a42c-5060565e6ce9 req-2a44c472-a4b2-4805-ba93-9634302ce635 tempest-TestServerVolumeAttachScenarioOldVersion-900234539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:35:52 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-9e0e2cdc-fc8b-4945-a42c-5060565e6ce9 req-2a44c472-a4b2-4805-ba93-9634302ce635 tempest-TestServerVolumeAttachScenarioOldVersion-900234539 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b', 'name': 'volume-4ef53bda-416f-449d-a43c-19ead106931c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5f96dae8-baee-48d5-bf6b-cb00aade5345', 'enforce_multipath': True} {{(pid=87132) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 15:35:52 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-9e0e2cdc-fc8b-4945-a42c-5060565e6ce9 req-2a44c472-a4b2-4805-ba93-9634302ce635 tempest-TestServerVolumeAttachScenarioOldVersion-900234539 None] attachment_update completed successfully. Nov 06 15:35:54 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-9892b351-3dae-4682-a188-cbb37474dafb req-be374723-afff-42ab-b6f6-3f0bedce4d82 tempest-TestServerVolumeAttachScenarioOldVersion-900234539 None] Terminate volume connection completed successfully. Nov 06 15:35:54 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-9892b351-3dae-4682-a188-cbb37474dafb req-be374723-afff-42ab-b6f6-3f0bedce4d82 tempest-TestServerVolumeAttachScenarioOldVersion-900234539 None] Deleting attachment 5f96dae8-baee-48d5-bf6b-cb00aade5345. {{(pid=87132) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 06 15:35:55 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-53a63754-1775-4d3b-851c-14ae5287fc3c tempest-TestServerVolumeAttachScenarioOldVersion-900234539 None] Acquiring lock "cinder-4ef53bda-416f-449d-a43c-19ead106931c-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:35:55 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-53a63754-1775-4d3b-851c-14ae5287fc3c tempest-TestServerVolumeAttachScenarioOldVersion-900234539 None] Lock "cinder-4ef53bda-416f-449d-a43c-19ead106931c-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:35:55 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-53a63754-1775-4d3b-851c-14ae5287fc3c tempest-TestServerVolumeAttachScenarioOldVersion-900234539 None] Acquiring lock "cinder-quobyte-4ef53bda-416f-449d-a43c-19ead106931c" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:35:55 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-53a63754-1775-4d3b-851c-14ae5287fc3c tempest-TestServerVolumeAttachScenarioOldVersion-900234539 None] Lock "cinder-quobyte-4ef53bda-416f-449d-a43c-19ead106931c" acquired by "delete_volume" :: waited 0.015s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:35:55 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2fb7b84-5ed9-4d7b-8d29-56feb2fe5f11]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:35:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-53a63754-1775-4d3b-851c-14ae5287fc3c tempest-TestServerVolumeAttachScenarioOldVersion-900234539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-4ef53bda-416f-449d-a43c-19ead106931c {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:35:55 devstack sudo[104572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-4ef53bda-416f-449d-a43c-19ead106931c Nov 06 15:35:55 devstack sudo[104572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:35:55 devstack sudo[104572]: pam_unix(sudo:session): session closed for user root Nov 06 15:35:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-53a63754-1775-4d3b-851c-14ae5287fc3c tempest-TestServerVolumeAttachScenarioOldVersion-900234539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-4ef53bda-416f-449d-a43c-19ead106931c" returned: 0 in 0.351s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:35:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-53a63754-1775-4d3b-851c-14ae5287fc3c tempest-TestServerVolumeAttachScenarioOldVersion-900234539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-4ef53bda-416f-449d-a43c-19ead106931c {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:35:55 devstack sudo[104579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-4ef53bda-416f-449d-a43c-19ead106931c Nov 06 15:35:55 devstack sudo[104579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:35:56 devstack sudo[104579]: pam_unix(sudo:session): session closed for user root Nov 06 15:35:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-53a63754-1775-4d3b-851c-14ae5287fc3c tempest-TestServerVolumeAttachScenarioOldVersion-900234539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-4ef53bda-416f-449d-a43c-19ead106931c" returned: 0 in 0.238s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:35:56 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-53a63754-1775-4d3b-851c-14ae5287fc3c tempest-TestServerVolumeAttachScenarioOldVersion-900234539 None] Lock "cinder-quobyte-4ef53bda-416f-449d-a43c-19ead106931c" released by "delete_volume" :: held 0.628s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:35:56 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-53a63754-1775-4d3b-851c-14ae5287fc3c tempest-TestServerVolumeAttachScenarioOldVersion-900234539 None] Created reservations ['9cd378be-de10-43e8-a2bb-375027c766ea', '72d0483e-b644-4d92-91b5-8c9383ab13c9', '129fcc82-facd-4923-84f3-0922616cce45', '3f1cce09-5e81-4829-af70-0b54946334ca'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:35:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-53a63754-1775-4d3b-851c-14ae5287fc3c tempest-TestServerVolumeAttachScenarioOldVersion-900234539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:35:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-53a63754-1775-4d3b-851c-14ae5287fc3c tempest-TestServerVolumeAttachScenarioOldVersion-900234539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:35:56 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-53a63754-1775-4d3b-851c-14ae5287fc3c tempest-TestServerVolumeAttachScenarioOldVersion-900234539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:35:56 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-53a63754-1775-4d3b-851c-14ae5287fc3c tempest-TestServerVolumeAttachScenarioOldVersion-900234539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:35:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-53a63754-1775-4d3b-851c-14ae5287fc3c tempest-TestServerVolumeAttachScenarioOldVersion-900234539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:35:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-53a63754-1775-4d3b-851c-14ae5287fc3c tempest-TestServerVolumeAttachScenarioOldVersion-900234539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:35:56 devstack sudo[104582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:35:56 devstack sudo[104582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:35:56 devstack sudo[104582]: pam_unix(sudo:session): session closed for user root Nov 06 15:35:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-53a63754-1775-4d3b-851c-14ae5287fc3c tempest-TestServerVolumeAttachScenarioOldVersion-900234539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.249s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:35:56 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-53a63754-1775-4d3b-851c-14ae5287fc3c tempest-TestServerVolumeAttachScenarioOldVersion-900234539 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:35:56 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-53a63754-1775-4d3b-851c-14ae5287fc3c tempest-TestServerVolumeAttachScenarioOldVersion-900234539 None] Deleted volume successfully. Nov 06 15:35:56 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-53a63754-1775-4d3b-851c-14ae5287fc3c tempest-TestServerVolumeAttachScenarioOldVersion-900234539 None] Lock "cinder-4ef53bda-416f-449d-a43c-19ead106931c-delete_volume" released by "delete_volume" :: held 1.064s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:36:06 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:SELECT=14,cinder:UPDATE=15,cinder:INSERT=3,cinder:DELETE=1 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 15:36:06 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:UPDATE=10,cinder:SELECT=15,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 15:36:08 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 15:36:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:36:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:36:08 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:36:08 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:36:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:36:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:36:08 devstack sudo[104660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:36:08 devstack sudo[104660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:36:08 devstack sudo[104660]: pam_unix(sudo:session): session closed for user root Nov 06 15:36:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.254s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:36:08 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:36:08 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Running periodic task VolumeManager._thread_info {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 15:36:08 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] thread count: 28 {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 15:36:08 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] thread info: [<_MainThread(MainThread, started 140011251929216)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 06 15:36:30 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-d11a884b-57bb-4f6d-82af-118d9ee1ffb3 tempest-TestServerVolumeAttachmentScenario-900511464 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:36:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d11a884b-57bb-4f6d-82af-118d9ee1ffb3 tempest-TestServerVolumeAttachmentScenario-900511464 None] Flow 'volume_create_manager' (0f52a5bd-f39c-4937-8c16-fd810daa2fbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:36:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d11a884b-57bb-4f6d-82af-118d9ee1ffb3 tempest-TestServerVolumeAttachmentScenario-900511464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b07c42c-6c1a-4258-94d9-229b1014ea5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:36:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d11a884b-57bb-4f6d-82af-118d9ee1ffb3 tempest-TestServerVolumeAttachmentScenario-900511464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b07c42c-6c1a-4258-94d9-229b1014ea5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:36:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-512959497',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f042d61-9d53-40f6-925f-267989410bc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='024928f0dd0d4e44af925c47f601d228',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:36:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:36:30Z,use_quota=True,user_id='fe5370eb0a6e489d9da48cb41d3957b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:36:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d11a884b-57bb-4f6d-82af-118d9ee1ffb3 tempest-TestServerVolumeAttachmentScenario-900511464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d4ce7b9-23d4-4403-8769-ebe8b114ac63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:36:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d11a884b-57bb-4f6d-82af-118d9ee1ffb3 tempest-TestServerVolumeAttachmentScenario-900511464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d4ce7b9-23d4-4403-8769-ebe8b114ac63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:36:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d11a884b-57bb-4f6d-82af-118d9ee1ffb3 tempest-TestServerVolumeAttachmentScenario-900511464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6aa841fb-4463-4e10-a02a-baac59b73a82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:36:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d11a884b-57bb-4f6d-82af-118d9ee1ffb3 tempest-TestServerVolumeAttachmentScenario-900511464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6aa841fb-4463-4e10-a02a-baac59b73a82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f042d61-9d53-40f6-925f-267989410bc4', 'volume_name': 'volume-1f042d61-9d53-40f6-925f-267989410bc4', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:36:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d11a884b-57bb-4f6d-82af-118d9ee1ffb3 tempest-TestServerVolumeAttachmentScenario-900511464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee4c2e22-0452-4226-b2af-5458482f2d7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:36:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d11a884b-57bb-4f6d-82af-118d9ee1ffb3 tempest-TestServerVolumeAttachmentScenario-900511464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee4c2e22-0452-4226-b2af-5458482f2d7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:36:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d11a884b-57bb-4f6d-82af-118d9ee1ffb3 tempest-TestServerVolumeAttachmentScenario-900511464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8488116-7d6e-4f57-8b88-c4154e70a3ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:36:30 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-d11a884b-57bb-4f6d-82af-118d9ee1ffb3 tempest-TestServerVolumeAttachmentScenario-900511464 None] Volume 1f042d61-9d53-40f6-925f-267989410bc4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f042d61-9d53-40f6-925f-267989410bc4', 'volume_size': 1} Nov 06 15:36:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-d11a884b-57bb-4f6d-82af-118d9ee1ffb3 tempest-TestServerVolumeAttachmentScenario-900511464 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:36:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-d11a884b-57bb-4f6d-82af-118d9ee1ffb3 tempest-TestServerVolumeAttachmentScenario-900511464 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:36:30 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-d11a884b-57bb-4f6d-82af-118d9ee1ffb3 tempest-TestServerVolumeAttachmentScenario-900511464 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:36:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-512959497',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f042d61-9d53-40f6-925f-267989410bc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='024928f0dd0d4e44af925c47f601d228',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:36:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:36:30Z,use_quota=True,user_id='fe5370eb0a6e489d9da48cb41d3957b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:36:30 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-d11a884b-57bb-4f6d-82af-118d9ee1ffb3 tempest-TestServerVolumeAttachmentScenario-900511464 None] Creating volume 1f042d61-9d53-40f6-925f-267989410bc4 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:36:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-d11a884b-57bb-4f6d-82af-118d9ee1ffb3 tempest-TestServerVolumeAttachmentScenario-900511464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:36:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-d11a884b-57bb-4f6d-82af-118d9ee1ffb3 tempest-TestServerVolumeAttachmentScenario-900511464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:36:30 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-d11a884b-57bb-4f6d-82af-118d9ee1ffb3 tempest-TestServerVolumeAttachmentScenario-900511464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:36:30 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-d11a884b-57bb-4f6d-82af-118d9ee1ffb3 tempest-TestServerVolumeAttachmentScenario-900511464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:36:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-d11a884b-57bb-4f6d-82af-118d9ee1ffb3 tempest-TestServerVolumeAttachmentScenario-900511464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:36:30 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-d11a884b-57bb-4f6d-82af-118d9ee1ffb3 tempest-TestServerVolumeAttachmentScenario-900511464 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:36:30 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-d11a884b-57bb-4f6d-82af-118d9ee1ffb3 tempest-TestServerVolumeAttachmentScenario-900511464 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:36:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d11a884b-57bb-4f6d-82af-118d9ee1ffb3 tempest-TestServerVolumeAttachmentScenario-900511464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-1f042d61-9d53-40f6-925f-267989410bc4 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:36:30 devstack sudo[104665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-1f042d61-9d53-40f6-925f-267989410bc4 1073741824 Nov 06 15:36:30 devstack sudo[104665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:36:30 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cc96114-a3bd-4cc4-b90d-e5186b264991 tempest-TestServerVolumeAttachmentScenario-900511464 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:36:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1cc96114-a3bd-4cc4-b90d-e5186b264991 tempest-TestServerVolumeAttachmentScenario-900511464 None] Flow 'volume_create_manager' (5144c73f-59dc-4e99-a8e1-7b7c3ed636ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:36:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1cc96114-a3bd-4cc4-b90d-e5186b264991 tempest-TestServerVolumeAttachmentScenario-900511464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50245b10-f309-4db1-903d-0b349d2bdf10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:36:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1cc96114-a3bd-4cc4-b90d-e5186b264991 tempest-TestServerVolumeAttachmentScenario-900511464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50245b10-f309-4db1-903d-0b349d2bdf10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:36:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1031310342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2ff7070-36f6-41aa-a659-e298993eb111,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='024928f0dd0d4e44af925c47f601d228',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:36:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:36:31Z,use_quota=True,user_id='fe5370eb0a6e489d9da48cb41d3957b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:36:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1cc96114-a3bd-4cc4-b90d-e5186b264991 tempest-TestServerVolumeAttachmentScenario-900511464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a327528-accf-42bb-acff-53b44f660801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:36:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1cc96114-a3bd-4cc4-b90d-e5186b264991 tempest-TestServerVolumeAttachmentScenario-900511464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a327528-accf-42bb-acff-53b44f660801) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:36:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1cc96114-a3bd-4cc4-b90d-e5186b264991 tempest-TestServerVolumeAttachmentScenario-900511464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b5265a6-ae41-4387-b6b4-ec156387b318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:36:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1cc96114-a3bd-4cc4-b90d-e5186b264991 tempest-TestServerVolumeAttachmentScenario-900511464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b5265a6-ae41-4387-b6b4-ec156387b318) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2ff7070-36f6-41aa-a659-e298993eb111', 'volume_name': 'volume-e2ff7070-36f6-41aa-a659-e298993eb111', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:36:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1cc96114-a3bd-4cc4-b90d-e5186b264991 tempest-TestServerVolumeAttachmentScenario-900511464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3760c8f0-cf40-48a4-8bda-a3363ac2f3c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:36:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1cc96114-a3bd-4cc4-b90d-e5186b264991 tempest-TestServerVolumeAttachmentScenario-900511464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3760c8f0-cf40-48a4-8bda-a3363ac2f3c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:36:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1cc96114-a3bd-4cc4-b90d-e5186b264991 tempest-TestServerVolumeAttachmentScenario-900511464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da88be46-e6cb-4dd9-928e-cc47da9293fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:36:30 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-1cc96114-a3bd-4cc4-b90d-e5186b264991 tempest-TestServerVolumeAttachmentScenario-900511464 None] Volume e2ff7070-36f6-41aa-a659-e298993eb111: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2ff7070-36f6-41aa-a659-e298993eb111', 'volume_size': 1} Nov 06 15:36:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1cc96114-a3bd-4cc4-b90d-e5186b264991 tempest-TestServerVolumeAttachmentScenario-900511464 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:36:30 devstack sudo[104665]: pam_unix(sudo:session): session closed for user root Nov 06 15:36:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d11a884b-57bb-4f6d-82af-118d9ee1ffb3 tempest-TestServerVolumeAttachmentScenario-900511464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-1f042d61-9d53-40f6-925f-267989410bc4 1073741824" returned: 0 in 0.562s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:36:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d11a884b-57bb-4f6d-82af-118d9ee1ffb3 tempest-TestServerVolumeAttachmentScenario-900511464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-1f042d61-9d53-40f6-925f-267989410bc4 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:36:31 devstack sudo[104672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-1f042d61-9d53-40f6-925f-267989410bc4 Nov 06 15:36:31 devstack sudo[104672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:36:31 devstack sudo[104672]: pam_unix(sudo:session): session closed for user root Nov 06 15:36:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d11a884b-57bb-4f6d-82af-118d9ee1ffb3 tempest-TestServerVolumeAttachmentScenario-900511464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-1f042d61-9d53-40f6-925f-267989410bc4" returned: 0 in 0.255s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:36:31 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-d11a884b-57bb-4f6d-82af-118d9ee1ffb3 tempest-TestServerVolumeAttachmentScenario-900511464 None] <== create_volume: return (861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:36:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-d11a884b-57bb-4f6d-82af-118d9ee1ffb3 tempest-TestServerVolumeAttachmentScenario-900511464 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.864s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:36:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1cc96114-a3bd-4cc4-b90d-e5186b264991 tempest-TestServerVolumeAttachmentScenario-900511464 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.327s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:36:31 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1cc96114-a3bd-4cc4-b90d-e5186b264991 tempest-TestServerVolumeAttachmentScenario-900511464 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:36:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1031310342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2ff7070-36f6-41aa-a659-e298993eb111,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='024928f0dd0d4e44af925c47f601d228',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:36:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:36:31Z,use_quota=True,user_id='fe5370eb0a6e489d9da48cb41d3957b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:36:31 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-1cc96114-a3bd-4cc4-b90d-e5186b264991 tempest-TestServerVolumeAttachmentScenario-900511464 None] Creating volume e2ff7070-36f6-41aa-a659-e298993eb111 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:36:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1cc96114-a3bd-4cc4-b90d-e5186b264991 tempest-TestServerVolumeAttachmentScenario-900511464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:36:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1cc96114-a3bd-4cc4-b90d-e5186b264991 tempest-TestServerVolumeAttachmentScenario-900511464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:36:31 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1cc96114-a3bd-4cc4-b90d-e5186b264991 tempest-TestServerVolumeAttachmentScenario-900511464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:36:31 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1cc96114-a3bd-4cc4-b90d-e5186b264991 tempest-TestServerVolumeAttachmentScenario-900511464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:36:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1cc96114-a3bd-4cc4-b90d-e5186b264991 tempest-TestServerVolumeAttachmentScenario-900511464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:36:31 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1cc96114-a3bd-4cc4-b90d-e5186b264991 tempest-TestServerVolumeAttachmentScenario-900511464 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:36:31 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-1cc96114-a3bd-4cc4-b90d-e5186b264991 tempest-TestServerVolumeAttachmentScenario-900511464 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:36:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1cc96114-a3bd-4cc4-b90d-e5186b264991 tempest-TestServerVolumeAttachmentScenario-900511464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-e2ff7070-36f6-41aa-a659-e298993eb111 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:36:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d11a884b-57bb-4f6d-82af-118d9ee1ffb3 tempest-TestServerVolumeAttachmentScenario-900511464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8488116-7d6e-4f57-8b88-c4154e70a3ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f042d61-9d53-40f6-925f-267989410bc4', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:36:31 devstack sudo[104675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-e2ff7070-36f6-41aa-a659-e298993eb111 1073741824 Nov 06 15:36:31 devstack sudo[104675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:36:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d11a884b-57bb-4f6d-82af-118d9ee1ffb3 tempest-TestServerVolumeAttachmentScenario-900511464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (002c98c0-04ef-41e4-b606-e6419ed60329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:36:31 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-d11a884b-57bb-4f6d-82af-118d9ee1ffb3 tempest-TestServerVolumeAttachmentScenario-900511464 None] Volume volume-1f042d61-9d53-40f6-925f-267989410bc4 (1f042d61-9d53-40f6-925f-267989410bc4): created successfully Nov 06 15:36:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d11a884b-57bb-4f6d-82af-118d9ee1ffb3 tempest-TestServerVolumeAttachmentScenario-900511464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (002c98c0-04ef-41e4-b606-e6419ed60329) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:36:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d11a884b-57bb-4f6d-82af-118d9ee1ffb3 tempest-TestServerVolumeAttachmentScenario-900511464 None] Flow 'volume_create_manager' (0f52a5bd-f39c-4937-8c16-fd810daa2fbf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:36:31 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-d11a884b-57bb-4f6d-82af-118d9ee1ffb3 tempest-TestServerVolumeAttachmentScenario-900511464 None] Created volume successfully. Nov 06 15:36:31 devstack sudo[104675]: pam_unix(sudo:session): session closed for user root Nov 06 15:36:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1cc96114-a3bd-4cc4-b90d-e5186b264991 tempest-TestServerVolumeAttachmentScenario-900511464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-e2ff7070-36f6-41aa-a659-e298993eb111 1073741824" returned: 0 in 0.449s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:36:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1cc96114-a3bd-4cc4-b90d-e5186b264991 tempest-TestServerVolumeAttachmentScenario-900511464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-e2ff7070-36f6-41aa-a659-e298993eb111 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:36:31 devstack sudo[104680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-e2ff7070-36f6-41aa-a659-e298993eb111 Nov 06 15:36:31 devstack sudo[104680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:36:32 devstack sudo[104680]: pam_unix(sudo:session): session closed for user root Nov 06 15:36:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1cc96114-a3bd-4cc4-b90d-e5186b264991 tempest-TestServerVolumeAttachmentScenario-900511464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-e2ff7070-36f6-41aa-a659-e298993eb111" returned: 0 in 0.244s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:36:32 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1cc96114-a3bd-4cc4-b90d-e5186b264991 tempest-TestServerVolumeAttachmentScenario-900511464 None] <== create_volume: return (741ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:36:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1cc96114-a3bd-4cc4-b90d-e5186b264991 tempest-TestServerVolumeAttachmentScenario-900511464 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.744s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:36:32 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1cc96114-a3bd-4cc4-b90d-e5186b264991 tempest-TestServerVolumeAttachmentScenario-900511464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da88be46-e6cb-4dd9-928e-cc47da9293fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2ff7070-36f6-41aa-a659-e298993eb111', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:36:32 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1cc96114-a3bd-4cc4-b90d-e5186b264991 tempest-TestServerVolumeAttachmentScenario-900511464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ded290ac-5229-4a0d-9d35-dda046ffbbdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:36:32 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-1cc96114-a3bd-4cc4-b90d-e5186b264991 tempest-TestServerVolumeAttachmentScenario-900511464 None] Volume volume-e2ff7070-36f6-41aa-a659-e298993eb111 (e2ff7070-36f6-41aa-a659-e298993eb111): created successfully Nov 06 15:36:32 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1cc96114-a3bd-4cc4-b90d-e5186b264991 tempest-TestServerVolumeAttachmentScenario-900511464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ded290ac-5229-4a0d-9d35-dda046ffbbdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:36:32 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1cc96114-a3bd-4cc4-b90d-e5186b264991 tempest-TestServerVolumeAttachmentScenario-900511464 None] Flow 'volume_create_manager' (5144c73f-59dc-4e99-a8e1-7b7c3ed636ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:36:32 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-1cc96114-a3bd-4cc4-b90d-e5186b264991 tempest-TestServerVolumeAttachmentScenario-900511464 None] Created volume successfully. Nov 06 15:36:42 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:UPDATE=5,cinder:SELECT=4,cinder:DELETE=1 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 15:36:42 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:SELECT=4,cinder:UPDATE=7,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 15:37:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-7b918827-e6f7-4a1e-a247-5c0b53f42365 req-e5b6d1ec-27d8-439c-894d-ad0732fe6d71 tempest-TestServerVolumeAttachmentScenario-900511464 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:37:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-7b918827-e6f7-4a1e-a247-5c0b53f42365 req-e5b6d1ec-27d8-439c-894d-ad0732fe6d71 tempest-TestServerVolumeAttachmentScenario-900511464 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:37:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-7b918827-e6f7-4a1e-a247-5c0b53f42365 req-e5b6d1ec-27d8-439c-894d-ad0732fe6d71 tempest-TestServerVolumeAttachmentScenario-900511464 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:37:01 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-7b918827-e6f7-4a1e-a247-5c0b53f42365 req-e5b6d1ec-27d8-439c-894d-ad0732fe6d71 tempest-TestServerVolumeAttachmentScenario-900511464 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b', 'name': 'volume-1f042d61-9d53-40f6-925f-267989410bc4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '74efbbbe-4813-4cbf-bba8-c1b1f0111a3a', 'enforce_multipath': True} {{(pid=87132) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 15:37:01 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-7b918827-e6f7-4a1e-a247-5c0b53f42365 req-e5b6d1ec-27d8-439c-894d-ad0732fe6d71 tempest-TestServerVolumeAttachmentScenario-900511464 None] attachment_update completed successfully. Nov 06 15:37:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-aac53e18-2b6e-48ec-ae34-0abdac0e6fdc req-ab3dc558-824f-4fb8-bcc5-ce45ee0307d5 tempest-TestServerVolumeAttachmentScenario-900511464 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:37:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-aac53e18-2b6e-48ec-ae34-0abdac0e6fdc req-ab3dc558-824f-4fb8-bcc5-ce45ee0307d5 tempest-TestServerVolumeAttachmentScenario-900511464 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:37:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-aac53e18-2b6e-48ec-ae34-0abdac0e6fdc req-ab3dc558-824f-4fb8-bcc5-ce45ee0307d5 tempest-TestServerVolumeAttachmentScenario-900511464 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:37:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-aac53e18-2b6e-48ec-ae34-0abdac0e6fdc req-ab3dc558-824f-4fb8-bcc5-ce45ee0307d5 tempest-TestServerVolumeAttachmentScenario-900511464 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b', 'name': 'volume-e2ff7070-36f6-41aa-a659-e298993eb111', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e5168673-a2ca-4b96-8837-78b4394e09e4', 'enforce_multipath': True} {{(pid=87132) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 15:37:04 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-aac53e18-2b6e-48ec-ae34-0abdac0e6fdc req-ab3dc558-824f-4fb8-bcc5-ce45ee0307d5 tempest-TestServerVolumeAttachmentScenario-900511464 None] attachment_update completed successfully. Nov 06 15:37:06 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-a98d4782-64cf-4dd4-8bd2-9f289ec76d1c req-1442fe1e-969a-4243-afd9-927147355242 tempest-TestServerVolumeAttachmentScenario-900511464 None] Terminate volume connection completed successfully. Nov 06 15:37:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-a98d4782-64cf-4dd4-8bd2-9f289ec76d1c req-1442fe1e-969a-4243-afd9-927147355242 tempest-TestServerVolumeAttachmentScenario-900511464 None] Deleting attachment e5168673-a2ca-4b96-8837-78b4394e09e4. {{(pid=87132) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 06 15:37:07 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-4b1fd0ab-65ab-4925-bcd9-8dc08f43f7a2 req-b6a20af7-ab9c-4455-9b39-724e8786b864 tempest-TestServerVolumeAttachmentScenario-900511464 None] Terminate volume connection completed successfully. Nov 06 15:37:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-4b1fd0ab-65ab-4925-bcd9-8dc08f43f7a2 req-b6a20af7-ab9c-4455-9b39-724e8786b864 tempest-TestServerVolumeAttachmentScenario-900511464 None] Deleting attachment 74efbbbe-4813-4cbf-bba8-c1b1f0111a3a. {{(pid=87132) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 06 15:37:08 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 15:37:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:37:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:37:08 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:37:08 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:37:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:37:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:37:08 devstack sudo[105320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:37:08 devstack sudo[105320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:37:08 devstack sudo[105320]: pam_unix(sudo:session): session closed for user root Nov 06 15:37:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.250s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:37:08 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:37:08 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Running periodic task VolumeManager._thread_info {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 15:37:08 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] thread count: 28 {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 15:37:08 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] thread info: [<_MainThread(MainThread, started 140011251929216)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 06 15:37:12 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-dff3075a-300b-43fa-a72c-37de0a7638fc tempest-TestServerVolumeAttachmentScenario-900511464 None] Acquiring lock "cinder-e2ff7070-36f6-41aa-a659-e298993eb111-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:37:12 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-dff3075a-300b-43fa-a72c-37de0a7638fc tempest-TestServerVolumeAttachmentScenario-900511464 None] Lock "cinder-e2ff7070-36f6-41aa-a659-e298993eb111-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:37:12 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-dff3075a-300b-43fa-a72c-37de0a7638fc tempest-TestServerVolumeAttachmentScenario-900511464 None] Acquiring lock "cinder-quobyte-e2ff7070-36f6-41aa-a659-e298993eb111" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:37:12 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-dff3075a-300b-43fa-a72c-37de0a7638fc tempest-TestServerVolumeAttachmentScenario-900511464 None] Lock "cinder-quobyte-e2ff7070-36f6-41aa-a659-e298993eb111" acquired by "delete_volume" :: waited 0.014s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:37:12 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[59d11113-e447-4e01-805f-8c8160d56eb7]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:37:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-dff3075a-300b-43fa-a72c-37de0a7638fc tempest-TestServerVolumeAttachmentScenario-900511464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-e2ff7070-36f6-41aa-a659-e298993eb111 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:37:12 devstack sudo[105347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-e2ff7070-36f6-41aa-a659-e298993eb111 Nov 06 15:37:12 devstack sudo[105347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:37:12 devstack sudo[105347]: pam_unix(sudo:session): session closed for user root Nov 06 15:37:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-dff3075a-300b-43fa-a72c-37de0a7638fc tempest-TestServerVolumeAttachmentScenario-900511464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-e2ff7070-36f6-41aa-a659-e298993eb111" returned: 0 in 0.349s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:37:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-dff3075a-300b-43fa-a72c-37de0a7638fc tempest-TestServerVolumeAttachmentScenario-900511464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-e2ff7070-36f6-41aa-a659-e298993eb111 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:37:12 devstack sudo[105352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-e2ff7070-36f6-41aa-a659-e298993eb111 Nov 06 15:37:12 devstack sudo[105352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:37:13 devstack sudo[105352]: pam_unix(sudo:session): session closed for user root Nov 06 15:37:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-dff3075a-300b-43fa-a72c-37de0a7638fc tempest-TestServerVolumeAttachmentScenario-900511464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-e2ff7070-36f6-41aa-a659-e298993eb111" returned: 0 in 0.238s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:37:13 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-dff3075a-300b-43fa-a72c-37de0a7638fc tempest-TestServerVolumeAttachmentScenario-900511464 None] Lock "cinder-quobyte-e2ff7070-36f6-41aa-a659-e298993eb111" released by "delete_volume" :: held 0.625s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:37:13 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-dff3075a-300b-43fa-a72c-37de0a7638fc tempest-TestServerVolumeAttachmentScenario-900511464 None] Created reservations ['485f6b61-d5fd-4062-aeaa-edf063ff9c9e', 'eea5ccd1-5ceb-49f8-aab7-b6a3743db95e', 'b19c3dfc-4e4c-4f26-b3bd-245d25a24ceb', '3deafa57-aaf9-4460-a388-776f8629849f'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:37:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-dff3075a-300b-43fa-a72c-37de0a7638fc tempest-TestServerVolumeAttachmentScenario-900511464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:37:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-dff3075a-300b-43fa-a72c-37de0a7638fc tempest-TestServerVolumeAttachmentScenario-900511464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:37:13 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-dff3075a-300b-43fa-a72c-37de0a7638fc tempest-TestServerVolumeAttachmentScenario-900511464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:37:13 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-dff3075a-300b-43fa-a72c-37de0a7638fc tempest-TestServerVolumeAttachmentScenario-900511464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:37:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-dff3075a-300b-43fa-a72c-37de0a7638fc tempest-TestServerVolumeAttachmentScenario-900511464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:37:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-dff3075a-300b-43fa-a72c-37de0a7638fc tempest-TestServerVolumeAttachmentScenario-900511464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:37:13 devstack sudo[105355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:37:13 devstack sudo[105355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:37:13 devstack sudo[105355]: pam_unix(sudo:session): session closed for user root Nov 06 15:37:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-dff3075a-300b-43fa-a72c-37de0a7638fc tempest-TestServerVolumeAttachmentScenario-900511464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.237s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:37:13 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-dff3075a-300b-43fa-a72c-37de0a7638fc tempest-TestServerVolumeAttachmentScenario-900511464 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:37:13 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-dff3075a-300b-43fa-a72c-37de0a7638fc tempest-TestServerVolumeAttachmentScenario-900511464 None] Deleted volume successfully. Nov 06 15:37:13 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-dff3075a-300b-43fa-a72c-37de0a7638fc tempest-TestServerVolumeAttachmentScenario-900511464 None] Lock "cinder-e2ff7070-36f6-41aa-a659-e298993eb111-delete_volume" released by "delete_volume" :: held 1.036s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:37:13 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-40d00fef-af74-4eaf-9d9a-d1ff57619c1f tempest-TestServerVolumeAttachmentScenario-900511464 None] Acquiring lock "cinder-1f042d61-9d53-40f6-925f-267989410bc4-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:37:13 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-40d00fef-af74-4eaf-9d9a-d1ff57619c1f tempest-TestServerVolumeAttachmentScenario-900511464 None] Lock "cinder-1f042d61-9d53-40f6-925f-267989410bc4-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:37:13 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-40d00fef-af74-4eaf-9d9a-d1ff57619c1f tempest-TestServerVolumeAttachmentScenario-900511464 None] Acquiring lock "cinder-quobyte-1f042d61-9d53-40f6-925f-267989410bc4" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:37:13 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-40d00fef-af74-4eaf-9d9a-d1ff57619c1f tempest-TestServerVolumeAttachmentScenario-900511464 None] Lock "cinder-quobyte-1f042d61-9d53-40f6-925f-267989410bc4" acquired by "delete_volume" :: waited 0.014s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:37:13 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[75b8f6d2-9c13-490c-9a56-410171432ccd]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:37:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-40d00fef-af74-4eaf-9d9a-d1ff57619c1f tempest-TestServerVolumeAttachmentScenario-900511464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-1f042d61-9d53-40f6-925f-267989410bc4 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:37:13 devstack sudo[105358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-1f042d61-9d53-40f6-925f-267989410bc4 Nov 06 15:37:13 devstack sudo[105358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:37:13 devstack sudo[105358]: pam_unix(sudo:session): session closed for user root Nov 06 15:37:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-40d00fef-af74-4eaf-9d9a-d1ff57619c1f tempest-TestServerVolumeAttachmentScenario-900511464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-1f042d61-9d53-40f6-925f-267989410bc4" returned: 0 in 0.347s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:37:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-40d00fef-af74-4eaf-9d9a-d1ff57619c1f tempest-TestServerVolumeAttachmentScenario-900511464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-1f042d61-9d53-40f6-925f-267989410bc4 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:37:13 devstack sudo[105363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-1f042d61-9d53-40f6-925f-267989410bc4 Nov 06 15:37:13 devstack sudo[105363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:37:14 devstack sudo[105363]: pam_unix(sudo:session): session closed for user root Nov 06 15:37:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-40d00fef-af74-4eaf-9d9a-d1ff57619c1f tempest-TestServerVolumeAttachmentScenario-900511464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-1f042d61-9d53-40f6-925f-267989410bc4" returned: 0 in 0.236s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:37:14 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-40d00fef-af74-4eaf-9d9a-d1ff57619c1f tempest-TestServerVolumeAttachmentScenario-900511464 None] Lock "cinder-quobyte-1f042d61-9d53-40f6-925f-267989410bc4" released by "delete_volume" :: held 0.624s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:37:14 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-40d00fef-af74-4eaf-9d9a-d1ff57619c1f tempest-TestServerVolumeAttachmentScenario-900511464 None] Created reservations ['69512c1c-055f-41dd-a077-537695b16a32', '5015b03a-c276-4b6b-b598-e1f2718b7a02', '80915c04-7da6-4efd-a4fc-92bffe741448', '5f4090d6-3ae1-4517-a8ae-536243423575'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:37:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-40d00fef-af74-4eaf-9d9a-d1ff57619c1f tempest-TestServerVolumeAttachmentScenario-900511464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:37:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-40d00fef-af74-4eaf-9d9a-d1ff57619c1f tempest-TestServerVolumeAttachmentScenario-900511464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:37:14 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-40d00fef-af74-4eaf-9d9a-d1ff57619c1f tempest-TestServerVolumeAttachmentScenario-900511464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:37:14 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-40d00fef-af74-4eaf-9d9a-d1ff57619c1f tempest-TestServerVolumeAttachmentScenario-900511464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:37:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-40d00fef-af74-4eaf-9d9a-d1ff57619c1f tempest-TestServerVolumeAttachmentScenario-900511464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:37:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-40d00fef-af74-4eaf-9d9a-d1ff57619c1f tempest-TestServerVolumeAttachmentScenario-900511464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:37:14 devstack sudo[105366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:37:14 devstack sudo[105366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:37:14 devstack sudo[105366]: pam_unix(sudo:session): session closed for user root Nov 06 15:37:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-40d00fef-af74-4eaf-9d9a-d1ff57619c1f tempest-TestServerVolumeAttachmentScenario-900511464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.239s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:37:14 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-40d00fef-af74-4eaf-9d9a-d1ff57619c1f tempest-TestServerVolumeAttachmentScenario-900511464 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:37:14 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-40d00fef-af74-4eaf-9d9a-d1ff57619c1f tempest-TestServerVolumeAttachmentScenario-900511464 None] Deleted volume successfully. Nov 06 15:37:14 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-40d00fef-af74-4eaf-9d9a-d1ff57619c1f tempest-TestServerVolumeAttachmentScenario-900511464 None] Lock "cinder-1f042d61-9d53-40f6-925f-267989410bc4-delete_volume" released by "delete_volume" :: held 1.042s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:37:24 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:SELECT=29,cinder:UPDATE=18,cinder:INSERT=3 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 15:37:24 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:UPDATE=21,cinder:SELECT=22,cinder:INSERT=5,cinder:DELETE=2 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 15:37:43 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-16490450-5638-4c2e-aad8-fb4ef720b9b2 tempest-TestShelveInstance-1616885335 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:37:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-16490450-5638-4c2e-aad8-fb4ef720b9b2 tempest-TestShelveInstance-1616885335 None] Flow 'volume_create_manager' (4d350bbd-f26b-4dc0-95fe-4de3c542f794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:37:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-16490450-5638-4c2e-aad8-fb4ef720b9b2 tempest-TestShelveInstance-1616885335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87367b2b-b2ec-4447-a906-95809dfd7495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:37:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-16490450-5638-4c2e-aad8-fb4ef720b9b2 tempest-TestShelveInstance-1616885335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87367b2b-b2ec-4447-a906-95809dfd7495) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:37:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1523631562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6bbb724-96b5-4489-9d81-8ada15b6ccee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53781854ad034ce999f8ecfe41f0eceb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:37:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:37:44Z,use_quota=True,user_id='6c1f5a3b7258442384c51c7ad71cb55f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:37:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-16490450-5638-4c2e-aad8-fb4ef720b9b2 tempest-TestShelveInstance-1616885335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cad0b40-bdc8-44f8-810d-6ecf3958ce9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:37:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-16490450-5638-4c2e-aad8-fb4ef720b9b2 tempest-TestShelveInstance-1616885335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cad0b40-bdc8-44f8-810d-6ecf3958ce9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:37:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-16490450-5638-4c2e-aad8-fb4ef720b9b2 tempest-TestShelveInstance-1616885335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68d3af26-571c-4a90-90c7-50473fe975f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:37:43 devstack cinder-volume[87132]: DEBUG cinder.image.glance [None req-16490450-5638-4c2e-aad8-fb4ef720b9b2 tempest-TestShelveInstance-1616885335 None] Creating Keystone auth plugin from conf {{(pid=87132) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 06 15:37:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-16490450-5638-4c2e-aad8-fb4ef720b9b2 tempest-TestShelveInstance-1616885335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68d3af26-571c-4a90-90c7-50473fe975f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd6bbb724-96b5-4489-9d81-8ada15b6ccee', 'volume_name': 'volume-d6bbb724-96b5-4489-9d81-8ada15b6ccee', 'volume_size': 1, 'image_id': '3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c02e84193ee841ccb304f909f5951fd0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83', 'created_at': datetime.datetime(2026, 11, 6, 14, 12, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 14, 12, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:37:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-16490450-5638-4c2e-aad8-fb4ef720b9b2 tempest-TestShelveInstance-1616885335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dcb1f80-64eb-4af8-baa8-4216d8a8d4f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:37:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-16490450-5638-4c2e-aad8-fb4ef720b9b2 tempest-TestShelveInstance-1616885335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dcb1f80-64eb-4af8-baa8-4216d8a8d4f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:37:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-16490450-5638-4c2e-aad8-fb4ef720b9b2 tempest-TestShelveInstance-1616885335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a4b1125-f233-4476-891a-19cb949798ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:37:43 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-16490450-5638-4c2e-aad8-fb4ef720b9b2 tempest-TestShelveInstance-1616885335 None] Volume d6bbb724-96b5-4489-9d81-8ada15b6ccee: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d6bbb724-96b5-4489-9d81-8ada15b6ccee', 'volume_size': 1, 'image_id': '3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c02e84193ee841ccb304f909f5951fd0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83', 'created_at': datetime.datetime(2026, 11, 6, 14, 12, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 14, 12, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 06 15:37:43 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-16490450-5638-4c2e-aad8-fb4ef720b9b2 tempest-TestShelveInstance-1616885335 None] Trying to clone d6bbb724-96b5-4489-9d81-8ada15b6ccee from image 3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83 at location (None, [{'url': 'file:///opt/stack/data/glance/images/3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83', 'metadata': {}}]). {{(pid=87132) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 06 15:37:44 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-16490450-5638-4c2e-aad8-fb4ef720b9b2 tempest-TestShelveInstance-1616885335 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83_ii9r71ubdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87132) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 06 15:37:44 devstack cinder-volume[87132]: INFO cinder.image.image_utils [None req-16490450-5638-4c2e-aad8-fb4ef720b9b2 tempest-TestShelveInstance-1616885335 None] Image download 20.69 MB at 20.69 MB/s Nov 06 15:37:44 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[71a91695-f718-4811-a5dd-debdfbd95dcd]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:37:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-16490450-5638-4c2e-aad8-fb4ef720b9b2 tempest-TestShelveInstance-1616885335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83_ii9r71ubdevstack@QuobyteHD {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:37:44 devstack sudo[105379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83_ii9r71ubdevstack@QuobyteHD Nov 06 15:37:44 devstack sudo[105379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:37:44 devstack sudo[105379]: pam_unix(sudo:session): session closed for user root Nov 06 15:37:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-16490450-5638-4c2e-aad8-fb4ef720b9b2 tempest-TestShelveInstance-1616885335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83_ii9r71ubdevstack@QuobyteHD" returned: 0 in 0.325s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:37:44 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-16490450-5638-4c2e-aad8-fb4ef720b9b2 tempest-TestShelveInstance-1616885335 None] Temporary image 3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83 is fetched for user 6c1f5a3b7258442384c51c7ad71cb55f. {{(pid=87132) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 06 15:37:44 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[16df4cd6-65c4-44f4-a4be-583d8c891ed5]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:37:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-16490450-5638-4c2e-aad8-fb4ef720b9b2 tempest-TestShelveInstance-1616885335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83_ii9r71ubdevstack@QuobyteHD {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:37:44 devstack sudo[105384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83_ii9r71ubdevstack@QuobyteHD Nov 06 15:37:44 devstack sudo[105384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:37:45 devstack sudo[105384]: pam_unix(sudo:session): session closed for user root Nov 06 15:37:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-16490450-5638-4c2e-aad8-fb4ef720b9b2 tempest-TestShelveInstance-1616885335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83_ii9r71ubdevstack@QuobyteHD" returned: 0 in 0.328s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:37:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-16490450-5638-4c2e-aad8-fb4ef720b9b2 tempest-TestShelveInstance-1616885335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:37:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-16490450-5638-4c2e-aad8-fb4ef720b9b2 tempest-TestShelveInstance-1616885335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:37:45 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-16490450-5638-4c2e-aad8-fb4ef720b9b2 tempest-TestShelveInstance-1616885335 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:37:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1523631562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6bbb724-96b5-4489-9d81-8ada15b6ccee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53781854ad034ce999f8ecfe41f0eceb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:37:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:37:44Z,use_quota=True,user_id='6c1f5a3b7258442384c51c7ad71cb55f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:37:45 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-16490450-5638-4c2e-aad8-fb4ef720b9b2 tempest-TestShelveInstance-1616885335 None] Creating volume d6bbb724-96b5-4489-9d81-8ada15b6ccee {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:37:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-16490450-5638-4c2e-aad8-fb4ef720b9b2 tempest-TestShelveInstance-1616885335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:37:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-16490450-5638-4c2e-aad8-fb4ef720b9b2 tempest-TestShelveInstance-1616885335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:37:45 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-16490450-5638-4c2e-aad8-fb4ef720b9b2 tempest-TestShelveInstance-1616885335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:37:45 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-16490450-5638-4c2e-aad8-fb4ef720b9b2 tempest-TestShelveInstance-1616885335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:37:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-16490450-5638-4c2e-aad8-fb4ef720b9b2 tempest-TestShelveInstance-1616885335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:37:45 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-16490450-5638-4c2e-aad8-fb4ef720b9b2 tempest-TestShelveInstance-1616885335 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:37:45 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-16490450-5638-4c2e-aad8-fb4ef720b9b2 tempest-TestShelveInstance-1616885335 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:37:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-16490450-5638-4c2e-aad8-fb4ef720b9b2 tempest-TestShelveInstance-1616885335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d6bbb724-96b5-4489-9d81-8ada15b6ccee 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:37:45 devstack sudo[105389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d6bbb724-96b5-4489-9d81-8ada15b6ccee 1073741824 Nov 06 15:37:45 devstack sudo[105389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:37:45 devstack sudo[105389]: pam_unix(sudo:session): session closed for user root Nov 06 15:37:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-16490450-5638-4c2e-aad8-fb4ef720b9b2 tempest-TestShelveInstance-1616885335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d6bbb724-96b5-4489-9d81-8ada15b6ccee 1073741824" returned: 0 in 0.388s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:37:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-16490450-5638-4c2e-aad8-fb4ef720b9b2 tempest-TestShelveInstance-1616885335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d6bbb724-96b5-4489-9d81-8ada15b6ccee {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:37:45 devstack sudo[105394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d6bbb724-96b5-4489-9d81-8ada15b6ccee Nov 06 15:37:45 devstack sudo[105394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:37:45 devstack sudo[105394]: pam_unix(sudo:session): session closed for user root Nov 06 15:37:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-16490450-5638-4c2e-aad8-fb4ef720b9b2 tempest-TestShelveInstance-1616885335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d6bbb724-96b5-4489-9d81-8ada15b6ccee" returned: 0 in 0.241s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:37:45 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-16490450-5638-4c2e-aad8-fb4ef720b9b2 tempest-TestShelveInstance-1616885335 None] <== create_volume: return (673ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:37:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-16490450-5638-4c2e-aad8-fb4ef720b9b2 tempest-TestShelveInstance-1616885335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.676s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:37:45 devstack cinder-volume[87132]: DEBUG cinder.volume.volume_utils [None req-16490450-5638-4c2e-aad8-fb4ef720b9b2 tempest-TestShelveInstance-1616885335 None] Attempting download of 3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83 ((None, [{'url': 'file:///opt/stack/data/glance/images/3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83', 'metadata': {}}])) to volume d6bbb724-96b5-4489-9d81-8ada15b6ccee. {{(pid=87132) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 06 15:37:45 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[360d0324-d56d-404c-a691-564541a5b538]: (4, 'raw') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:37:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-16490450-5638-4c2e-aad8-fb4ef720b9b2 tempest-TestShelveInstance-1616885335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83_r_j_2kz4 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:37:45 devstack sudo[105398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83_r_j_2kz4 Nov 06 15:37:45 devstack sudo[105398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:37:46 devstack sudo[105398]: pam_unix(sudo:session): session closed for user root Nov 06 15:37:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-16490450-5638-4c2e-aad8-fb4ef720b9b2 tempest-TestShelveInstance-1616885335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83_r_j_2kz4" returned: 0 in 0.313s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:37:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-16490450-5638-4c2e-aad8-fb4ef720b9b2 tempest-TestShelveInstance-1616885335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83_r_j_2kz4 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:37:46 devstack sudo[105402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83_r_j_2kz4 Nov 06 15:37:46 devstack sudo[105402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:37:46 devstack sudo[105402]: pam_unix(sudo:session): session closed for user root Nov 06 15:37:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-16490450-5638-4c2e-aad8-fb4ef720b9b2 tempest-TestShelveInstance-1616885335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83_r_j_2kz4" returned: 1 in 0.314s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:37:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-16490450-5638-4c2e-aad8-fb4ef720b9b2 tempest-TestShelveInstance-1616885335 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83_r_j_2kz4' failed. Not Retrying. {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 15:37:46 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[dca42932-55c6-46ef-9dc6-6d80c3de45fb]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:37:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-16490450-5638-4c2e-aad8-fb4ef720b9b2 tempest-TestShelveInstance-1616885335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83_ii9r71ubdevstack@QuobyteHD {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:37:46 devstack sudo[105406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83_ii9r71ubdevstack@QuobyteHD Nov 06 15:37:46 devstack sudo[105406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:37:46 devstack sudo[105406]: pam_unix(sudo:session): session closed for user root Nov 06 15:37:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-16490450-5638-4c2e-aad8-fb4ef720b9b2 tempest-TestShelveInstance-1616885335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83_ii9r71ubdevstack@QuobyteHD" returned: 0 in 0.338s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:37:46 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-16490450-5638-4c2e-aad8-fb4ef720b9b2 tempest-TestShelveInstance-1616885335 None] 3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83 was qcow2, converting to qcow2 {{(pid=87132) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 06 15:37:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-16490450-5638-4c2e-aad8-fb4ef720b9b2 tempest-TestShelveInstance-1616885335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83_ii9r71ubdevstack@QuobyteHD /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d6bbb724-96b5-4489-9d81-8ada15b6ccee {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:37:46 devstack sudo[105411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83_ii9r71ubdevstack@QuobyteHD /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d6bbb724-96b5-4489-9d81-8ada15b6ccee Nov 06 15:37:46 devstack sudo[105411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:37:48 devstack sudo[105411]: pam_unix(sudo:session): session closed for user root Nov 06 15:37:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-16490450-5638-4c2e-aad8-fb4ef720b9b2 tempest-TestShelveInstance-1616885335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83_ii9r71ubdevstack@QuobyteHD /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d6bbb724-96b5-4489-9d81-8ada15b6ccee" returned: 0 in 1.581s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:37:48 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-16490450-5638-4c2e-aad8-fb4ef720b9b2 tempest-TestShelveInstance-1616885335 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83_ii9r71ubdevstack@QuobyteHD, size 112.00 MB, duration 1.58 sec, destination /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d6bbb724-96b5-4489-9d81-8ada15b6ccee {{(pid=87132) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 06 15:37:48 devstack cinder-volume[87132]: INFO cinder.image.image_utils [None req-16490450-5638-4c2e-aad8-fb4ef720b9b2 tempest-TestShelveInstance-1616885335 None] Converted 112.00 MB image at 70.80 MB/s Nov 06 15:37:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-16490450-5638-4c2e-aad8-fb4ef720b9b2 tempest-TestShelveInstance-1616885335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d6bbb724-96b5-4489-9d81-8ada15b6ccee 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:37:48 devstack sudo[105420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d6bbb724-96b5-4489-9d81-8ada15b6ccee 1G Nov 06 15:37:48 devstack sudo[105420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:37:48 devstack sudo[105420]: pam_unix(sudo:session): session closed for user root Nov 06 15:37:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-16490450-5638-4c2e-aad8-fb4ef720b9b2 tempest-TestShelveInstance-1616885335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d6bbb724-96b5-4489-9d81-8ada15b6ccee 1G" returned: 0 in 0.298s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:37:48 devstack cinder-volume[87132]: DEBUG cinder.volume.volume_utils [None req-16490450-5638-4c2e-aad8-fb4ef720b9b2 tempest-TestShelveInstance-1616885335 None] Downloaded image 3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83 ((None, [{'url': 'file:///opt/stack/data/glance/images/3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83', 'metadata': {}}])) to volume d6bbb724-96b5-4489-9d81-8ada15b6ccee successfully. {{(pid=87132) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 06 15:37:48 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-16490450-5638-4c2e-aad8-fb4ef720b9b2 tempest-TestShelveInstance-1616885335 None] Temporary image 3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83 for user 6c1f5a3b7258442384c51c7ad71cb55f is deleted. {{(pid=87132) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 06 15:37:48 devstack cinder-volume[87132]: DEBUG cinder.volume.volume_utils [None req-16490450-5638-4c2e-aad8-fb4ef720b9b2 tempest-TestShelveInstance-1616885335 None] Marking volume d6bbb724-96b5-4489-9d81-8ada15b6ccee as bootable. {{(pid=87132) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 06 15:37:48 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-16490450-5638-4c2e-aad8-fb4ef720b9b2 tempest-TestShelveInstance-1616885335 None] Copying metadata from image 3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83 to d6bbb724-96b5-4489-9d81-8ada15b6ccee. {{(pid=87132) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 06 15:37:48 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-16490450-5638-4c2e-aad8-fb4ef720b9b2 tempest-TestShelveInstance-1616885335 None] Creating volume glance metadata for volume d6bbb724-96b5-4489-9d81-8ada15b6ccee backed by image 3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87132) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 06 15:37:48 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-16490450-5638-4c2e-aad8-fb4ef720b9b2 tempest-TestShelveInstance-1616885335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a4b1125-f233-4476-891a-19cb949798ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6bbb724-96b5-4489-9d81-8ada15b6ccee', 'volume_size': 1, 'image_id': '3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c02e84193ee841ccb304f909f5951fd0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83', 'created_at': datetime.datetime(2026, 11, 6, 14, 12, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 14, 12, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3d43de62-a61a-4b32-b8cb-bd2d9b2e2e83/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:37:48 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-16490450-5638-4c2e-aad8-fb4ef720b9b2 tempest-TestShelveInstance-1616885335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff1a64b8-85f2-42c4-a309-764af2a7624d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:37:48 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-16490450-5638-4c2e-aad8-fb4ef720b9b2 tempest-TestShelveInstance-1616885335 None] Volume volume-d6bbb724-96b5-4489-9d81-8ada15b6ccee (d6bbb724-96b5-4489-9d81-8ada15b6ccee): created successfully Nov 06 15:37:48 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-16490450-5638-4c2e-aad8-fb4ef720b9b2 tempest-TestShelveInstance-1616885335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff1a64b8-85f2-42c4-a309-764af2a7624d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:37:48 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-16490450-5638-4c2e-aad8-fb4ef720b9b2 tempest-TestShelveInstance-1616885335 None] Flow 'volume_create_manager' (4d350bbd-f26b-4dc0-95fe-4de3c542f794) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:37:48 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-16490450-5638-4c2e-aad8-fb4ef720b9b2 tempest-TestShelveInstance-1616885335 None] Created volume successfully. Nov 06 15:37:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-335efe25-ebca-4b77-9ffa-bedfb3669e33 req-2066b117-f193-47db-a53d-969ae848406a tempest-TestShelveInstance-1616885335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:37:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-335efe25-ebca-4b77-9ffa-bedfb3669e33 req-2066b117-f193-47db-a53d-969ae848406a tempest-TestShelveInstance-1616885335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:37:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-335efe25-ebca-4b77-9ffa-bedfb3669e33 req-2066b117-f193-47db-a53d-969ae848406a tempest-TestShelveInstance-1616885335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:37:52 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-335efe25-ebca-4b77-9ffa-bedfb3669e33 req-2066b117-f193-47db-a53d-969ae848406a tempest-TestShelveInstance-1616885335 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b', 'name': 'volume-d6bbb724-96b5-4489-9d81-8ada15b6ccee', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7a3810f4-f3bc-4443-b409-c2aae8f258bc', 'enforce_multipath': True} {{(pid=87132) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 15:37:52 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-335efe25-ebca-4b77-9ffa-bedfb3669e33 req-2066b117-f193-47db-a53d-969ae848406a tempest-TestShelveInstance-1616885335 None] attachment_update completed successfully. Nov 06 15:38:02 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:SELECT=15,cinder:INSERT=10,cinder:UPDATE=6,cinder:DELETE=1 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 15:38:02 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:UPDATE=6,cinder:SELECT=17,cinder:INSERT=4 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 15:38:08 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Running periodic task VolumeManager._thread_info {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 15:38:08 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] thread count: 28 {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 15:38:08 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] thread info: [<_MainThread(MainThread, started 140011251929216)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 06 15:38:22 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-d6392741-887e-4c51-adaa-45ceb05a5611 req-b401dfba-caee-4969-b853-bcc04b047b5b tempest-TestShelveInstance-1616885335 None] Terminate volume connection completed successfully. Nov 06 15:38:22 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-d6392741-887e-4c51-adaa-45ceb05a5611 req-b401dfba-caee-4969-b853-bcc04b047b5b tempest-TestShelveInstance-1616885335 None] Deleting attachment 7a3810f4-f3bc-4443-b409-c2aae8f258bc. {{(pid=87132) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 06 15:38:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-f6bc352f-aaa1-4e38-bca5-ef64f8da7c1a req-35f1c639-9a9d-4e1a-b313-72fe19e8f46c tempest-TestShelveInstance-1616885335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:38:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-f6bc352f-aaa1-4e38-bca5-ef64f8da7c1a req-35f1c639-9a9d-4e1a-b313-72fe19e8f46c tempest-TestShelveInstance-1616885335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:38:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-f6bc352f-aaa1-4e38-bca5-ef64f8da7c1a req-35f1c639-9a9d-4e1a-b313-72fe19e8f46c tempest-TestShelveInstance-1616885335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.010s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:38:24 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-f6bc352f-aaa1-4e38-bca5-ef64f8da7c1a req-35f1c639-9a9d-4e1a-b313-72fe19e8f46c tempest-TestShelveInstance-1616885335 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b', 'name': 'volume-d6bbb724-96b5-4489-9d81-8ada15b6ccee', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd2c08b0d-1dab-478d-8c0f-090a0e041a03', 'enforce_multipath': True} {{(pid=87132) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 15:38:24 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-f6bc352f-aaa1-4e38-bca5-ef64f8da7c1a req-35f1c639-9a9d-4e1a-b313-72fe19e8f46c tempest-TestShelveInstance-1616885335 None] attachment_update completed successfully. Nov 06 15:38:34 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 15:38:34 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 15:38:50 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-242bdbec-e32b-4921-a949-020b55bcdc51 req-329847db-fd00-4b29-92aa-abcb821ba9f8 tempest-TestShelveInstance-1616885335 None] Terminate volume connection completed successfully. Nov 06 15:38:50 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-242bdbec-e32b-4921-a949-020b55bcdc51 req-329847db-fd00-4b29-92aa-abcb821ba9f8 tempest-TestShelveInstance-1616885335 None] Deleting attachment d2c08b0d-1dab-478d-8c0f-090a0e041a03. {{(pid=87132) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 06 15:38:51 devstack cinder-volume[87132]: DEBUG cinder.coordination [req-242bdbec-e32b-4921-a949-020b55bcdc51 req-e1a9d130-7b71-46b2-9929-51a790aba382 tempest-TestShelveInstance-1616885335 None] Acquiring lock "cinder-d6bbb724-96b5-4489-9d81-8ada15b6ccee-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:38:51 devstack cinder-volume[87132]: DEBUG cinder.coordination [req-242bdbec-e32b-4921-a949-020b55bcdc51 req-e1a9d130-7b71-46b2-9929-51a790aba382 tempest-TestShelveInstance-1616885335 None] Lock "cinder-d6bbb724-96b5-4489-9d81-8ada15b6ccee-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:38:51 devstack cinder-volume[87132]: DEBUG cinder.coordination [req-242bdbec-e32b-4921-a949-020b55bcdc51 req-e1a9d130-7b71-46b2-9929-51a790aba382 tempest-TestShelveInstance-1616885335 None] Acquiring lock "cinder-quobyte-d6bbb724-96b5-4489-9d81-8ada15b6ccee" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:38:51 devstack cinder-volume[87132]: DEBUG cinder.coordination [req-242bdbec-e32b-4921-a949-020b55bcdc51 req-e1a9d130-7b71-46b2-9929-51a790aba382 tempest-TestShelveInstance-1616885335 None] Lock "cinder-quobyte-d6bbb724-96b5-4489-9d81-8ada15b6ccee" acquired by "delete_volume" :: waited 0.015s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:38:51 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c060a01-f8e0-4afc-982e-5dd48285d9f9]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:38:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-242bdbec-e32b-4921-a949-020b55bcdc51 req-e1a9d130-7b71-46b2-9929-51a790aba382 tempest-TestShelveInstance-1616885335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d6bbb724-96b5-4489-9d81-8ada15b6ccee {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:38:51 devstack sudo[106612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d6bbb724-96b5-4489-9d81-8ada15b6ccee Nov 06 15:38:51 devstack sudo[106612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:38:51 devstack sudo[106612]: pam_unix(sudo:session): session closed for user root Nov 06 15:38:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-242bdbec-e32b-4921-a949-020b55bcdc51 req-e1a9d130-7b71-46b2-9929-51a790aba382 tempest-TestShelveInstance-1616885335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d6bbb724-96b5-4489-9d81-8ada15b6ccee" returned: 0 in 0.388s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:38:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-242bdbec-e32b-4921-a949-020b55bcdc51 req-e1a9d130-7b71-46b2-9929-51a790aba382 tempest-TestShelveInstance-1616885335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d6bbb724-96b5-4489-9d81-8ada15b6ccee {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:38:51 devstack sudo[106617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d6bbb724-96b5-4489-9d81-8ada15b6ccee Nov 06 15:38:51 devstack sudo[106617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:38:51 devstack sudo[106617]: pam_unix(sudo:session): session closed for user root Nov 06 15:38:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-242bdbec-e32b-4921-a949-020b55bcdc51 req-e1a9d130-7b71-46b2-9929-51a790aba382 tempest-TestShelveInstance-1616885335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d6bbb724-96b5-4489-9d81-8ada15b6ccee" returned: 0 in 0.263s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:38:51 devstack cinder-volume[87132]: DEBUG cinder.coordination [req-242bdbec-e32b-4921-a949-020b55bcdc51 req-e1a9d130-7b71-46b2-9929-51a790aba382 tempest-TestShelveInstance-1616885335 None] Lock "cinder-quobyte-d6bbb724-96b5-4489-9d81-8ada15b6ccee" released by "delete_volume" :: held 0.699s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:38:51 devstack cinder-volume[87132]: DEBUG cinder.quota [req-242bdbec-e32b-4921-a949-020b55bcdc51 req-e1a9d130-7b71-46b2-9929-51a790aba382 tempest-TestShelveInstance-1616885335 None] Created reservations ['b90931fc-0e33-47eb-9d4c-369a73fd2a3d', '1002e890-d3eb-4710-9c60-60a243cf56a1', 'f04f1d66-23d0-427a-a521-9e69558a2a25', '99933213-9f78-4a06-973b-9dea0fc2a136'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:38:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-242bdbec-e32b-4921-a949-020b55bcdc51 req-e1a9d130-7b71-46b2-9929-51a790aba382 tempest-TestShelveInstance-1616885335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:38:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-242bdbec-e32b-4921-a949-020b55bcdc51 req-e1a9d130-7b71-46b2-9929-51a790aba382 tempest-TestShelveInstance-1616885335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:38:51 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [req-242bdbec-e32b-4921-a949-020b55bcdc51 req-e1a9d130-7b71-46b2-9929-51a790aba382 tempest-TestShelveInstance-1616885335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:38:51 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [req-242bdbec-e32b-4921-a949-020b55bcdc51 req-e1a9d130-7b71-46b2-9929-51a790aba382 tempest-TestShelveInstance-1616885335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:38:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-242bdbec-e32b-4921-a949-020b55bcdc51 req-e1a9d130-7b71-46b2-9929-51a790aba382 tempest-TestShelveInstance-1616885335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:38:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-242bdbec-e32b-4921-a949-020b55bcdc51 req-e1a9d130-7b71-46b2-9929-51a790aba382 tempest-TestShelveInstance-1616885335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:38:51 devstack sudo[106620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:38:51 devstack sudo[106620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:38:52 devstack sudo[106620]: pam_unix(sudo:session): session closed for user root Nov 06 15:38:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-242bdbec-e32b-4921-a949-020b55bcdc51 req-e1a9d130-7b71-46b2-9929-51a790aba382 tempest-TestShelveInstance-1616885335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.264s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:38:52 devstack cinder-volume[87132]: DEBUG cinder.manager [req-242bdbec-e32b-4921-a949-020b55bcdc51 req-e1a9d130-7b71-46b2-9929-51a790aba382 tempest-TestShelveInstance-1616885335 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:38:52 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-242bdbec-e32b-4921-a949-020b55bcdc51 req-e1a9d130-7b71-46b2-9929-51a790aba382 tempest-TestShelveInstance-1616885335 None] Deleted volume successfully. Nov 06 15:38:52 devstack cinder-volume[87132]: DEBUG cinder.coordination [req-242bdbec-e32b-4921-a949-020b55bcdc51 req-e1a9d130-7b71-46b2-9929-51a790aba382 tempest-TestShelveInstance-1616885335 None] Lock "cinder-d6bbb724-96b5-4489-9d81-8ada15b6ccee-delete_volume" released by "delete_volume" :: held 1.155s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:39:02 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=7,cinder:DELETE=1 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 15:39:04 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:SELECT=7,cinder:UPDATE=10,cinder:INSERT=3 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 15:39:08 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 15:39:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:39:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:39:08 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:39:08 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:39:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:39:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:39:08 devstack sudo[106674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:39:08 devstack sudo[106674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:39:08 devstack sudo[106674]: pam_unix(sudo:session): session closed for user root Nov 06 15:39:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.254s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:39:08 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:39:08 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Running periodic task VolumeManager._thread_info {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 15:39:08 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] thread count: 28 {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 15:39:08 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] thread info: [<_MainThread(MainThread, started 140011251929216)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 06 15:39:21 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-0289452b-7daf-469b-8b5a-76bc736d8c32 tempest-TestImageHashVerification-1102953094 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:39:21 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0289452b-7daf-469b-8b5a-76bc736d8c32 tempest-TestImageHashVerification-1102953094 None] Flow 'volume_create_manager' (cbecf125-65c1-42aa-b5b4-befc60b8f643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:39:21 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0289452b-7daf-469b-8b5a-76bc736d8c32 tempest-TestImageHashVerification-1102953094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6802cf33-99e2-4721-b522-33f7b40478a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:39:21 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0289452b-7daf-469b-8b5a-76bc736d8c32 tempest-TestImageHashVerification-1102953094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6802cf33-99e2-4721-b522-33f7b40478a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:39:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-830828943',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f327fc54-b9ac-4054-aab1-dba258953299,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce75ea0659cd4848a5a25675e0653ec9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:39:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:39:22Z,use_quota=True,user_id='3e708a97bbd64c8a827babb96a089244',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:39:21 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0289452b-7daf-469b-8b5a-76bc736d8c32 tempest-TestImageHashVerification-1102953094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf680c91-0ba6-4014-9956-359954687b94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:39:21 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0289452b-7daf-469b-8b5a-76bc736d8c32 tempest-TestImageHashVerification-1102953094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf680c91-0ba6-4014-9956-359954687b94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:39:21 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0289452b-7daf-469b-8b5a-76bc736d8c32 tempest-TestImageHashVerification-1102953094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a75f437-09ba-488b-8b4c-5549377c45db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:39:21 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0289452b-7daf-469b-8b5a-76bc736d8c32 tempest-TestImageHashVerification-1102953094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a75f437-09ba-488b-8b4c-5549377c45db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f327fc54-b9ac-4054-aab1-dba258953299', 'volume_name': 'volume-f327fc54-b9ac-4054-aab1-dba258953299', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:39:21 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0289452b-7daf-469b-8b5a-76bc736d8c32 tempest-TestImageHashVerification-1102953094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd8f903d-2c2d-4921-a36a-66b757ce8927) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:39:21 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0289452b-7daf-469b-8b5a-76bc736d8c32 tempest-TestImageHashVerification-1102953094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd8f903d-2c2d-4921-a36a-66b757ce8927) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:39:21 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0289452b-7daf-469b-8b5a-76bc736d8c32 tempest-TestImageHashVerification-1102953094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4edfe00-cd74-40da-a80e-465d7ee50f90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:39:21 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-0289452b-7daf-469b-8b5a-76bc736d8c32 tempest-TestImageHashVerification-1102953094 None] Volume f327fc54-b9ac-4054-aab1-dba258953299: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f327fc54-b9ac-4054-aab1-dba258953299', 'volume_size': 1} Nov 06 15:39:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0289452b-7daf-469b-8b5a-76bc736d8c32 tempest-TestImageHashVerification-1102953094 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:39:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0289452b-7daf-469b-8b5a-76bc736d8c32 tempest-TestImageHashVerification-1102953094 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:39:21 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0289452b-7daf-469b-8b5a-76bc736d8c32 tempest-TestImageHashVerification-1102953094 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:39:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-830828943',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f327fc54-b9ac-4054-aab1-dba258953299,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce75ea0659cd4848a5a25675e0653ec9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:39:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:39:22Z,use_quota=True,user_id='3e708a97bbd64c8a827babb96a089244',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:39:21 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-0289452b-7daf-469b-8b5a-76bc736d8c32 tempest-TestImageHashVerification-1102953094 None] Creating volume f327fc54-b9ac-4054-aab1-dba258953299 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:39:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0289452b-7daf-469b-8b5a-76bc736d8c32 tempest-TestImageHashVerification-1102953094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:39:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0289452b-7daf-469b-8b5a-76bc736d8c32 tempest-TestImageHashVerification-1102953094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:39:21 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0289452b-7daf-469b-8b5a-76bc736d8c32 tempest-TestImageHashVerification-1102953094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:39:21 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0289452b-7daf-469b-8b5a-76bc736d8c32 tempest-TestImageHashVerification-1102953094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:39:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0289452b-7daf-469b-8b5a-76bc736d8c32 tempest-TestImageHashVerification-1102953094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:39:21 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0289452b-7daf-469b-8b5a-76bc736d8c32 tempest-TestImageHashVerification-1102953094 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:39:21 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-0289452b-7daf-469b-8b5a-76bc736d8c32 tempest-TestImageHashVerification-1102953094 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:39:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0289452b-7daf-469b-8b5a-76bc736d8c32 tempest-TestImageHashVerification-1102953094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f327fc54-b9ac-4054-aab1-dba258953299 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:39:21 devstack sudo[106680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f327fc54-b9ac-4054-aab1-dba258953299 1073741824 Nov 06 15:39:21 devstack sudo[106680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:39:22 devstack sudo[106680]: pam_unix(sudo:session): session closed for user root Nov 06 15:39:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0289452b-7daf-469b-8b5a-76bc736d8c32 tempest-TestImageHashVerification-1102953094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f327fc54-b9ac-4054-aab1-dba258953299 1073741824" returned: 0 in 0.419s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:39:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0289452b-7daf-469b-8b5a-76bc736d8c32 tempest-TestImageHashVerification-1102953094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f327fc54-b9ac-4054-aab1-dba258953299 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:39:22 devstack sudo[106687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f327fc54-b9ac-4054-aab1-dba258953299 Nov 06 15:39:22 devstack sudo[106687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:39:22 devstack sudo[106687]: pam_unix(sudo:session): session closed for user root Nov 06 15:39:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0289452b-7daf-469b-8b5a-76bc736d8c32 tempest-TestImageHashVerification-1102953094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f327fc54-b9ac-4054-aab1-dba258953299" returned: 0 in 0.235s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:39:22 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0289452b-7daf-469b-8b5a-76bc736d8c32 tempest-TestImageHashVerification-1102953094 None] <== create_volume: return (693ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:39:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0289452b-7daf-469b-8b5a-76bc736d8c32 tempest-TestImageHashVerification-1102953094 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.696s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:39:22 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0289452b-7daf-469b-8b5a-76bc736d8c32 tempest-TestImageHashVerification-1102953094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4edfe00-cd74-40da-a80e-465d7ee50f90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f327fc54-b9ac-4054-aab1-dba258953299', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:39:22 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0289452b-7daf-469b-8b5a-76bc736d8c32 tempest-TestImageHashVerification-1102953094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed9ed501-3815-48fc-96b6-406ffa37a4d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:39:22 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-0289452b-7daf-469b-8b5a-76bc736d8c32 tempest-TestImageHashVerification-1102953094 None] Volume volume-f327fc54-b9ac-4054-aab1-dba258953299 (f327fc54-b9ac-4054-aab1-dba258953299): created successfully Nov 06 15:39:22 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0289452b-7daf-469b-8b5a-76bc736d8c32 tempest-TestImageHashVerification-1102953094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed9ed501-3815-48fc-96b6-406ffa37a4d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:39:22 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0289452b-7daf-469b-8b5a-76bc736d8c32 tempest-TestImageHashVerification-1102953094 None] Flow 'volume_create_manager' (cbecf125-65c1-42aa-b5b4-befc60b8f643) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:39:22 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-0289452b-7daf-469b-8b5a-76bc736d8c32 tempest-TestImageHashVerification-1102953094 None] Created volume successfully. Nov 06 15:39:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-01f12847-53fa-4a46-a7f7-4b608b6fc8ea tempest-TestImageHashVerification-1102953094 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:39:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-01f12847-53fa-4a46-a7f7-4b608b6fc8ea tempest-TestImageHashVerification-1102953094 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:39:23 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[9202c12b-3cb5-40e4-b1bf-4ee2d75d08f2]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:39:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-01f12847-53fa-4a46-a7f7-4b608b6fc8ea tempest-TestImageHashVerification-1102953094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f327fc54-b9ac-4054-aab1-dba258953299 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:39:23 devstack sudo[106690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f327fc54-b9ac-4054-aab1-dba258953299 Nov 06 15:39:23 devstack sudo[106690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:39:23 devstack sudo[106690]: pam_unix(sudo:session): session closed for user root Nov 06 15:39:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-01f12847-53fa-4a46-a7f7-4b608b6fc8ea tempest-TestImageHashVerification-1102953094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f327fc54-b9ac-4054-aab1-dba258953299" returned: 0 in 0.368s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:39:23 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8b9cc68-da8e-4e01-a96a-e090decb5143]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:39:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-01f12847-53fa-4a46-a7f7-4b608b6fc8ea tempest-TestImageHashVerification-1102953094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f327fc54-b9ac-4054-aab1-dba258953299 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:39:23 devstack sudo[106695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f327fc54-b9ac-4054-aab1-dba258953299 Nov 06 15:39:23 devstack sudo[106695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:39:24 devstack sudo[106695]: pam_unix(sudo:session): session closed for user root Nov 06 15:39:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-01f12847-53fa-4a46-a7f7-4b608b6fc8ea tempest-TestImageHashVerification-1102953094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f327fc54-b9ac-4054-aab1-dba258953299" returned: 0 in 0.356s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:39:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-01f12847-53fa-4a46-a7f7-4b608b6fc8ea tempest-TestImageHashVerification-1102953094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f327fc54-b9ac-4054-aab1-dba258953299 /opt/stack/data/cinder/conversion/f327fc54-b9ac-4054-aab1-dba258953299.temp_image.67da2ffa-38bc-491a-8eaf-8ff8c6cb07be_b4iuedp.img {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:39:24 devstack sudo[106700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f327fc54-b9ac-4054-aab1-dba258953299 /opt/stack/data/cinder/conversion/f327fc54-b9ac-4054-aab1-dba258953299.temp_image.67da2ffa-38bc-491a-8eaf-8ff8c6cb07be_b4iuedp.img Nov 06 15:39:24 devstack sudo[106700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:39:30 devstack sudo[106700]: pam_unix(sudo:session): session closed for user root Nov 06 15:39:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-01f12847-53fa-4a46-a7f7-4b608b6fc8ea tempest-TestImageHashVerification-1102953094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f327fc54-b9ac-4054-aab1-dba258953299 /opt/stack/data/cinder/conversion/f327fc54-b9ac-4054-aab1-dba258953299.temp_image.67da2ffa-38bc-491a-8eaf-8ff8c6cb07be_b4iuedp.img" returned: 0 in 5.893s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:39:30 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d3ec15e-5679-488b-902f-15380e837a4e]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:39:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-01f12847-53fa-4a46-a7f7-4b608b6fc8ea tempest-TestImageHashVerification-1102953094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f327fc54-b9ac-4054-aab1-dba258953299 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:39:30 devstack sudo[106714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f327fc54-b9ac-4054-aab1-dba258953299 Nov 06 15:39:30 devstack sudo[106714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:39:30 devstack sudo[106714]: pam_unix(sudo:session): session closed for user root Nov 06 15:39:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-01f12847-53fa-4a46-a7f7-4b608b6fc8ea tempest-TestImageHashVerification-1102953094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f327fc54-b9ac-4054-aab1-dba258953299" returned: 0 in 0.528s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:39:30 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-01f12847-53fa-4a46-a7f7-4b608b6fc8ea tempest-TestImageHashVerification-1102953094 None] Image conversion details: src /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f327fc54-b9ac-4054-aab1-dba258953299, size 1024.00 MB, duration 5.89 sec, destination /opt/stack/data/cinder/conversion/f327fc54-b9ac-4054-aab1-dba258953299.temp_image.67da2ffa-38bc-491a-8eaf-8ff8c6cb07be_b4iuedp.img {{(pid=87132) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 06 15:39:30 devstack cinder-volume[87132]: INFO cinder.image.image_utils [None req-01f12847-53fa-4a46-a7f7-4b608b6fc8ea tempest-TestImageHashVerification-1102953094 None] Converted 1024.00 MB image at 173.72 MB/s Nov 06 15:39:30 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-01f12847-53fa-4a46-a7f7-4b608b6fc8ea tempest-TestImageHashVerification-1102953094 None] 67da2ffa-38bc-491a-8eaf-8ff8c6cb07be was raw, no need to convert to raw {{(pid=87132) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Nov 06 15:39:32 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:SELECT=3,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 15:39:40 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:UPDATE=3,cinder:SELECT=4,cinder:INSERT=1 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 15:39:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-01f12847-53fa-4a46-a7f7-4b608b6fc8ea tempest-TestImageHashVerification-1102953094 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 25.044s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:39:48 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-01f12847-53fa-4a46-a7f7-4b608b6fc8ea tempest-TestImageHashVerification-1102953094 None] Uploaded volume to glance image-id: 67da2ffa-38bc-491a-8eaf-8ff8c6cb07be. {{(pid=87132) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 06 15:39:48 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-01f12847-53fa-4a46-a7f7-4b608b6fc8ea tempest-TestImageHashVerification-1102953094 None] Copy volume to image completed successfully. Nov 06 15:39:50 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c7e21550-be9b-4847-8ab3-622a23d051dd tempest-TestImageHashVerification-1102953094 None] Acquiring lock "cinder-f327fc54-b9ac-4054-aab1-dba258953299-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:39:50 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c7e21550-be9b-4847-8ab3-622a23d051dd tempest-TestImageHashVerification-1102953094 None] Lock "cinder-f327fc54-b9ac-4054-aab1-dba258953299-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:39:50 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c7e21550-be9b-4847-8ab3-622a23d051dd tempest-TestImageHashVerification-1102953094 None] Acquiring lock "cinder-quobyte-f327fc54-b9ac-4054-aab1-dba258953299" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:39:50 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c7e21550-be9b-4847-8ab3-622a23d051dd tempest-TestImageHashVerification-1102953094 None] Lock "cinder-quobyte-f327fc54-b9ac-4054-aab1-dba258953299" acquired by "delete_volume" :: waited 0.020s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:39:50 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b6fb571-59c9-45fb-95dd-ff3c2e4447e1]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:39:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c7e21550-be9b-4847-8ab3-622a23d051dd tempest-TestImageHashVerification-1102953094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f327fc54-b9ac-4054-aab1-dba258953299 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:39:50 devstack sudo[106722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f327fc54-b9ac-4054-aab1-dba258953299 Nov 06 15:39:50 devstack sudo[106722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:39:50 devstack sudo[106722]: pam_unix(sudo:session): session closed for user root Nov 06 15:39:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c7e21550-be9b-4847-8ab3-622a23d051dd tempest-TestImageHashVerification-1102953094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f327fc54-b9ac-4054-aab1-dba258953299" returned: 0 in 0.359s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:39:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c7e21550-be9b-4847-8ab3-622a23d051dd tempest-TestImageHashVerification-1102953094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f327fc54-b9ac-4054-aab1-dba258953299 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:39:50 devstack sudo[106727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f327fc54-b9ac-4054-aab1-dba258953299 Nov 06 15:39:50 devstack sudo[106727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:39:50 devstack sudo[106727]: pam_unix(sudo:session): session closed for user root Nov 06 15:39:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c7e21550-be9b-4847-8ab3-622a23d051dd tempest-TestImageHashVerification-1102953094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f327fc54-b9ac-4054-aab1-dba258953299" returned: 0 in 0.243s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:39:50 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c7e21550-be9b-4847-8ab3-622a23d051dd tempest-TestImageHashVerification-1102953094 None] Lock "cinder-quobyte-f327fc54-b9ac-4054-aab1-dba258953299" released by "delete_volume" :: held 0.639s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:39:50 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-c7e21550-be9b-4847-8ab3-622a23d051dd tempest-TestImageHashVerification-1102953094 None] Created reservations ['e9f7fc55-ddf9-458a-9ec7-c5e8630863b1', '7b6f35f6-9f58-424e-afb4-aa410730d043', 'c8e8e321-80d1-4891-8342-e9ed319739bc', '248c77d9-f9aa-4f60-b97e-cda0c7961feb'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:39:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c7e21550-be9b-4847-8ab3-622a23d051dd tempest-TestImageHashVerification-1102953094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:39:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c7e21550-be9b-4847-8ab3-622a23d051dd tempest-TestImageHashVerification-1102953094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:39:50 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c7e21550-be9b-4847-8ab3-622a23d051dd tempest-TestImageHashVerification-1102953094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:39:50 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c7e21550-be9b-4847-8ab3-622a23d051dd tempest-TestImageHashVerification-1102953094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:39:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c7e21550-be9b-4847-8ab3-622a23d051dd tempest-TestImageHashVerification-1102953094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:39:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c7e21550-be9b-4847-8ab3-622a23d051dd tempest-TestImageHashVerification-1102953094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:39:50 devstack sudo[106730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:39:50 devstack sudo[106730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:39:51 devstack sudo[106730]: pam_unix(sudo:session): session closed for user root Nov 06 15:39:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c7e21550-be9b-4847-8ab3-622a23d051dd tempest-TestImageHashVerification-1102953094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.240s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:39:51 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-c7e21550-be9b-4847-8ab3-622a23d051dd tempest-TestImageHashVerification-1102953094 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:39:51 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-c7e21550-be9b-4847-8ab3-622a23d051dd tempest-TestImageHashVerification-1102953094 None] Deleted volume successfully. Nov 06 15:39:51 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c7e21550-be9b-4847-8ab3-622a23d051dd tempest-TestImageHashVerification-1102953094 None] Lock "cinder-f327fc54-b9ac-4054-aab1-dba258953299-delete_volume" released by "delete_volume" :: held 1.079s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:40:00 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:UPDATE=10,cinder:SELECT=5,cinder:INSERT=2 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 15:40:01 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:SELECT=6,cinder:UPDATE=7,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 15:40:02 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a095cef-b536-4e64-8e28-6fcb5ca0e8ec tempest-CreateVolumesFromSnapshotTest-1159372696 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:40:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3a095cef-b536-4e64-8e28-6fcb5ca0e8ec tempest-CreateVolumesFromSnapshotTest-1159372696 None] Flow 'volume_create_manager' (4e60e815-cc8b-425b-8242-dcd398bea30c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:40:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3a095cef-b536-4e64-8e28-6fcb5ca0e8ec tempest-CreateVolumesFromSnapshotTest-1159372696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2dba40ac-d7a3-424a-976a-7a809e0c332b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:40:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3a095cef-b536-4e64-8e28-6fcb5ca0e8ec tempest-CreateVolumesFromSnapshotTest-1159372696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2dba40ac-d7a3-424a-976a-7a809e0c332b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:40:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-822483995',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e6613bf-d0d7-4dce-814b-ee0c077b2b4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08988f0a2d51439e8c8727fc22e62fd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:40:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:40:02Z,use_quota=True,user_id='9a14a36421fb4924836827ffe3f51426',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:40:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3a095cef-b536-4e64-8e28-6fcb5ca0e8ec tempest-CreateVolumesFromSnapshotTest-1159372696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa779ffa-090f-478f-89c0-f7e92f08628d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:40:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3a095cef-b536-4e64-8e28-6fcb5ca0e8ec tempest-CreateVolumesFromSnapshotTest-1159372696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa779ffa-090f-478f-89c0-f7e92f08628d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:40:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3a095cef-b536-4e64-8e28-6fcb5ca0e8ec tempest-CreateVolumesFromSnapshotTest-1159372696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0956f24a-8183-47f7-8335-c0b501525e6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:40:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3a095cef-b536-4e64-8e28-6fcb5ca0e8ec tempest-CreateVolumesFromSnapshotTest-1159372696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0956f24a-8183-47f7-8335-c0b501525e6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e6613bf-d0d7-4dce-814b-ee0c077b2b4b', 'volume_name': 'volume-0e6613bf-d0d7-4dce-814b-ee0c077b2b4b', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:40:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3a095cef-b536-4e64-8e28-6fcb5ca0e8ec tempest-CreateVolumesFromSnapshotTest-1159372696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (535e819c-d5b4-45f4-8943-005748321d81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:40:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3a095cef-b536-4e64-8e28-6fcb5ca0e8ec tempest-CreateVolumesFromSnapshotTest-1159372696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (535e819c-d5b4-45f4-8943-005748321d81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:40:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3a095cef-b536-4e64-8e28-6fcb5ca0e8ec tempest-CreateVolumesFromSnapshotTest-1159372696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc3ef431-c67d-4bd1-8796-97c98356881a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:40:02 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-3a095cef-b536-4e64-8e28-6fcb5ca0e8ec tempest-CreateVolumesFromSnapshotTest-1159372696 None] Volume 0e6613bf-d0d7-4dce-814b-ee0c077b2b4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e6613bf-d0d7-4dce-814b-ee0c077b2b4b', 'volume_size': 1} Nov 06 15:40:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3a095cef-b536-4e64-8e28-6fcb5ca0e8ec tempest-CreateVolumesFromSnapshotTest-1159372696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:40:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3a095cef-b536-4e64-8e28-6fcb5ca0e8ec tempest-CreateVolumesFromSnapshotTest-1159372696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:40:02 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3a095cef-b536-4e64-8e28-6fcb5ca0e8ec tempest-CreateVolumesFromSnapshotTest-1159372696 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:40:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-822483995',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e6613bf-d0d7-4dce-814b-ee0c077b2b4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08988f0a2d51439e8c8727fc22e62fd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:40:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:40:02Z,use_quota=True,user_id='9a14a36421fb4924836827ffe3f51426',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:40:02 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-3a095cef-b536-4e64-8e28-6fcb5ca0e8ec tempest-CreateVolumesFromSnapshotTest-1159372696 None] Creating volume 0e6613bf-d0d7-4dce-814b-ee0c077b2b4b {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:40:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3a095cef-b536-4e64-8e28-6fcb5ca0e8ec tempest-CreateVolumesFromSnapshotTest-1159372696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:40:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3a095cef-b536-4e64-8e28-6fcb5ca0e8ec tempest-CreateVolumesFromSnapshotTest-1159372696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:40:02 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3a095cef-b536-4e64-8e28-6fcb5ca0e8ec tempest-CreateVolumesFromSnapshotTest-1159372696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:40:02 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3a095cef-b536-4e64-8e28-6fcb5ca0e8ec tempest-CreateVolumesFromSnapshotTest-1159372696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:40:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3a095cef-b536-4e64-8e28-6fcb5ca0e8ec tempest-CreateVolumesFromSnapshotTest-1159372696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:40:02 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3a095cef-b536-4e64-8e28-6fcb5ca0e8ec tempest-CreateVolumesFromSnapshotTest-1159372696 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:40:02 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-3a095cef-b536-4e64-8e28-6fcb5ca0e8ec tempest-CreateVolumesFromSnapshotTest-1159372696 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:40:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3a095cef-b536-4e64-8e28-6fcb5ca0e8ec tempest-CreateVolumesFromSnapshotTest-1159372696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0e6613bf-d0d7-4dce-814b-ee0c077b2b4b 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:40:02 devstack sudo[106786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0e6613bf-d0d7-4dce-814b-ee0c077b2b4b 1073741824 Nov 06 15:40:02 devstack sudo[106786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:40:02 devstack sudo[106786]: pam_unix(sudo:session): session closed for user root Nov 06 15:40:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3a095cef-b536-4e64-8e28-6fcb5ca0e8ec tempest-CreateVolumesFromSnapshotTest-1159372696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0e6613bf-d0d7-4dce-814b-ee0c077b2b4b 1073741824" returned: 0 in 0.409s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:40:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3a095cef-b536-4e64-8e28-6fcb5ca0e8ec tempest-CreateVolumesFromSnapshotTest-1159372696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0e6613bf-d0d7-4dce-814b-ee0c077b2b4b {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:40:02 devstack sudo[106791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0e6613bf-d0d7-4dce-814b-ee0c077b2b4b Nov 06 15:40:02 devstack sudo[106791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:40:02 devstack sudo[106791]: pam_unix(sudo:session): session closed for user root Nov 06 15:40:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3a095cef-b536-4e64-8e28-6fcb5ca0e8ec tempest-CreateVolumesFromSnapshotTest-1159372696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0e6613bf-d0d7-4dce-814b-ee0c077b2b4b" returned: 0 in 0.249s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:40:02 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3a095cef-b536-4e64-8e28-6fcb5ca0e8ec tempest-CreateVolumesFromSnapshotTest-1159372696 None] <== create_volume: return (701ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:40:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3a095cef-b536-4e64-8e28-6fcb5ca0e8ec tempest-CreateVolumesFromSnapshotTest-1159372696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.704s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:40:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3a095cef-b536-4e64-8e28-6fcb5ca0e8ec tempest-CreateVolumesFromSnapshotTest-1159372696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc3ef431-c67d-4bd1-8796-97c98356881a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e6613bf-d0d7-4dce-814b-ee0c077b2b4b', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:40:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3a095cef-b536-4e64-8e28-6fcb5ca0e8ec tempest-CreateVolumesFromSnapshotTest-1159372696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99b64c54-bb25-4852-9215-b793cba37eb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:40:02 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-3a095cef-b536-4e64-8e28-6fcb5ca0e8ec tempest-CreateVolumesFromSnapshotTest-1159372696 None] Volume volume-0e6613bf-d0d7-4dce-814b-ee0c077b2b4b (0e6613bf-d0d7-4dce-814b-ee0c077b2b4b): created successfully Nov 06 15:40:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3a095cef-b536-4e64-8e28-6fcb5ca0e8ec tempest-CreateVolumesFromSnapshotTest-1159372696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99b64c54-bb25-4852-9215-b793cba37eb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:40:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3a095cef-b536-4e64-8e28-6fcb5ca0e8ec tempest-CreateVolumesFromSnapshotTest-1159372696 None] Flow 'volume_create_manager' (4e60e815-cc8b-425b-8242-dcd398bea30c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:40:02 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-3a095cef-b536-4e64-8e28-6fcb5ca0e8ec tempest-CreateVolumesFromSnapshotTest-1159372696 None] Created volume successfully. Nov 06 15:40:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-433d40d4-58b3-45fa-a078-057142782a9c tempest-CreateVolumesFromSnapshotTest-1159372696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:40:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-433d40d4-58b3-45fa-a078-057142782a9c tempest-CreateVolumesFromSnapshotTest-1159372696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:40:03 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-433d40d4-58b3-45fa-a078-057142782a9c tempest-CreateVolumesFromSnapshotTest-1159372696 None] Creating offline snapshot 6526bed3-4c3a-40a6-bc61-c37fa1e45d77 of volume 0e6613bf-d0d7-4dce-814b-ee0c077b2b4b {{(pid=87132) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 15:40:03 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[f995ab18-26da-444d-8ae4-3d51cd650e92]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:40:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-433d40d4-58b3-45fa-a078-057142782a9c tempest-CreateVolumesFromSnapshotTest-1159372696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0e6613bf-d0d7-4dce-814b-ee0c077b2b4b {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:40:03 devstack sudo[106794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0e6613bf-d0d7-4dce-814b-ee0c077b2b4b Nov 06 15:40:03 devstack sudo[106794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:40:03 devstack sudo[106794]: pam_unix(sudo:session): session closed for user root Nov 06 15:40:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-433d40d4-58b3-45fa-a078-057142782a9c tempest-CreateVolumesFromSnapshotTest-1159372696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0e6613bf-d0d7-4dce-814b-ee0c077b2b4b" returned: 0 in 0.352s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:40:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-433d40d4-58b3-45fa-a078-057142782a9c tempest-CreateVolumesFromSnapshotTest-1159372696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0e6613bf-d0d7-4dce-814b-ee0c077b2b4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0e6613bf-d0d7-4dce-814b-ee0c077b2b4b.6526bed3-4c3a-40a6-bc61-c37fa1e45d77 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:40:03 devstack sudo[106799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0e6613bf-d0d7-4dce-814b-ee0c077b2b4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0e6613bf-d0d7-4dce-814b-ee0c077b2b4b.6526bed3-4c3a-40a6-bc61-c37fa1e45d77 1G Nov 06 15:40:03 devstack sudo[106799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:40:03 devstack sudo[106799]: pam_unix(sudo:session): session closed for user root Nov 06 15:40:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-433d40d4-58b3-45fa-a078-057142782a9c tempest-CreateVolumesFromSnapshotTest-1159372696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0e6613bf-d0d7-4dce-814b-ee0c077b2b4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0e6613bf-d0d7-4dce-814b-ee0c077b2b4b.6526bed3-4c3a-40a6-bc61-c37fa1e45d77 1G" returned: 0 in 0.395s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:40:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-433d40d4-58b3-45fa-a078-057142782a9c tempest-CreateVolumesFromSnapshotTest-1159372696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e6613bf-d0d7-4dce-814b-ee0c077b2b4b -F qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0e6613bf-d0d7-4dce-814b-ee0c077b2b4b.6526bed3-4c3a-40a6-bc61-c37fa1e45d77 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:40:04 devstack sudo[106804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e6613bf-d0d7-4dce-814b-ee0c077b2b4b -F qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0e6613bf-d0d7-4dce-814b-ee0c077b2b4b.6526bed3-4c3a-40a6-bc61-c37fa1e45d77 Nov 06 15:40:04 devstack sudo[106804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:40:04 devstack sudo[106804]: pam_unix(sudo:session): session closed for user root Nov 06 15:40:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-433d40d4-58b3-45fa-a078-057142782a9c tempest-CreateVolumesFromSnapshotTest-1159372696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e6613bf-d0d7-4dce-814b-ee0c077b2b4b -F qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0e6613bf-d0d7-4dce-814b-ee0c077b2b4b.6526bed3-4c3a-40a6-bc61-c37fa1e45d77" returned: 0 in 0.308s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:40:04 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-433d40d4-58b3-45fa-a078-057142782a9c tempest-CreateVolumesFromSnapshotTest-1159372696 None] /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0e6613bf-d0d7-4dce-814b-ee0c077b2b4b.6526bed3-4c3a-40a6-bc61-c37fa1e45d77 is being set with open permissions: ugo+rw Nov 06 15:40:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-433d40d4-58b3-45fa-a078-057142782a9c tempest-CreateVolumesFromSnapshotTest-1159372696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0e6613bf-d0d7-4dce-814b-ee0c077b2b4b.6526bed3-4c3a-40a6-bc61-c37fa1e45d77 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:40:04 devstack sudo[106809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0e6613bf-d0d7-4dce-814b-ee0c077b2b4b.6526bed3-4c3a-40a6-bc61-c37fa1e45d77 Nov 06 15:40:04 devstack sudo[106809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:40:04 devstack sudo[106809]: pam_unix(sudo:session): session closed for user root Nov 06 15:40:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-433d40d4-58b3-45fa-a078-057142782a9c tempest-CreateVolumesFromSnapshotTest-1159372696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0e6613bf-d0d7-4dce-814b-ee0c077b2b4b.6526bed3-4c3a-40a6-bc61-c37fa1e45d77" returned: 0 in 0.234s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:40:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-433d40d4-58b3-45fa-a078-057142782a9c tempest-CreateVolumesFromSnapshotTest-1159372696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0e6613bf-d0d7-4dce-814b-ee0c077b2b4b.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:40:04 devstack sudo[106812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0e6613bf-d0d7-4dce-814b-ee0c077b2b4b.info Nov 06 15:40:04 devstack sudo[106812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:40:04 devstack sudo[106812]: pam_unix(sudo:session): session closed for user root Nov 06 15:40:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-433d40d4-58b3-45fa-a078-057142782a9c tempest-CreateVolumesFromSnapshotTest-1159372696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0e6613bf-d0d7-4dce-814b-ee0c077b2b4b.info" returned: 0 in 0.249s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:40:04 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-433d40d4-58b3-45fa-a078-057142782a9c tempest-CreateVolumesFromSnapshotTest-1159372696 None] /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0e6613bf-d0d7-4dce-814b-ee0c077b2b4b.info is being set with open permissions: ugo+rw Nov 06 15:40:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-433d40d4-58b3-45fa-a078-057142782a9c tempest-CreateVolumesFromSnapshotTest-1159372696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0e6613bf-d0d7-4dce-814b-ee0c077b2b4b.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:40:04 devstack sudo[106815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0e6613bf-d0d7-4dce-814b-ee0c077b2b4b.info Nov 06 15:40:04 devstack sudo[106815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:40:05 devstack sudo[106815]: pam_unix(sudo:session): session closed for user root Nov 06 15:40:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-433d40d4-58b3-45fa-a078-057142782a9c tempest-CreateVolumesFromSnapshotTest-1159372696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0e6613bf-d0d7-4dce-814b-ee0c077b2b4b.info" returned: 0 in 0.255s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:40:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-433d40d4-58b3-45fa-a078-057142782a9c tempest-CreateVolumesFromSnapshotTest-1159372696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.875s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:40:05 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-433d40d4-58b3-45fa-a078-057142782a9c tempest-CreateVolumesFromSnapshotTest-1159372696 None] Create snapshot completed successfully Nov 06 15:40:05 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b7c7e88-c1b0-41f4-afcf-1c7aea0a3031 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:40:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3b7c7e88-c1b0-41f4-afcf-1c7aea0a3031 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Flow 'volume_create_manager' (5e5cc2aa-23b1-4871-991b-a0ea51377dd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:40:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3b7c7e88-c1b0-41f4-afcf-1c7aea0a3031 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (621e8850-94d0-44fe-aa9c-9be9462dabb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:40:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3b7c7e88-c1b0-41f4-afcf-1c7aea0a3031 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (621e8850-94d0-44fe-aa9c-9be9462dabb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:40:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-640579156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0276be22-a5a7-4685-bfbf-99b55563d585,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08988f0a2d51439e8c8727fc22e62fd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:40:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:40:06Z,use_quota=True,user_id='9a14a36421fb4924836827ffe3f51426',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:40:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3b7c7e88-c1b0-41f4-afcf-1c7aea0a3031 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67d0c74d-b626-41da-8941-fa7d9e9ef964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:40:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3b7c7e88-c1b0-41f4-afcf-1c7aea0a3031 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67d0c74d-b626-41da-8941-fa7d9e9ef964) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:40:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3b7c7e88-c1b0-41f4-afcf-1c7aea0a3031 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfdad387-c566-43f1-b0ec-0a4bc69883e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:40:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3b7c7e88-c1b0-41f4-afcf-1c7aea0a3031 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfdad387-c566-43f1-b0ec-0a4bc69883e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0276be22-a5a7-4685-bfbf-99b55563d585', 'volume_name': 'volume-0276be22-a5a7-4685-bfbf-99b55563d585', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:40:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3b7c7e88-c1b0-41f4-afcf-1c7aea0a3031 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e46e2ddc-1c67-4ef5-92f8-ea0a280c19ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:40:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3b7c7e88-c1b0-41f4-afcf-1c7aea0a3031 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e46e2ddc-1c67-4ef5-92f8-ea0a280c19ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:40:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3b7c7e88-c1b0-41f4-afcf-1c7aea0a3031 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60a1abca-7c2b-4a8b-9a17-a355020fc2b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:40:05 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-3b7c7e88-c1b0-41f4-afcf-1c7aea0a3031 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Volume 0276be22-a5a7-4685-bfbf-99b55563d585: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0276be22-a5a7-4685-bfbf-99b55563d585', 'volume_size': 1} Nov 06 15:40:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3b7c7e88-c1b0-41f4-afcf-1c7aea0a3031 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:40:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3b7c7e88-c1b0-41f4-afcf-1c7aea0a3031 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:40:05 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3b7c7e88-c1b0-41f4-afcf-1c7aea0a3031 tempest-CreateVolumesFromSnapshotTest-1159372696 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:40:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-640579156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0276be22-a5a7-4685-bfbf-99b55563d585,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08988f0a2d51439e8c8727fc22e62fd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:40:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:40:06Z,use_quota=True,user_id='9a14a36421fb4924836827ffe3f51426',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:40:05 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-3b7c7e88-c1b0-41f4-afcf-1c7aea0a3031 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Creating volume 0276be22-a5a7-4685-bfbf-99b55563d585 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:40:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3b7c7e88-c1b0-41f4-afcf-1c7aea0a3031 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:40:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3b7c7e88-c1b0-41f4-afcf-1c7aea0a3031 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:40:05 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3b7c7e88-c1b0-41f4-afcf-1c7aea0a3031 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:40:05 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3b7c7e88-c1b0-41f4-afcf-1c7aea0a3031 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:40:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3b7c7e88-c1b0-41f4-afcf-1c7aea0a3031 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:40:05 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3b7c7e88-c1b0-41f4-afcf-1c7aea0a3031 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:40:05 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-3b7c7e88-c1b0-41f4-afcf-1c7aea0a3031 tempest-CreateVolumesFromSnapshotTest-1159372696 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:40:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3b7c7e88-c1b0-41f4-afcf-1c7aea0a3031 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0276be22-a5a7-4685-bfbf-99b55563d585 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:40:05 devstack sudo[106819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0276be22-a5a7-4685-bfbf-99b55563d585 1073741824 Nov 06 15:40:05 devstack sudo[106819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:40:06 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa19e557-f32a-4848-a35e-0bddbe20aa09 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:40:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fa19e557-f32a-4848-a35e-0bddbe20aa09 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Flow 'volume_create_manager' (0895ef7d-1118-4575-a1d9-29334bcc0c42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:40:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fa19e557-f32a-4848-a35e-0bddbe20aa09 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6d23bb2-d64e-4938-bcac-8f983cd74fa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:40:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fa19e557-f32a-4848-a35e-0bddbe20aa09 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6d23bb2-d64e-4938-bcac-8f983cd74fa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:40:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1353819697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5416ade-2b1a-4099-bd44-aed88145709b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08988f0a2d51439e8c8727fc22e62fd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:40:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:40:06Z,use_quota=True,user_id='9a14a36421fb4924836827ffe3f51426',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:40:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fa19e557-f32a-4848-a35e-0bddbe20aa09 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0cf8d03-8673-4950-8501-7e22086bbbd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:40:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fa19e557-f32a-4848-a35e-0bddbe20aa09 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0cf8d03-8673-4950-8501-7e22086bbbd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:40:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fa19e557-f32a-4848-a35e-0bddbe20aa09 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b602cb4b-bc80-49d2-b5e4-da01bb2e7490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:40:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fa19e557-f32a-4848-a35e-0bddbe20aa09 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b602cb4b-bc80-49d2-b5e4-da01bb2e7490) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5416ade-2b1a-4099-bd44-aed88145709b', 'volume_name': 'volume-d5416ade-2b1a-4099-bd44-aed88145709b', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:40:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fa19e557-f32a-4848-a35e-0bddbe20aa09 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd39d379-2168-4570-8ed8-7b4e5583560d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:40:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fa19e557-f32a-4848-a35e-0bddbe20aa09 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd39d379-2168-4570-8ed8-7b4e5583560d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:40:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fa19e557-f32a-4848-a35e-0bddbe20aa09 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da6e6744-fe3e-4479-8579-1ad100572f3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:40:06 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-fa19e557-f32a-4848-a35e-0bddbe20aa09 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Volume d5416ade-2b1a-4099-bd44-aed88145709b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5416ade-2b1a-4099-bd44-aed88145709b', 'volume_size': 1} Nov 06 15:40:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-fa19e557-f32a-4848-a35e-0bddbe20aa09 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:40:06 devstack sudo[106819]: pam_unix(sudo:session): session closed for user root Nov 06 15:40:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3b7c7e88-c1b0-41f4-afcf-1c7aea0a3031 tempest-CreateVolumesFromSnapshotTest-1159372696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0276be22-a5a7-4685-bfbf-99b55563d585 1073741824" returned: 0 in 0.505s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:40:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3b7c7e88-c1b0-41f4-afcf-1c7aea0a3031 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0276be22-a5a7-4685-bfbf-99b55563d585 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:40:06 devstack sudo[106825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0276be22-a5a7-4685-bfbf-99b55563d585 Nov 06 15:40:06 devstack sudo[106825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:40:06 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-660eaf73-06ee-4220-8594-cffc1b9c7522 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:40:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-660eaf73-06ee-4220-8594-cffc1b9c7522 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Flow 'volume_create_manager' (3708da53-3595-4194-a29e-8216bd203a9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:40:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-660eaf73-06ee-4220-8594-cffc1b9c7522 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d05ea91-3536-44f7-86c7-9bd11f93da1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:40:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-660eaf73-06ee-4220-8594-cffc1b9c7522 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d05ea91-3536-44f7-86c7-9bd11f93da1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:40:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1005701397',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=990c9c52-5ecf-497c-81c3-83a18bc32c9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08988f0a2d51439e8c8727fc22e62fd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:40:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:40:06Z,use_quota=True,user_id='9a14a36421fb4924836827ffe3f51426',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:40:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-660eaf73-06ee-4220-8594-cffc1b9c7522 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a24b87b4-7ac7-4003-8072-a1ea9da7e3ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:40:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-660eaf73-06ee-4220-8594-cffc1b9c7522 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a24b87b4-7ac7-4003-8072-a1ea9da7e3ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:40:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-660eaf73-06ee-4220-8594-cffc1b9c7522 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21d1e884-6e94-4a67-a86a-28ded0620097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:40:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-660eaf73-06ee-4220-8594-cffc1b9c7522 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21d1e884-6e94-4a67-a86a-28ded0620097) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '990c9c52-5ecf-497c-81c3-83a18bc32c9e', 'volume_name': 'volume-990c9c52-5ecf-497c-81c3-83a18bc32c9e', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:40:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-660eaf73-06ee-4220-8594-cffc1b9c7522 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc607a3d-1ec4-4190-ab63-95d8d9a99823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:40:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-660eaf73-06ee-4220-8594-cffc1b9c7522 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc607a3d-1ec4-4190-ab63-95d8d9a99823) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:40:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-660eaf73-06ee-4220-8594-cffc1b9c7522 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52aeb312-f70e-4df8-8ab4-b80f8f39a0a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:40:06 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-660eaf73-06ee-4220-8594-cffc1b9c7522 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Volume 990c9c52-5ecf-497c-81c3-83a18bc32c9e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-990c9c52-5ecf-497c-81c3-83a18bc32c9e', 'volume_size': 1} Nov 06 15:40:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-660eaf73-06ee-4220-8594-cffc1b9c7522 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:40:06 devstack sudo[106825]: pam_unix(sudo:session): session closed for user root Nov 06 15:40:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3b7c7e88-c1b0-41f4-afcf-1c7aea0a3031 tempest-CreateVolumesFromSnapshotTest-1159372696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0276be22-a5a7-4685-bfbf-99b55563d585" returned: 0 in 0.261s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:40:06 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3b7c7e88-c1b0-41f4-afcf-1c7aea0a3031 tempest-CreateVolumesFromSnapshotTest-1159372696 None] <== create_volume: return (809ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:40:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3b7c7e88-c1b0-41f4-afcf-1c7aea0a3031 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.811s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:40:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-fa19e557-f32a-4848-a35e-0bddbe20aa09 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.425s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:40:06 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-fa19e557-f32a-4848-a35e-0bddbe20aa09 tempest-CreateVolumesFromSnapshotTest-1159372696 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:40:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1353819697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5416ade-2b1a-4099-bd44-aed88145709b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08988f0a2d51439e8c8727fc22e62fd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:40:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:40:06Z,use_quota=True,user_id='9a14a36421fb4924836827ffe3f51426',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:40:06 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-fa19e557-f32a-4848-a35e-0bddbe20aa09 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Creating volume d5416ade-2b1a-4099-bd44-aed88145709b {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:40:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-fa19e557-f32a-4848-a35e-0bddbe20aa09 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:40:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-fa19e557-f32a-4848-a35e-0bddbe20aa09 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:40:06 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-fa19e557-f32a-4848-a35e-0bddbe20aa09 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:40:06 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-fa19e557-f32a-4848-a35e-0bddbe20aa09 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:40:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-fa19e557-f32a-4848-a35e-0bddbe20aa09 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:40:06 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-fa19e557-f32a-4848-a35e-0bddbe20aa09 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:40:06 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-fa19e557-f32a-4848-a35e-0bddbe20aa09 tempest-CreateVolumesFromSnapshotTest-1159372696 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:40:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-fa19e557-f32a-4848-a35e-0bddbe20aa09 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d5416ade-2b1a-4099-bd44-aed88145709b 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:40:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3b7c7e88-c1b0-41f4-afcf-1c7aea0a3031 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60a1abca-7c2b-4a8b-9a17-a355020fc2b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0276be22-a5a7-4685-bfbf-99b55563d585', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:40:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3b7c7e88-c1b0-41f4-afcf-1c7aea0a3031 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (984ededb-a004-4d60-bdb8-af54d717412f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:40:06 devstack sudo[106828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d5416ade-2b1a-4099-bd44-aed88145709b 1073741824 Nov 06 15:40:06 devstack sudo[106828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:40:06 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-3b7c7e88-c1b0-41f4-afcf-1c7aea0a3031 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Volume volume-0276be22-a5a7-4685-bfbf-99b55563d585 (0276be22-a5a7-4685-bfbf-99b55563d585): created successfully Nov 06 15:40:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3b7c7e88-c1b0-41f4-afcf-1c7aea0a3031 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (984ededb-a004-4d60-bdb8-af54d717412f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:40:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3b7c7e88-c1b0-41f4-afcf-1c7aea0a3031 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Flow 'volume_create_manager' (5e5cc2aa-23b1-4871-991b-a0ea51377dd5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:40:06 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-3b7c7e88-c1b0-41f4-afcf-1c7aea0a3031 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Created volume successfully. Nov 06 15:40:06 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-203c7c59-6770-4f6f-97a8-962227f17469 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:40:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-203c7c59-6770-4f6f-97a8-962227f17469 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Flow 'volume_create_manager' (09a92498-b974-4d49-9102-79a14f883464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:40:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-203c7c59-6770-4f6f-97a8-962227f17469 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (645352b3-828c-4d03-9d02-aa46fba63863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:40:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-203c7c59-6770-4f6f-97a8-962227f17469 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (645352b3-828c-4d03-9d02-aa46fba63863) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:40:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1823235302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9507e4cb-62a8-4728-b721-ee2b83c589ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08988f0a2d51439e8c8727fc22e62fd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:40:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:40:07Z,use_quota=True,user_id='9a14a36421fb4924836827ffe3f51426',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:40:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-203c7c59-6770-4f6f-97a8-962227f17469 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff280679-0f76-42c7-9a6c-ccc4c4945030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:40:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-203c7c59-6770-4f6f-97a8-962227f17469 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff280679-0f76-42c7-9a6c-ccc4c4945030) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:40:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-203c7c59-6770-4f6f-97a8-962227f17469 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72ae408b-6287-4acb-a2af-8158be4520dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:40:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-203c7c59-6770-4f6f-97a8-962227f17469 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72ae408b-6287-4acb-a2af-8158be4520dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9507e4cb-62a8-4728-b721-ee2b83c589ae', 'volume_name': 'volume-9507e4cb-62a8-4728-b721-ee2b83c589ae', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:40:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-203c7c59-6770-4f6f-97a8-962227f17469 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a898d40-b7f2-46b0-a8e9-253bf18d0c03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:40:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-203c7c59-6770-4f6f-97a8-962227f17469 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a898d40-b7f2-46b0-a8e9-253bf18d0c03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:40:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-203c7c59-6770-4f6f-97a8-962227f17469 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ee1ce75-593f-4ba2-8392-02634f39c4bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:40:06 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-203c7c59-6770-4f6f-97a8-962227f17469 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Volume 9507e4cb-62a8-4728-b721-ee2b83c589ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9507e4cb-62a8-4728-b721-ee2b83c589ae', 'volume_size': 1} Nov 06 15:40:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-203c7c59-6770-4f6f-97a8-962227f17469 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:40:07 devstack sudo[106828]: pam_unix(sudo:session): session closed for user root Nov 06 15:40:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-fa19e557-f32a-4848-a35e-0bddbe20aa09 tempest-CreateVolumesFromSnapshotTest-1159372696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d5416ade-2b1a-4099-bd44-aed88145709b 1073741824" returned: 0 in 0.570s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:40:07 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-c596a780-4db0-44d9-b4ca-3a55ee421698 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:40:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c596a780-4db0-44d9-b4ca-3a55ee421698 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Flow 'volume_create_manager' (6a02b545-68e1-4e82-ac8a-0ca6907bd486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:40:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c596a780-4db0-44d9-b4ca-3a55ee421698 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ace773a-b88f-44e4-9acb-92f3190dc18b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:40:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c596a780-4db0-44d9-b4ca-3a55ee421698 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ace773a-b88f-44e4-9acb-92f3190dc18b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:40:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-744109373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c333b408-7596-46b2-83f3-6c338a7b7a1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08988f0a2d51439e8c8727fc22e62fd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:40:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:40:07Z,use_quota=True,user_id='9a14a36421fb4924836827ffe3f51426',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:40:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c596a780-4db0-44d9-b4ca-3a55ee421698 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bffe589-7841-4a5c-9e96-0b3c8b7f4a40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:40:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c596a780-4db0-44d9-b4ca-3a55ee421698 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bffe589-7841-4a5c-9e96-0b3c8b7f4a40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:40:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c596a780-4db0-44d9-b4ca-3a55ee421698 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c65b57c-7464-4c7b-8d2e-c4af4a969593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:40:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c596a780-4db0-44d9-b4ca-3a55ee421698 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c65b57c-7464-4c7b-8d2e-c4af4a969593) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c333b408-7596-46b2-83f3-6c338a7b7a1f', 'volume_name': 'volume-c333b408-7596-46b2-83f3-6c338a7b7a1f', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:40:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c596a780-4db0-44d9-b4ca-3a55ee421698 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fb0ef8a-8fe4-4f4b-8011-5f589b99a7cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:40:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c596a780-4db0-44d9-b4ca-3a55ee421698 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fb0ef8a-8fe4-4f4b-8011-5f589b99a7cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:40:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c596a780-4db0-44d9-b4ca-3a55ee421698 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e70c943-29be-4202-bb1c-dac65882c527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:40:07 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-c596a780-4db0-44d9-b4ca-3a55ee421698 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Volume c333b408-7596-46b2-83f3-6c338a7b7a1f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c333b408-7596-46b2-83f3-6c338a7b7a1f', 'volume_size': 1} Nov 06 15:40:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c596a780-4db0-44d9-b4ca-3a55ee421698 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:40:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-fa19e557-f32a-4848-a35e-0bddbe20aa09 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d5416ade-2b1a-4099-bd44-aed88145709b {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:40:07 devstack sudo[106834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d5416ade-2b1a-4099-bd44-aed88145709b Nov 06 15:40:07 devstack sudo[106834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:40:07 devstack sudo[106834]: pam_unix(sudo:session): session closed for user root Nov 06 15:40:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-fa19e557-f32a-4848-a35e-0bddbe20aa09 tempest-CreateVolumesFromSnapshotTest-1159372696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d5416ade-2b1a-4099-bd44-aed88145709b" returned: 0 in 0.230s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:40:07 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-fa19e557-f32a-4848-a35e-0bddbe20aa09 tempest-CreateVolumesFromSnapshotTest-1159372696 None] <== create_volume: return (909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:40:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-fa19e557-f32a-4848-a35e-0bddbe20aa09 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.912s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:40:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-660eaf73-06ee-4220-8594-cffc1b9c7522 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.994s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:40:07 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-660eaf73-06ee-4220-8594-cffc1b9c7522 tempest-CreateVolumesFromSnapshotTest-1159372696 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:40:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1005701397',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=990c9c52-5ecf-497c-81c3-83a18bc32c9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08988f0a2d51439e8c8727fc22e62fd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:40:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:40:06Z,use_quota=True,user_id='9a14a36421fb4924836827ffe3f51426',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:40:07 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-660eaf73-06ee-4220-8594-cffc1b9c7522 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Creating volume 990c9c52-5ecf-497c-81c3-83a18bc32c9e {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:40:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-660eaf73-06ee-4220-8594-cffc1b9c7522 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:40:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-660eaf73-06ee-4220-8594-cffc1b9c7522 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:40:07 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-660eaf73-06ee-4220-8594-cffc1b9c7522 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:40:07 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-660eaf73-06ee-4220-8594-cffc1b9c7522 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:40:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-660eaf73-06ee-4220-8594-cffc1b9c7522 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:40:07 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-660eaf73-06ee-4220-8594-cffc1b9c7522 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:40:07 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-660eaf73-06ee-4220-8594-cffc1b9c7522 tempest-CreateVolumesFromSnapshotTest-1159372696 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:40:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-660eaf73-06ee-4220-8594-cffc1b9c7522 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-990c9c52-5ecf-497c-81c3-83a18bc32c9e 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:40:07 devstack sudo[106837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-990c9c52-5ecf-497c-81c3-83a18bc32c9e 1073741824 Nov 06 15:40:07 devstack sudo[106837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:40:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fa19e557-f32a-4848-a35e-0bddbe20aa09 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da6e6744-fe3e-4479-8579-1ad100572f3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5416ade-2b1a-4099-bd44-aed88145709b', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:40:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fa19e557-f32a-4848-a35e-0bddbe20aa09 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b186e37d-4805-424e-b47a-154acbac7589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:40:07 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-fa19e557-f32a-4848-a35e-0bddbe20aa09 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Volume volume-d5416ade-2b1a-4099-bd44-aed88145709b (d5416ade-2b1a-4099-bd44-aed88145709b): created successfully Nov 06 15:40:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fa19e557-f32a-4848-a35e-0bddbe20aa09 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b186e37d-4805-424e-b47a-154acbac7589) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:40:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fa19e557-f32a-4848-a35e-0bddbe20aa09 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Flow 'volume_create_manager' (0895ef7d-1118-4575-a1d9-29334bcc0c42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:40:07 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-fa19e557-f32a-4848-a35e-0bddbe20aa09 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Created volume successfully. Nov 06 15:40:07 devstack sudo[106837]: pam_unix(sudo:session): session closed for user root Nov 06 15:40:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-660eaf73-06ee-4220-8594-cffc1b9c7522 tempest-CreateVolumesFromSnapshotTest-1159372696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-990c9c52-5ecf-497c-81c3-83a18bc32c9e 1073741824" returned: 0 in 0.392s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:40:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-660eaf73-06ee-4220-8594-cffc1b9c7522 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-990c9c52-5ecf-497c-81c3-83a18bc32c9e {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:40:07 devstack sudo[106843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-990c9c52-5ecf-497c-81c3-83a18bc32c9e Nov 06 15:40:07 devstack sudo[106843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:40:08 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 15:40:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:40:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:40:08 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:40:08 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:40:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:40:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:40:08 devstack sudo[106845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:40:08 devstack sudo[106845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:40:08 devstack sudo[106843]: pam_unix(sudo:session): session closed for user root Nov 06 15:40:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-660eaf73-06ee-4220-8594-cffc1b9c7522 tempest-CreateVolumesFromSnapshotTest-1159372696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-990c9c52-5ecf-497c-81c3-83a18bc32c9e" returned: 0 in 0.258s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:40:08 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-660eaf73-06ee-4220-8594-cffc1b9c7522 tempest-CreateVolumesFromSnapshotTest-1159372696 None] <== create_volume: return (686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:40:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-660eaf73-06ee-4220-8594-cffc1b9c7522 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.690s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:40:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-203c7c59-6770-4f6f-97a8-962227f17469 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.326s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:40:08 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-203c7c59-6770-4f6f-97a8-962227f17469 tempest-CreateVolumesFromSnapshotTest-1159372696 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:40:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1823235302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9507e4cb-62a8-4728-b721-ee2b83c589ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08988f0a2d51439e8c8727fc22e62fd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:40:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:40:07Z,use_quota=True,user_id='9a14a36421fb4924836827ffe3f51426',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:40:08 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-203c7c59-6770-4f6f-97a8-962227f17469 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Creating volume 9507e4cb-62a8-4728-b721-ee2b83c589ae {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:40:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-203c7c59-6770-4f6f-97a8-962227f17469 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:40:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-203c7c59-6770-4f6f-97a8-962227f17469 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:40:08 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-203c7c59-6770-4f6f-97a8-962227f17469 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:40:08 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-203c7c59-6770-4f6f-97a8-962227f17469 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:40:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-203c7c59-6770-4f6f-97a8-962227f17469 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:40:08 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-203c7c59-6770-4f6f-97a8-962227f17469 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:40:08 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-203c7c59-6770-4f6f-97a8-962227f17469 tempest-CreateVolumesFromSnapshotTest-1159372696 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:40:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-203c7c59-6770-4f6f-97a8-962227f17469 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-9507e4cb-62a8-4728-b721-ee2b83c589ae 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:40:08 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-660eaf73-06ee-4220-8594-cffc1b9c7522 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52aeb312-f70e-4df8-8ab4-b80f8f39a0a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-990c9c52-5ecf-497c-81c3-83a18bc32c9e', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:40:08 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-660eaf73-06ee-4220-8594-cffc1b9c7522 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79e01c75-9e4a-4cc9-a0d1-b1601efca02e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:40:08 devstack sudo[106848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-9507e4cb-62a8-4728-b721-ee2b83c589ae 1073741824 Nov 06 15:40:08 devstack sudo[106848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:40:08 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-660eaf73-06ee-4220-8594-cffc1b9c7522 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Volume volume-990c9c52-5ecf-497c-81c3-83a18bc32c9e (990c9c52-5ecf-497c-81c3-83a18bc32c9e): created successfully Nov 06 15:40:08 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-660eaf73-06ee-4220-8594-cffc1b9c7522 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79e01c75-9e4a-4cc9-a0d1-b1601efca02e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:40:08 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-660eaf73-06ee-4220-8594-cffc1b9c7522 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Flow 'volume_create_manager' (3708da53-3595-4194-a29e-8216bd203a9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:40:08 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-660eaf73-06ee-4220-8594-cffc1b9c7522 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Created volume successfully. Nov 06 15:40:08 devstack sudo[106845]: pam_unix(sudo:session): session closed for user root Nov 06 15:40:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.257s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:40:08 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:40:08 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Running periodic task VolumeManager._thread_info {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 15:40:08 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] thread count: 28 {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 15:40:08 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] thread info: [<_MainThread(MainThread, started 140011251929216)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 06 15:40:08 devstack sudo[106848]: pam_unix(sudo:session): session closed for user root Nov 06 15:40:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-203c7c59-6770-4f6f-97a8-962227f17469 tempest-CreateVolumesFromSnapshotTest-1159372696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-9507e4cb-62a8-4728-b721-ee2b83c589ae 1073741824" returned: 0 in 0.490s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:40:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-203c7c59-6770-4f6f-97a8-962227f17469 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-9507e4cb-62a8-4728-b721-ee2b83c589ae {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:40:08 devstack sudo[106856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-9507e4cb-62a8-4728-b721-ee2b83c589ae Nov 06 15:40:08 devstack sudo[106856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:40:08 devstack sudo[106856]: pam_unix(sudo:session): session closed for user root Nov 06 15:40:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-203c7c59-6770-4f6f-97a8-962227f17469 tempest-CreateVolumesFromSnapshotTest-1159372696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-9507e4cb-62a8-4728-b721-ee2b83c589ae" returned: 0 in 0.246s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:40:08 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-203c7c59-6770-4f6f-97a8-962227f17469 tempest-CreateVolumesFromSnapshotTest-1159372696 None] <== create_volume: return (780ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:40:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-203c7c59-6770-4f6f-97a8-962227f17469 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.784s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:40:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c596a780-4db0-44d9-b4ca-3a55ee421698 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.730s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:40:09 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c596a780-4db0-44d9-b4ca-3a55ee421698 tempest-CreateVolumesFromSnapshotTest-1159372696 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:40:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-744109373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c333b408-7596-46b2-83f3-6c338a7b7a1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08988f0a2d51439e8c8727fc22e62fd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:40:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:40:07Z,use_quota=True,user_id='9a14a36421fb4924836827ffe3f51426',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:40:09 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-c596a780-4db0-44d9-b4ca-3a55ee421698 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Creating volume c333b408-7596-46b2-83f3-6c338a7b7a1f {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:40:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c596a780-4db0-44d9-b4ca-3a55ee421698 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:40:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c596a780-4db0-44d9-b4ca-3a55ee421698 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:40:09 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c596a780-4db0-44d9-b4ca-3a55ee421698 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:40:09 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c596a780-4db0-44d9-b4ca-3a55ee421698 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:40:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c596a780-4db0-44d9-b4ca-3a55ee421698 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:40:09 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c596a780-4db0-44d9-b4ca-3a55ee421698 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:40:09 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-c596a780-4db0-44d9-b4ca-3a55ee421698 tempest-CreateVolumesFromSnapshotTest-1159372696 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:40:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c596a780-4db0-44d9-b4ca-3a55ee421698 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-c333b408-7596-46b2-83f3-6c338a7b7a1f 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:40:09 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-203c7c59-6770-4f6f-97a8-962227f17469 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ee1ce75-593f-4ba2-8392-02634f39c4bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9507e4cb-62a8-4728-b721-ee2b83c589ae', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:40:09 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-203c7c59-6770-4f6f-97a8-962227f17469 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79c18574-c93d-42a5-b742-5fee158143be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:40:09 devstack sudo[106859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-c333b408-7596-46b2-83f3-6c338a7b7a1f 1073741824 Nov 06 15:40:09 devstack sudo[106859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:40:09 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-203c7c59-6770-4f6f-97a8-962227f17469 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Volume volume-9507e4cb-62a8-4728-b721-ee2b83c589ae (9507e4cb-62a8-4728-b721-ee2b83c589ae): created successfully Nov 06 15:40:09 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-203c7c59-6770-4f6f-97a8-962227f17469 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79c18574-c93d-42a5-b742-5fee158143be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:40:09 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-203c7c59-6770-4f6f-97a8-962227f17469 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Flow 'volume_create_manager' (09a92498-b974-4d49-9102-79a14f883464) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:40:09 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-203c7c59-6770-4f6f-97a8-962227f17469 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Created volume successfully. Nov 06 15:40:09 devstack sudo[106859]: pam_unix(sudo:session): session closed for user root Nov 06 15:40:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c596a780-4db0-44d9-b4ca-3a55ee421698 tempest-CreateVolumesFromSnapshotTest-1159372696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-c333b408-7596-46b2-83f3-6c338a7b7a1f 1073741824" returned: 0 in 0.431s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:40:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c596a780-4db0-44d9-b4ca-3a55ee421698 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-c333b408-7596-46b2-83f3-6c338a7b7a1f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:40:09 devstack sudo[106865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-c333b408-7596-46b2-83f3-6c338a7b7a1f Nov 06 15:40:09 devstack sudo[106865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:40:09 devstack sudo[106865]: pam_unix(sudo:session): session closed for user root Nov 06 15:40:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c596a780-4db0-44d9-b4ca-3a55ee421698 tempest-CreateVolumesFromSnapshotTest-1159372696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-c333b408-7596-46b2-83f3-6c338a7b7a1f" returned: 0 in 0.244s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:40:09 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c596a780-4db0-44d9-b4ca-3a55ee421698 tempest-CreateVolumesFromSnapshotTest-1159372696 None] <== create_volume: return (713ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:40:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c596a780-4db0-44d9-b4ca-3a55ee421698 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.717s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:40:09 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c596a780-4db0-44d9-b4ca-3a55ee421698 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e70c943-29be-4202-bb1c-dac65882c527) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c333b408-7596-46b2-83f3-6c338a7b7a1f', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:40:09 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c596a780-4db0-44d9-b4ca-3a55ee421698 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7af54ad2-6e10-46f2-9b4c-10555e4df456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:40:09 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-c596a780-4db0-44d9-b4ca-3a55ee421698 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Volume volume-c333b408-7596-46b2-83f3-6c338a7b7a1f (c333b408-7596-46b2-83f3-6c338a7b7a1f): created successfully Nov 06 15:40:09 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c596a780-4db0-44d9-b4ca-3a55ee421698 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7af54ad2-6e10-46f2-9b4c-10555e4df456) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:40:09 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c596a780-4db0-44d9-b4ca-3a55ee421698 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Flow 'volume_create_manager' (6a02b545-68e1-4e82-ac8a-0ca6907bd486) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:40:09 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-c596a780-4db0-44d9-b4ca-3a55ee421698 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Created volume successfully. Nov 06 15:40:10 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-63d8595f-5308-4310-91a9-122fee4f74cf tempest-CreateVolumesFromSnapshotTest-1159372696 None] Acquiring lock "cinder-c333b408-7596-46b2-83f3-6c338a7b7a1f-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:40:10 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-63d8595f-5308-4310-91a9-122fee4f74cf tempest-CreateVolumesFromSnapshotTest-1159372696 None] Lock "cinder-c333b408-7596-46b2-83f3-6c338a7b7a1f-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:40:10 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-63d8595f-5308-4310-91a9-122fee4f74cf tempest-CreateVolumesFromSnapshotTest-1159372696 None] Acquiring lock "cinder-quobyte-c333b408-7596-46b2-83f3-6c338a7b7a1f" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:40:10 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-63d8595f-5308-4310-91a9-122fee4f74cf tempest-CreateVolumesFromSnapshotTest-1159372696 None] Lock "cinder-quobyte-c333b408-7596-46b2-83f3-6c338a7b7a1f" acquired by "delete_volume" :: waited 0.018s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:40:10 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[88f2ba44-e076-41f9-9a9f-151e83b46c83]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:40:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-63d8595f-5308-4310-91a9-122fee4f74cf tempest-CreateVolumesFromSnapshotTest-1159372696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-c333b408-7596-46b2-83f3-6c338a7b7a1f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:40:10 devstack sudo[106868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-c333b408-7596-46b2-83f3-6c338a7b7a1f Nov 06 15:40:10 devstack sudo[106868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:40:11 devstack sudo[106868]: pam_unix(sudo:session): session closed for user root Nov 06 15:40:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-63d8595f-5308-4310-91a9-122fee4f74cf tempest-CreateVolumesFromSnapshotTest-1159372696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-c333b408-7596-46b2-83f3-6c338a7b7a1f" returned: 0 in 0.360s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:40:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-63d8595f-5308-4310-91a9-122fee4f74cf tempest-CreateVolumesFromSnapshotTest-1159372696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-c333b408-7596-46b2-83f3-6c338a7b7a1f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:40:11 devstack sudo[106873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-c333b408-7596-46b2-83f3-6c338a7b7a1f Nov 06 15:40:11 devstack sudo[106873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:40:11 devstack sudo[106873]: pam_unix(sudo:session): session closed for user root Nov 06 15:40:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-63d8595f-5308-4310-91a9-122fee4f74cf tempest-CreateVolumesFromSnapshotTest-1159372696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-c333b408-7596-46b2-83f3-6c338a7b7a1f" returned: 0 in 0.231s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:40:11 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-63d8595f-5308-4310-91a9-122fee4f74cf tempest-CreateVolumesFromSnapshotTest-1159372696 None] Lock "cinder-quobyte-c333b408-7596-46b2-83f3-6c338a7b7a1f" released by "delete_volume" :: held 0.634s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:40:11 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-63d8595f-5308-4310-91a9-122fee4f74cf tempest-CreateVolumesFromSnapshotTest-1159372696 None] Created reservations ['276c5b23-dedb-443d-a6b9-46cb03f29787', '5875d2af-e84e-4b38-a45a-a56b871e70de', '4eee2f1b-dd29-466f-8204-69e5de480b54', '7af90e6d-20fb-46c1-8e6a-e03d607a0596'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:40:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-63d8595f-5308-4310-91a9-122fee4f74cf tempest-CreateVolumesFromSnapshotTest-1159372696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:40:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-63d8595f-5308-4310-91a9-122fee4f74cf tempest-CreateVolumesFromSnapshotTest-1159372696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:40:11 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-63d8595f-5308-4310-91a9-122fee4f74cf tempest-CreateVolumesFromSnapshotTest-1159372696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:40:11 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-63d8595f-5308-4310-91a9-122fee4f74cf tempest-CreateVolumesFromSnapshotTest-1159372696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:40:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-63d8595f-5308-4310-91a9-122fee4f74cf tempest-CreateVolumesFromSnapshotTest-1159372696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:40:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-63d8595f-5308-4310-91a9-122fee4f74cf tempest-CreateVolumesFromSnapshotTest-1159372696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:40:11 devstack sudo[106876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:40:11 devstack sudo[106876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:40:11 devstack sudo[106876]: pam_unix(sudo:session): session closed for user root Nov 06 15:40:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-63d8595f-5308-4310-91a9-122fee4f74cf tempest-CreateVolumesFromSnapshotTest-1159372696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.236s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:40:11 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-63d8595f-5308-4310-91a9-122fee4f74cf tempest-CreateVolumesFromSnapshotTest-1159372696 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:40:11 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-63d8595f-5308-4310-91a9-122fee4f74cf tempest-CreateVolumesFromSnapshotTest-1159372696 None] Deleted volume successfully. Nov 06 15:40:11 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-63d8595f-5308-4310-91a9-122fee4f74cf tempest-CreateVolumesFromSnapshotTest-1159372696 None] Lock "cinder-c333b408-7596-46b2-83f3-6c338a7b7a1f-delete_volume" released by "delete_volume" :: held 1.062s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:40:12 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-064a8fc3-ad01-4027-b6a0-186017dec512 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Acquiring lock "cinder-9507e4cb-62a8-4728-b721-ee2b83c589ae-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:40:12 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-064a8fc3-ad01-4027-b6a0-186017dec512 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Lock "cinder-9507e4cb-62a8-4728-b721-ee2b83c589ae-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:40:12 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-064a8fc3-ad01-4027-b6a0-186017dec512 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Acquiring lock "cinder-quobyte-9507e4cb-62a8-4728-b721-ee2b83c589ae" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:40:12 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-064a8fc3-ad01-4027-b6a0-186017dec512 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Lock "cinder-quobyte-9507e4cb-62a8-4728-b721-ee2b83c589ae" acquired by "delete_volume" :: waited 0.013s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:40:12 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[db6154ae-d278-4952-bc0d-bebaa21c0838]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:40:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-064a8fc3-ad01-4027-b6a0-186017dec512 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-9507e4cb-62a8-4728-b721-ee2b83c589ae {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:40:12 devstack sudo[106879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-9507e4cb-62a8-4728-b721-ee2b83c589ae Nov 06 15:40:12 devstack sudo[106879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:40:12 devstack sudo[106879]: pam_unix(sudo:session): session closed for user root Nov 06 15:40:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-064a8fc3-ad01-4027-b6a0-186017dec512 tempest-CreateVolumesFromSnapshotTest-1159372696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-9507e4cb-62a8-4728-b721-ee2b83c589ae" returned: 0 in 0.349s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:40:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-064a8fc3-ad01-4027-b6a0-186017dec512 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-9507e4cb-62a8-4728-b721-ee2b83c589ae {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:40:12 devstack sudo[106884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-9507e4cb-62a8-4728-b721-ee2b83c589ae Nov 06 15:40:12 devstack sudo[106884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:40:12 devstack sudo[106884]: pam_unix(sudo:session): session closed for user root Nov 06 15:40:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-064a8fc3-ad01-4027-b6a0-186017dec512 tempest-CreateVolumesFromSnapshotTest-1159372696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-9507e4cb-62a8-4728-b721-ee2b83c589ae" returned: 0 in 0.238s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:40:12 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-064a8fc3-ad01-4027-b6a0-186017dec512 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Lock "cinder-quobyte-9507e4cb-62a8-4728-b721-ee2b83c589ae" released by "delete_volume" :: held 0.627s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:40:12 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-064a8fc3-ad01-4027-b6a0-186017dec512 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Created reservations ['a5cae3ea-7033-4106-a50d-d2dd3979cf72', 'e2ab710b-5dcd-4fc9-b027-cc767e417342', '6a2bf3d1-d672-4cd8-bec0-c850b297d51e', '786e0851-190e-41c0-91aa-2eb30eb34bbe'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:40:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-064a8fc3-ad01-4027-b6a0-186017dec512 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:40:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-064a8fc3-ad01-4027-b6a0-186017dec512 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:40:12 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-064a8fc3-ad01-4027-b6a0-186017dec512 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:40:12 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-064a8fc3-ad01-4027-b6a0-186017dec512 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:40:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-064a8fc3-ad01-4027-b6a0-186017dec512 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:40:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-064a8fc3-ad01-4027-b6a0-186017dec512 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:40:12 devstack sudo[106887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:40:12 devstack sudo[106887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:40:13 devstack sudo[106887]: pam_unix(sudo:session): session closed for user root Nov 06 15:40:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-064a8fc3-ad01-4027-b6a0-186017dec512 tempest-CreateVolumesFromSnapshotTest-1159372696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.245s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:40:13 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-064a8fc3-ad01-4027-b6a0-186017dec512 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:40:13 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-064a8fc3-ad01-4027-b6a0-186017dec512 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Deleted volume successfully. Nov 06 15:40:13 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-064a8fc3-ad01-4027-b6a0-186017dec512 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Lock "cinder-9507e4cb-62a8-4728-b721-ee2b83c589ae-delete_volume" released by "delete_volume" :: held 1.050s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:40:13 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-8dbaae07-732c-48e0-a174-1e8bc07c5f32 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Acquiring lock "cinder-990c9c52-5ecf-497c-81c3-83a18bc32c9e-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:40:13 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-8dbaae07-732c-48e0-a174-1e8bc07c5f32 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Lock "cinder-990c9c52-5ecf-497c-81c3-83a18bc32c9e-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:40:13 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-8dbaae07-732c-48e0-a174-1e8bc07c5f32 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Acquiring lock "cinder-quobyte-990c9c52-5ecf-497c-81c3-83a18bc32c9e" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:40:13 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-8dbaae07-732c-48e0-a174-1e8bc07c5f32 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Lock "cinder-quobyte-990c9c52-5ecf-497c-81c3-83a18bc32c9e" acquired by "delete_volume" :: waited 0.017s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:40:13 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c0106e1-5547-42ad-b1c6-b5f1cb4a4f50]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:40:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8dbaae07-732c-48e0-a174-1e8bc07c5f32 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-990c9c52-5ecf-497c-81c3-83a18bc32c9e {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:40:13 devstack sudo[106890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-990c9c52-5ecf-497c-81c3-83a18bc32c9e Nov 06 15:40:13 devstack sudo[106890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:40:13 devstack sudo[106890]: pam_unix(sudo:session): session closed for user root Nov 06 15:40:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8dbaae07-732c-48e0-a174-1e8bc07c5f32 tempest-CreateVolumesFromSnapshotTest-1159372696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-990c9c52-5ecf-497c-81c3-83a18bc32c9e" returned: 0 in 0.347s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:40:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8dbaae07-732c-48e0-a174-1e8bc07c5f32 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-990c9c52-5ecf-497c-81c3-83a18bc32c9e {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:40:13 devstack sudo[106895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-990c9c52-5ecf-497c-81c3-83a18bc32c9e Nov 06 15:40:13 devstack sudo[106895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:40:13 devstack sudo[106895]: pam_unix(sudo:session): session closed for user root Nov 06 15:40:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8dbaae07-732c-48e0-a174-1e8bc07c5f32 tempest-CreateVolumesFromSnapshotTest-1159372696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-990c9c52-5ecf-497c-81c3-83a18bc32c9e" returned: 0 in 0.244s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:40:13 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-8dbaae07-732c-48e0-a174-1e8bc07c5f32 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Lock "cinder-quobyte-990c9c52-5ecf-497c-81c3-83a18bc32c9e" released by "delete_volume" :: held 0.628s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:40:13 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-8dbaae07-732c-48e0-a174-1e8bc07c5f32 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Created reservations ['1d3a3e07-6379-4983-b65b-4eb5b70dd50b', '0e101586-d242-4613-97d4-c5a5f78b38cc', 'd71f3a8c-dc49-45b1-85e2-d5d7d11c1e62', 'd61cde7a-eecf-402f-a7dc-9f984c3bd8c3'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:40:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8dbaae07-732c-48e0-a174-1e8bc07c5f32 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:40:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8dbaae07-732c-48e0-a174-1e8bc07c5f32 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:40:13 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-8dbaae07-732c-48e0-a174-1e8bc07c5f32 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:40:13 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-8dbaae07-732c-48e0-a174-1e8bc07c5f32 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:40:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8dbaae07-732c-48e0-a174-1e8bc07c5f32 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:40:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8dbaae07-732c-48e0-a174-1e8bc07c5f32 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:40:13 devstack sudo[106898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:40:13 devstack sudo[106898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:40:14 devstack sudo[106898]: pam_unix(sudo:session): session closed for user root Nov 06 15:40:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8dbaae07-732c-48e0-a174-1e8bc07c5f32 tempest-CreateVolumesFromSnapshotTest-1159372696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.239s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:40:14 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-8dbaae07-732c-48e0-a174-1e8bc07c5f32 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:40:14 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-8dbaae07-732c-48e0-a174-1e8bc07c5f32 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Deleted volume successfully. Nov 06 15:40:14 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-8dbaae07-732c-48e0-a174-1e8bc07c5f32 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Lock "cinder-990c9c52-5ecf-497c-81c3-83a18bc32c9e-delete_volume" released by "delete_volume" :: held 1.046s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:40:14 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e08945ee-c52a-4d1f-98bd-80076f82a26a tempest-CreateVolumesFromSnapshotTest-1159372696 None] Acquiring lock "cinder-d5416ade-2b1a-4099-bd44-aed88145709b-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:40:14 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e08945ee-c52a-4d1f-98bd-80076f82a26a tempest-CreateVolumesFromSnapshotTest-1159372696 None] Lock "cinder-d5416ade-2b1a-4099-bd44-aed88145709b-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:40:14 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e08945ee-c52a-4d1f-98bd-80076f82a26a tempest-CreateVolumesFromSnapshotTest-1159372696 None] Acquiring lock "cinder-quobyte-d5416ade-2b1a-4099-bd44-aed88145709b" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:40:14 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e08945ee-c52a-4d1f-98bd-80076f82a26a tempest-CreateVolumesFromSnapshotTest-1159372696 None] Lock "cinder-quobyte-d5416ade-2b1a-4099-bd44-aed88145709b" acquired by "delete_volume" :: waited 0.014s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:40:14 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfaf23a0-8f98-4c35-af6c-bb463fd92973]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:40:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e08945ee-c52a-4d1f-98bd-80076f82a26a tempest-CreateVolumesFromSnapshotTest-1159372696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d5416ade-2b1a-4099-bd44-aed88145709b {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:40:14 devstack sudo[106901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d5416ade-2b1a-4099-bd44-aed88145709b Nov 06 15:40:14 devstack sudo[106901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:40:14 devstack sudo[106901]: pam_unix(sudo:session): session closed for user root Nov 06 15:40:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e08945ee-c52a-4d1f-98bd-80076f82a26a tempest-CreateVolumesFromSnapshotTest-1159372696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d5416ade-2b1a-4099-bd44-aed88145709b" returned: 0 in 0.346s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:40:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e08945ee-c52a-4d1f-98bd-80076f82a26a tempest-CreateVolumesFromSnapshotTest-1159372696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d5416ade-2b1a-4099-bd44-aed88145709b {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:40:14 devstack sudo[106906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d5416ade-2b1a-4099-bd44-aed88145709b Nov 06 15:40:14 devstack sudo[106906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:40:14 devstack sudo[106906]: pam_unix(sudo:session): session closed for user root Nov 06 15:40:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e08945ee-c52a-4d1f-98bd-80076f82a26a tempest-CreateVolumesFromSnapshotTest-1159372696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d5416ade-2b1a-4099-bd44-aed88145709b" returned: 0 in 0.240s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:40:15 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e08945ee-c52a-4d1f-98bd-80076f82a26a tempest-CreateVolumesFromSnapshotTest-1159372696 None] Lock "cinder-quobyte-d5416ade-2b1a-4099-bd44-aed88145709b" released by "delete_volume" :: held 0.624s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:40:15 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-e08945ee-c52a-4d1f-98bd-80076f82a26a tempest-CreateVolumesFromSnapshotTest-1159372696 None] Created reservations ['bdd707a3-cb43-478f-9bf8-f386a0b3cafc', '306c640a-1fe6-45df-9586-4b6750106632', 'f94b1855-8ec6-4a44-a285-f4811d3c2b76', '1bd3475e-1068-48c7-9afb-b2466a24751c'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:40:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e08945ee-c52a-4d1f-98bd-80076f82a26a tempest-CreateVolumesFromSnapshotTest-1159372696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:40:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e08945ee-c52a-4d1f-98bd-80076f82a26a tempest-CreateVolumesFromSnapshotTest-1159372696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:40:15 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e08945ee-c52a-4d1f-98bd-80076f82a26a tempest-CreateVolumesFromSnapshotTest-1159372696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:40:15 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e08945ee-c52a-4d1f-98bd-80076f82a26a tempest-CreateVolumesFromSnapshotTest-1159372696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:40:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e08945ee-c52a-4d1f-98bd-80076f82a26a tempest-CreateVolumesFromSnapshotTest-1159372696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:40:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e08945ee-c52a-4d1f-98bd-80076f82a26a tempest-CreateVolumesFromSnapshotTest-1159372696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:40:15 devstack sudo[106909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:40:15 devstack sudo[106909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:40:15 devstack sudo[106909]: pam_unix(sudo:session): session closed for user root Nov 06 15:40:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e08945ee-c52a-4d1f-98bd-80076f82a26a tempest-CreateVolumesFromSnapshotTest-1159372696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.242s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:40:15 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-e08945ee-c52a-4d1f-98bd-80076f82a26a tempest-CreateVolumesFromSnapshotTest-1159372696 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:40:15 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-e08945ee-c52a-4d1f-98bd-80076f82a26a tempest-CreateVolumesFromSnapshotTest-1159372696 None] Deleted volume successfully. Nov 06 15:40:15 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e08945ee-c52a-4d1f-98bd-80076f82a26a tempest-CreateVolumesFromSnapshotTest-1159372696 None] Lock "cinder-d5416ade-2b1a-4099-bd44-aed88145709b-delete_volume" released by "delete_volume" :: held 1.048s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:40:15 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-7e1eca7a-7483-4ce5-8598-0152a1f34a50 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Acquiring lock "cinder-0276be22-a5a7-4685-bfbf-99b55563d585-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:40:15 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-7e1eca7a-7483-4ce5-8598-0152a1f34a50 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Lock "cinder-0276be22-a5a7-4685-bfbf-99b55563d585-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:40:15 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-7e1eca7a-7483-4ce5-8598-0152a1f34a50 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Acquiring lock "cinder-quobyte-0276be22-a5a7-4685-bfbf-99b55563d585" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:40:15 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-7e1eca7a-7483-4ce5-8598-0152a1f34a50 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Lock "cinder-quobyte-0276be22-a5a7-4685-bfbf-99b55563d585" acquired by "delete_volume" :: waited 0.015s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:40:15 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[25d22497-c28b-4653-9281-50fcc3032cbf]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:40:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7e1eca7a-7483-4ce5-8598-0152a1f34a50 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0276be22-a5a7-4685-bfbf-99b55563d585 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:40:15 devstack sudo[106912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0276be22-a5a7-4685-bfbf-99b55563d585 Nov 06 15:40:15 devstack sudo[106912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:40:15 devstack sudo[106912]: pam_unix(sudo:session): session closed for user root Nov 06 15:40:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7e1eca7a-7483-4ce5-8598-0152a1f34a50 tempest-CreateVolumesFromSnapshotTest-1159372696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0276be22-a5a7-4685-bfbf-99b55563d585" returned: 0 in 0.351s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:40:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7e1eca7a-7483-4ce5-8598-0152a1f34a50 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0276be22-a5a7-4685-bfbf-99b55563d585 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:40:15 devstack sudo[106918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0276be22-a5a7-4685-bfbf-99b55563d585 Nov 06 15:40:15 devstack sudo[106918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:40:16 devstack sudo[106918]: pam_unix(sudo:session): session closed for user root Nov 06 15:40:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7e1eca7a-7483-4ce5-8598-0152a1f34a50 tempest-CreateVolumesFromSnapshotTest-1159372696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0276be22-a5a7-4685-bfbf-99b55563d585" returned: 0 in 0.242s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:40:16 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-7e1eca7a-7483-4ce5-8598-0152a1f34a50 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Lock "cinder-quobyte-0276be22-a5a7-4685-bfbf-99b55563d585" released by "delete_volume" :: held 0.636s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:40:16 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-7e1eca7a-7483-4ce5-8598-0152a1f34a50 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Created reservations ['a46e8171-983c-40f0-8771-2da9750e6e5a', '93284b28-9013-4afd-8484-21c518042449', 'd8e56f1c-e2e9-4df3-a5f9-7543f9b5d918', '46810882-06d4-4256-bac1-875669850689'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:40:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7e1eca7a-7483-4ce5-8598-0152a1f34a50 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:40:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7e1eca7a-7483-4ce5-8598-0152a1f34a50 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:40:16 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-7e1eca7a-7483-4ce5-8598-0152a1f34a50 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:40:16 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-7e1eca7a-7483-4ce5-8598-0152a1f34a50 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:40:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7e1eca7a-7483-4ce5-8598-0152a1f34a50 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:40:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7e1eca7a-7483-4ce5-8598-0152a1f34a50 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:40:16 devstack sudo[106921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:40:16 devstack sudo[106921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:40:16 devstack sudo[106921]: pam_unix(sudo:session): session closed for user root Nov 06 15:40:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7e1eca7a-7483-4ce5-8598-0152a1f34a50 tempest-CreateVolumesFromSnapshotTest-1159372696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.234s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:40:16 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-7e1eca7a-7483-4ce5-8598-0152a1f34a50 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:40:16 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-7e1eca7a-7483-4ce5-8598-0152a1f34a50 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Deleted volume successfully. Nov 06 15:40:16 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-7e1eca7a-7483-4ce5-8598-0152a1f34a50 tempest-CreateVolumesFromSnapshotTest-1159372696 None] Lock "cinder-0276be22-a5a7-4685-bfbf-99b55563d585-delete_volume" released by "delete_volume" :: held 1.048s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:40:16 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6fa32df2-9692-44cc-9dee-962c22106f6a tempest-CreateVolumesFromSnapshotTest-1159372696 None] Acquiring lock "cinder-6526bed3-4c3a-40a6-bc61-c37fa1e45d77-delete_snapshot" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:40:16 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6fa32df2-9692-44cc-9dee-962c22106f6a tempest-CreateVolumesFromSnapshotTest-1159372696 None] Lock "cinder-6526bed3-4c3a-40a6-bc61-c37fa1e45d77-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:40:16 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6fa32df2-9692-44cc-9dee-962c22106f6a tempest-CreateVolumesFromSnapshotTest-1159372696 None] Acquiring lock "cinder-quobyte-0e6613bf-d0d7-4dce-814b-ee0c077b2b4b" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:40:16 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6fa32df2-9692-44cc-9dee-962c22106f6a tempest-CreateVolumesFromSnapshotTest-1159372696 None] Lock "cinder-quobyte-0e6613bf-d0d7-4dce-814b-ee0c077b2b4b" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:40:16 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6fa32df2-9692-44cc-9dee-962c22106f6a tempest-CreateVolumesFromSnapshotTest-1159372696 None] Acquiring lock "cinder-quobyte-6526bed3-4c3a-40a6-bc61-c37fa1e45d77" by "_delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:40:16 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6fa32df2-9692-44cc-9dee-962c22106f6a tempest-CreateVolumesFromSnapshotTest-1159372696 None] Lock "cinder-quobyte-6526bed3-4c3a-40a6-bc61-c37fa1e45d77" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:40:16 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-6fa32df2-9692-44cc-9dee-962c22106f6a tempest-CreateVolumesFromSnapshotTest-1159372696 None] Deleting offline snapshot 6526bed3-4c3a-40a6-bc61-c37fa1e45d77 of volume 0e6613bf-d0d7-4dce-814b-ee0c077b2b4b {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 15:40:16 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-6fa32df2-9692-44cc-9dee-962c22106f6a tempest-CreateVolumesFromSnapshotTest-1159372696 None] snapshot_file for this snap is: volume-0e6613bf-d0d7-4dce-814b-ee0c077b2b4b.6526bed3-4c3a-40a6-bc61-c37fa1e45d77 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 15:40:16 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ef9e97a-c50b-4e99-a810-b840061db2f6]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:40:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6fa32df2-9692-44cc-9dee-962c22106f6a tempest-CreateVolumesFromSnapshotTest-1159372696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0e6613bf-d0d7-4dce-814b-ee0c077b2b4b.6526bed3-4c3a-40a6-bc61-c37fa1e45d77 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:40:16 devstack sudo[106924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0e6613bf-d0d7-4dce-814b-ee0c077b2b4b.6526bed3-4c3a-40a6-bc61-c37fa1e45d77 Nov 06 15:40:16 devstack sudo[106924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:40:17 devstack sudo[106924]: pam_unix(sudo:session): session closed for user root Nov 06 15:40:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6fa32df2-9692-44cc-9dee-962c22106f6a tempest-CreateVolumesFromSnapshotTest-1159372696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0e6613bf-d0d7-4dce-814b-ee0c077b2b4b.6526bed3-4c3a-40a6-bc61-c37fa1e45d77" returned: 0 in 0.355s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:40:17 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-6fa32df2-9692-44cc-9dee-962c22106f6a tempest-CreateVolumesFromSnapshotTest-1159372696 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0e6613bf-d0d7-4dce-814b-ee0c077b2b4b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 15:40:17 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a383776-99af-4f16-9bcf-54728216a2a1]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:40:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6fa32df2-9692-44cc-9dee-962c22106f6a tempest-CreateVolumesFromSnapshotTest-1159372696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0e6613bf-d0d7-4dce-814b-ee0c077b2b4b {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:40:17 devstack sudo[106929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0e6613bf-d0d7-4dce-814b-ee0c077b2b4b Nov 06 15:40:17 devstack sudo[106929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:40:17 devstack sudo[106929]: pam_unix(sudo:session): session closed for user root Nov 06 15:40:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6fa32df2-9692-44cc-9dee-962c22106f6a tempest-CreateVolumesFromSnapshotTest-1159372696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0e6613bf-d0d7-4dce-814b-ee0c077b2b4b" returned: 0 in 0.353s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:40:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6fa32df2-9692-44cc-9dee-962c22106f6a tempest-CreateVolumesFromSnapshotTest-1159372696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0e6613bf-d0d7-4dce-814b-ee0c077b2b4b.6526bed3-4c3a-40a6-bc61-c37fa1e45d77 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:40:17 devstack sudo[106934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0e6613bf-d0d7-4dce-814b-ee0c077b2b4b.6526bed3-4c3a-40a6-bc61-c37fa1e45d77 Nov 06 15:40:17 devstack sudo[106934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:40:17 devstack sudo[106934]: pam_unix(sudo:session): session closed for user root Nov 06 15:40:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6fa32df2-9692-44cc-9dee-962c22106f6a tempest-CreateVolumesFromSnapshotTest-1159372696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0e6613bf-d0d7-4dce-814b-ee0c077b2b4b.6526bed3-4c3a-40a6-bc61-c37fa1e45d77" returned: 0 in 0.328s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:40:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6fa32df2-9692-44cc-9dee-962c22106f6a tempest-CreateVolumesFromSnapshotTest-1159372696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0e6613bf-d0d7-4dce-814b-ee0c077b2b4b.6526bed3-4c3a-40a6-bc61-c37fa1e45d77 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:40:17 devstack sudo[106940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0e6613bf-d0d7-4dce-814b-ee0c077b2b4b.6526bed3-4c3a-40a6-bc61-c37fa1e45d77 Nov 06 15:40:17 devstack sudo[106940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:40:17 devstack sudo[106940]: pam_unix(sudo:session): session closed for user root Nov 06 15:40:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6fa32df2-9692-44cc-9dee-962c22106f6a tempest-CreateVolumesFromSnapshotTest-1159372696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0e6613bf-d0d7-4dce-814b-ee0c077b2b4b.6526bed3-4c3a-40a6-bc61-c37fa1e45d77" returned: 0 in 0.246s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:40:18 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6fa32df2-9692-44cc-9dee-962c22106f6a tempest-CreateVolumesFromSnapshotTest-1159372696 None] Lock "cinder-quobyte-6526bed3-4c3a-40a6-bc61-c37fa1e45d77" released by "_delete_snapshot" :: held 1.387s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:40:18 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6fa32df2-9692-44cc-9dee-962c22106f6a tempest-CreateVolumesFromSnapshotTest-1159372696 None] Lock "cinder-quobyte-0e6613bf-d0d7-4dce-814b-ee0c077b2b4b" released by "delete_snapshot" :: held 1.410s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:40:18 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-6fa32df2-9692-44cc-9dee-962c22106f6a tempest-CreateVolumesFromSnapshotTest-1159372696 None] Created reservations ['2fafc61e-3770-4a51-affb-b5701a453d2a', 'd9182faf-8270-4a6e-aa96-0c9fe4f87b86', 'e3cc9dc4-8fe9-4820-87af-81e29e46ddac', '4d4d6d91-2aba-44c5-8280-ca80c18b29d9'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:40:18 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-6fa32df2-9692-44cc-9dee-962c22106f6a tempest-CreateVolumesFromSnapshotTest-1159372696 None] Delete snapshot completed successfully. Nov 06 15:40:18 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6fa32df2-9692-44cc-9dee-962c22106f6a tempest-CreateVolumesFromSnapshotTest-1159372696 None] Lock "cinder-6526bed3-4c3a-40a6-bc61-c37fa1e45d77-delete_snapshot" released by "delete_snapshot" :: held 1.526s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:40:18 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-07f8d5e0-c472-4fe3-b6ed-bd8cab017b2e tempest-CreateVolumesFromSnapshotTest-1159372696 None] Acquiring lock "cinder-0e6613bf-d0d7-4dce-814b-ee0c077b2b4b-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:40:18 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-07f8d5e0-c472-4fe3-b6ed-bd8cab017b2e tempest-CreateVolumesFromSnapshotTest-1159372696 None] Lock "cinder-0e6613bf-d0d7-4dce-814b-ee0c077b2b4b-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:40:18 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-07f8d5e0-c472-4fe3-b6ed-bd8cab017b2e tempest-CreateVolumesFromSnapshotTest-1159372696 None] Acquiring lock "cinder-quobyte-0e6613bf-d0d7-4dce-814b-ee0c077b2b4b" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:40:18 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-07f8d5e0-c472-4fe3-b6ed-bd8cab017b2e tempest-CreateVolumesFromSnapshotTest-1159372696 None] Lock "cinder-quobyte-0e6613bf-d0d7-4dce-814b-ee0c077b2b4b" acquired by "delete_volume" :: waited 0.015s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:40:18 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[36fc0ccc-07a3-4598-9d2e-6026faa9c66e]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:40:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-07f8d5e0-c472-4fe3-b6ed-bd8cab017b2e tempest-CreateVolumesFromSnapshotTest-1159372696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0e6613bf-d0d7-4dce-814b-ee0c077b2b4b {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:40:18 devstack sudo[106943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0e6613bf-d0d7-4dce-814b-ee0c077b2b4b Nov 06 15:40:18 devstack sudo[106943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:40:19 devstack sudo[106943]: pam_unix(sudo:session): session closed for user root Nov 06 15:40:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-07f8d5e0-c472-4fe3-b6ed-bd8cab017b2e tempest-CreateVolumesFromSnapshotTest-1159372696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0e6613bf-d0d7-4dce-814b-ee0c077b2b4b" returned: 0 in 0.351s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:40:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-07f8d5e0-c472-4fe3-b6ed-bd8cab017b2e tempest-CreateVolumesFromSnapshotTest-1159372696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0e6613bf-d0d7-4dce-814b-ee0c077b2b4b {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:40:19 devstack sudo[106948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0e6613bf-d0d7-4dce-814b-ee0c077b2b4b Nov 06 15:40:19 devstack sudo[106948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:40:19 devstack sudo[106948]: pam_unix(sudo:session): session closed for user root Nov 06 15:40:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-07f8d5e0-c472-4fe3-b6ed-bd8cab017b2e tempest-CreateVolumesFromSnapshotTest-1159372696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0e6613bf-d0d7-4dce-814b-ee0c077b2b4b" returned: 0 in 0.236s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:40:19 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-07f8d5e0-c472-4fe3-b6ed-bd8cab017b2e tempest-CreateVolumesFromSnapshotTest-1159372696 None] Lock "cinder-quobyte-0e6613bf-d0d7-4dce-814b-ee0c077b2b4b" released by "delete_volume" :: held 0.643s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:40:19 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-07f8d5e0-c472-4fe3-b6ed-bd8cab017b2e tempest-CreateVolumesFromSnapshotTest-1159372696 None] Created reservations ['c912c234-1568-428c-bcb2-10b798483ee2', '8205d4ba-cbb1-47ef-a0da-b2ef0d1b3575', '0792d05b-567d-4939-8837-39898c963a17', '77ff7c95-ab0d-4e06-8f68-19eebc60b59b'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:40:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-07f8d5e0-c472-4fe3-b6ed-bd8cab017b2e tempest-CreateVolumesFromSnapshotTest-1159372696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:40:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-07f8d5e0-c472-4fe3-b6ed-bd8cab017b2e tempest-CreateVolumesFromSnapshotTest-1159372696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:40:19 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-07f8d5e0-c472-4fe3-b6ed-bd8cab017b2e tempest-CreateVolumesFromSnapshotTest-1159372696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:40:19 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-07f8d5e0-c472-4fe3-b6ed-bd8cab017b2e tempest-CreateVolumesFromSnapshotTest-1159372696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:40:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-07f8d5e0-c472-4fe3-b6ed-bd8cab017b2e tempest-CreateVolumesFromSnapshotTest-1159372696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:40:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-07f8d5e0-c472-4fe3-b6ed-bd8cab017b2e tempest-CreateVolumesFromSnapshotTest-1159372696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:40:19 devstack sudo[106951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:40:19 devstack sudo[106951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:40:19 devstack sudo[106951]: pam_unix(sudo:session): session closed for user root Nov 06 15:40:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-07f8d5e0-c472-4fe3-b6ed-bd8cab017b2e tempest-CreateVolumesFromSnapshotTest-1159372696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.236s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:40:19 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-07f8d5e0-c472-4fe3-b6ed-bd8cab017b2e tempest-CreateVolumesFromSnapshotTest-1159372696 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:40:19 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-07f8d5e0-c472-4fe3-b6ed-bd8cab017b2e tempest-CreateVolumesFromSnapshotTest-1159372696 None] Deleted volume successfully. Nov 06 15:40:19 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-07f8d5e0-c472-4fe3-b6ed-bd8cab017b2e tempest-CreateVolumesFromSnapshotTest-1159372696 None] Lock "cinder-0e6613bf-d0d7-4dce-814b-ee0c077b2b4b-delete_volume" released by "delete_volume" :: held 1.066s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:40:22 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-1930a110-5f12-49a6-afbf-8759a3355e40 tempest-CinderUnicodeTest-1069380389 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:40:22 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1930a110-5f12-49a6-afbf-8759a3355e40 tempest-CinderUnicodeTest-1069380389 None] Flow 'volume_create_manager' (89d6d951-1470-4128-8179-b5a274127050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:40:22 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1930a110-5f12-49a6-afbf-8759a3355e40 tempest-CinderUnicodeTest-1069380389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27665787-17d4-4746-a24f-7b890868fd48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:40:22 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1930a110-5f12-49a6-afbf-8759a3355e40 tempest-CinderUnicodeTest-1069380389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27665787-17d4-4746-a24f-7b890868fd48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:40:22Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9499b39-32bb-476e-b072-c4541722d959,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2cfa1e35b7a3472e85145d409eeb0535',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:40:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:40:22Z,use_quota=True,user_id='d5633e5af7704bd4a8f73548802b8cee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:40:22 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1930a110-5f12-49a6-afbf-8759a3355e40 tempest-CinderUnicodeTest-1069380389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed6c9a17-ab77-4dcb-ba6e-cec7d9313bde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:40:22 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1930a110-5f12-49a6-afbf-8759a3355e40 tempest-CinderUnicodeTest-1069380389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed6c9a17-ab77-4dcb-ba6e-cec7d9313bde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:40:22 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1930a110-5f12-49a6-afbf-8759a3355e40 tempest-CinderUnicodeTest-1069380389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eccc2cba-85bc-4014-b487-f431d065733e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:40:22 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1930a110-5f12-49a6-afbf-8759a3355e40 tempest-CinderUnicodeTest-1069380389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eccc2cba-85bc-4014-b487-f431d065733e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9499b39-32bb-476e-b072-c4541722d959', 'volume_name': 'volume-e9499b39-32bb-476e-b072-c4541722d959', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:40:22 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1930a110-5f12-49a6-afbf-8759a3355e40 tempest-CinderUnicodeTest-1069380389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9694407-5c4a-4bc2-b39b-7a65c442401b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:40:22 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1930a110-5f12-49a6-afbf-8759a3355e40 tempest-CinderUnicodeTest-1069380389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9694407-5c4a-4bc2-b39b-7a65c442401b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:40:22 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1930a110-5f12-49a6-afbf-8759a3355e40 tempest-CinderUnicodeTest-1069380389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (407043e9-9f13-4c32-8883-6cfeeb7f78d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:40:22 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-1930a110-5f12-49a6-afbf-8759a3355e40 tempest-CinderUnicodeTest-1069380389 None] Volume e9499b39-32bb-476e-b072-c4541722d959: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9499b39-32bb-476e-b072-c4541722d959', 'volume_size': 1} Nov 06 15:40:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1930a110-5f12-49a6-afbf-8759a3355e40 tempest-CinderUnicodeTest-1069380389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:40:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1930a110-5f12-49a6-afbf-8759a3355e40 tempest-CinderUnicodeTest-1069380389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:40:22 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1930a110-5f12-49a6-afbf-8759a3355e40 tempest-CinderUnicodeTest-1069380389 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:40:22Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9499b39-32bb-476e-b072-c4541722d959,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2cfa1e35b7a3472e85145d409eeb0535',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:40:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:40:22Z,use_quota=True,user_id='d5633e5af7704bd4a8f73548802b8cee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:40:22 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-1930a110-5f12-49a6-afbf-8759a3355e40 tempest-CinderUnicodeTest-1069380389 None] Creating volume e9499b39-32bb-476e-b072-c4541722d959 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:40:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1930a110-5f12-49a6-afbf-8759a3355e40 tempest-CinderUnicodeTest-1069380389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:40:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1930a110-5f12-49a6-afbf-8759a3355e40 tempest-CinderUnicodeTest-1069380389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:40:22 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1930a110-5f12-49a6-afbf-8759a3355e40 tempest-CinderUnicodeTest-1069380389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:40:22 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1930a110-5f12-49a6-afbf-8759a3355e40 tempest-CinderUnicodeTest-1069380389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:40:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1930a110-5f12-49a6-afbf-8759a3355e40 tempest-CinderUnicodeTest-1069380389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:40:22 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1930a110-5f12-49a6-afbf-8759a3355e40 tempest-CinderUnicodeTest-1069380389 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:40:22 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-1930a110-5f12-49a6-afbf-8759a3355e40 tempest-CinderUnicodeTest-1069380389 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:40:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1930a110-5f12-49a6-afbf-8759a3355e40 tempest-CinderUnicodeTest-1069380389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-e9499b39-32bb-476e-b072-c4541722d959 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:40:22 devstack sudo[106954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-e9499b39-32bb-476e-b072-c4541722d959 1073741824 Nov 06 15:40:22 devstack sudo[106954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:40:22 devstack sudo[106954]: pam_unix(sudo:session): session closed for user root Nov 06 15:40:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1930a110-5f12-49a6-afbf-8759a3355e40 tempest-CinderUnicodeTest-1069380389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-e9499b39-32bb-476e-b072-c4541722d959 1073741824" returned: 0 in 0.404s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:40:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1930a110-5f12-49a6-afbf-8759a3355e40 tempest-CinderUnicodeTest-1069380389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-e9499b39-32bb-476e-b072-c4541722d959 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:40:23 devstack sudo[106959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-e9499b39-32bb-476e-b072-c4541722d959 Nov 06 15:40:23 devstack sudo[106959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:40:23 devstack sudo[106959]: pam_unix(sudo:session): session closed for user root Nov 06 15:40:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1930a110-5f12-49a6-afbf-8759a3355e40 tempest-CinderUnicodeTest-1069380389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-e9499b39-32bb-476e-b072-c4541722d959" returned: 0 in 0.237s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:40:23 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1930a110-5f12-49a6-afbf-8759a3355e40 tempest-CinderUnicodeTest-1069380389 None] <== create_volume: return (680ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:40:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1930a110-5f12-49a6-afbf-8759a3355e40 tempest-CinderUnicodeTest-1069380389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.684s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:40:23 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1930a110-5f12-49a6-afbf-8759a3355e40 tempest-CinderUnicodeTest-1069380389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (407043e9-9f13-4c32-8883-6cfeeb7f78d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9499b39-32bb-476e-b072-c4541722d959', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:40:23 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1930a110-5f12-49a6-afbf-8759a3355e40 tempest-CinderUnicodeTest-1069380389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bca93b7f-af06-49d3-9b17-c3c4313e2459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:40:23 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-1930a110-5f12-49a6-afbf-8759a3355e40 tempest-CinderUnicodeTest-1069380389 None] Volume volume-e9499b39-32bb-476e-b072-c4541722d959 (e9499b39-32bb-476e-b072-c4541722d959): created successfully Nov 06 15:40:23 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1930a110-5f12-49a6-afbf-8759a3355e40 tempest-CinderUnicodeTest-1069380389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bca93b7f-af06-49d3-9b17-c3c4313e2459) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:40:23 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1930a110-5f12-49a6-afbf-8759a3355e40 tempest-CinderUnicodeTest-1069380389 None] Flow 'volume_create_manager' (89d6d951-1470-4128-8179-b5a274127050) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:40:23 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-1930a110-5f12-49a6-afbf-8759a3355e40 tempest-CinderUnicodeTest-1069380389 None] Created volume successfully. Nov 06 15:40:23 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8ad04a2-1026-415a-b801-d4a58121834e tempest-CinderUnicodeTest-1069380389 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:40:23 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c8ad04a2-1026-415a-b801-d4a58121834e tempest-CinderUnicodeTest-1069380389 None] Flow 'volume_create_manager' (f2ef744b-fd26-4416-958a-ba4f2ad48b41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:40:23 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c8ad04a2-1026-415a-b801-d4a58121834e tempest-CinderUnicodeTest-1069380389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9b7bc4e-8ad7-42da-a93a-e026a5db4015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:40:24 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c8ad04a2-1026-415a-b801-d4a58121834e tempest-CinderUnicodeTest-1069380389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9b7bc4e-8ad7-42da-a93a-e026a5db4015) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:40:24Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-757006990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f364e664-d42a-434e-bed2-93aeccfd77e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2cfa1e35b7a3472e85145d409eeb0535',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:40:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:40:24Z,use_quota=True,user_id='d5633e5af7704bd4a8f73548802b8cee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:40:24 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c8ad04a2-1026-415a-b801-d4a58121834e tempest-CinderUnicodeTest-1069380389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ead3703-406e-4fd6-9ac5-eaade5550a68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:40:24 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c8ad04a2-1026-415a-b801-d4a58121834e tempest-CinderUnicodeTest-1069380389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ead3703-406e-4fd6-9ac5-eaade5550a68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:40:24 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c8ad04a2-1026-415a-b801-d4a58121834e tempest-CinderUnicodeTest-1069380389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2824530f-dfa3-401c-8d36-9ca5f14f3b9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:40:24 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c8ad04a2-1026-415a-b801-d4a58121834e tempest-CinderUnicodeTest-1069380389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2824530f-dfa3-401c-8d36-9ca5f14f3b9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f364e664-d42a-434e-bed2-93aeccfd77e2', 'volume_name': 'volume-f364e664-d42a-434e-bed2-93aeccfd77e2', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:40:24 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c8ad04a2-1026-415a-b801-d4a58121834e tempest-CinderUnicodeTest-1069380389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15112e16-c6fd-4d5c-bcf1-491d7d47f042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:40:24 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c8ad04a2-1026-415a-b801-d4a58121834e tempest-CinderUnicodeTest-1069380389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15112e16-c6fd-4d5c-bcf1-491d7d47f042) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:40:24 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c8ad04a2-1026-415a-b801-d4a58121834e tempest-CinderUnicodeTest-1069380389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f983fee6-12df-46f3-9646-3bf74a684b02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:40:24 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-c8ad04a2-1026-415a-b801-d4a58121834e tempest-CinderUnicodeTest-1069380389 None] Volume f364e664-d42a-434e-bed2-93aeccfd77e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f364e664-d42a-434e-bed2-93aeccfd77e2', 'volume_size': 1} Nov 06 15:40:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c8ad04a2-1026-415a-b801-d4a58121834e tempest-CinderUnicodeTest-1069380389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:40:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c8ad04a2-1026-415a-b801-d4a58121834e tempest-CinderUnicodeTest-1069380389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:40:24 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c8ad04a2-1026-415a-b801-d4a58121834e tempest-CinderUnicodeTest-1069380389 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:40:24Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-757006990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f364e664-d42a-434e-bed2-93aeccfd77e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2cfa1e35b7a3472e85145d409eeb0535',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:40:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:40:24Z,use_quota=True,user_id='d5633e5af7704bd4a8f73548802b8cee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:40:24 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-c8ad04a2-1026-415a-b801-d4a58121834e tempest-CinderUnicodeTest-1069380389 None] Creating volume f364e664-d42a-434e-bed2-93aeccfd77e2 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:40:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c8ad04a2-1026-415a-b801-d4a58121834e tempest-CinderUnicodeTest-1069380389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:40:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c8ad04a2-1026-415a-b801-d4a58121834e tempest-CinderUnicodeTest-1069380389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:40:24 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c8ad04a2-1026-415a-b801-d4a58121834e tempest-CinderUnicodeTest-1069380389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:40:24 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c8ad04a2-1026-415a-b801-d4a58121834e tempest-CinderUnicodeTest-1069380389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:40:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c8ad04a2-1026-415a-b801-d4a58121834e tempest-CinderUnicodeTest-1069380389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:40:24 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c8ad04a2-1026-415a-b801-d4a58121834e tempest-CinderUnicodeTest-1069380389 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:40:24 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-c8ad04a2-1026-415a-b801-d4a58121834e tempest-CinderUnicodeTest-1069380389 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:40:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c8ad04a2-1026-415a-b801-d4a58121834e tempest-CinderUnicodeTest-1069380389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f364e664-d42a-434e-bed2-93aeccfd77e2 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:40:24 devstack sudo[106962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f364e664-d42a-434e-bed2-93aeccfd77e2 1073741824 Nov 06 15:40:24 devstack sudo[106962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:40:24 devstack sudo[106962]: pam_unix(sudo:session): session closed for user root Nov 06 15:40:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c8ad04a2-1026-415a-b801-d4a58121834e tempest-CinderUnicodeTest-1069380389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f364e664-d42a-434e-bed2-93aeccfd77e2 1073741824" returned: 0 in 0.406s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:40:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c8ad04a2-1026-415a-b801-d4a58121834e tempest-CinderUnicodeTest-1069380389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f364e664-d42a-434e-bed2-93aeccfd77e2 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:40:24 devstack sudo[106967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f364e664-d42a-434e-bed2-93aeccfd77e2 Nov 06 15:40:24 devstack sudo[106967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:40:24 devstack sudo[106967]: pam_unix(sudo:session): session closed for user root Nov 06 15:40:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c8ad04a2-1026-415a-b801-d4a58121834e tempest-CinderUnicodeTest-1069380389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f364e664-d42a-434e-bed2-93aeccfd77e2" returned: 0 in 0.248s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:40:24 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c8ad04a2-1026-415a-b801-d4a58121834e tempest-CinderUnicodeTest-1069380389 None] <== create_volume: return (690ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:40:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c8ad04a2-1026-415a-b801-d4a58121834e tempest-CinderUnicodeTest-1069380389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.693s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:40:24 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c8ad04a2-1026-415a-b801-d4a58121834e tempest-CinderUnicodeTest-1069380389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f983fee6-12df-46f3-9646-3bf74a684b02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f364e664-d42a-434e-bed2-93aeccfd77e2', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:40:24 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c8ad04a2-1026-415a-b801-d4a58121834e tempest-CinderUnicodeTest-1069380389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa1c752e-1401-4e9e-9496-2fab859695e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:40:24 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-c8ad04a2-1026-415a-b801-d4a58121834e tempest-CinderUnicodeTest-1069380389 None] Volume volume-f364e664-d42a-434e-bed2-93aeccfd77e2 (f364e664-d42a-434e-bed2-93aeccfd77e2): created successfully Nov 06 15:40:24 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c8ad04a2-1026-415a-b801-d4a58121834e tempest-CinderUnicodeTest-1069380389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa1c752e-1401-4e9e-9496-2fab859695e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:40:24 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c8ad04a2-1026-415a-b801-d4a58121834e tempest-CinderUnicodeTest-1069380389 None] Flow 'volume_create_manager' (f2ef744b-fd26-4416-958a-ba4f2ad48b41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:40:24 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-c8ad04a2-1026-415a-b801-d4a58121834e tempest-CinderUnicodeTest-1069380389 None] Created volume successfully. Nov 06 15:40:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-865ef9d3-fae1-44db-a4eb-a253760f10c0 tempest-CinderUnicodeTest-1069380389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:40:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-865ef9d3-fae1-44db-a4eb-a253760f10c0 tempest-CinderUnicodeTest-1069380389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:40:25 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-865ef9d3-fae1-44db-a4eb-a253760f10c0 tempest-CinderUnicodeTest-1069380389 None] Creating offline snapshot 831496cf-dd39-43c8-aeb9-066fc95570cf of volume f364e664-d42a-434e-bed2-93aeccfd77e2 {{(pid=87132) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 15:40:25 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[8388d681-a746-40e4-bf3e-e97d5a82259e]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:40:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-865ef9d3-fae1-44db-a4eb-a253760f10c0 tempest-CinderUnicodeTest-1069380389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f364e664-d42a-434e-bed2-93aeccfd77e2 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:40:25 devstack sudo[106970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f364e664-d42a-434e-bed2-93aeccfd77e2 Nov 06 15:40:25 devstack sudo[106970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:40:25 devstack sudo[106970]: pam_unix(sudo:session): session closed for user root Nov 06 15:40:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-865ef9d3-fae1-44db-a4eb-a253760f10c0 tempest-CinderUnicodeTest-1069380389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f364e664-d42a-434e-bed2-93aeccfd77e2" returned: 0 in 0.350s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:40:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-865ef9d3-fae1-44db-a4eb-a253760f10c0 tempest-CinderUnicodeTest-1069380389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f364e664-d42a-434e-bed2-93aeccfd77e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f364e664-d42a-434e-bed2-93aeccfd77e2.831496cf-dd39-43c8-aeb9-066fc95570cf 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:40:25 devstack sudo[106975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f364e664-d42a-434e-bed2-93aeccfd77e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f364e664-d42a-434e-bed2-93aeccfd77e2.831496cf-dd39-43c8-aeb9-066fc95570cf 1G Nov 06 15:40:25 devstack sudo[106975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:40:25 devstack sudo[106975]: pam_unix(sudo:session): session closed for user root Nov 06 15:40:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-865ef9d3-fae1-44db-a4eb-a253760f10c0 tempest-CinderUnicodeTest-1069380389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f364e664-d42a-434e-bed2-93aeccfd77e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f364e664-d42a-434e-bed2-93aeccfd77e2.831496cf-dd39-43c8-aeb9-066fc95570cf 1G" returned: 0 in 0.382s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:40:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-865ef9d3-fae1-44db-a4eb-a253760f10c0 tempest-CinderUnicodeTest-1069380389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f364e664-d42a-434e-bed2-93aeccfd77e2 -F qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f364e664-d42a-434e-bed2-93aeccfd77e2.831496cf-dd39-43c8-aeb9-066fc95570cf {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:40:25 devstack sudo[106981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f364e664-d42a-434e-bed2-93aeccfd77e2 -F qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f364e664-d42a-434e-bed2-93aeccfd77e2.831496cf-dd39-43c8-aeb9-066fc95570cf Nov 06 15:40:25 devstack sudo[106981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:40:26 devstack sudo[106981]: pam_unix(sudo:session): session closed for user root Nov 06 15:40:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-865ef9d3-fae1-44db-a4eb-a253760f10c0 tempest-CinderUnicodeTest-1069380389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f364e664-d42a-434e-bed2-93aeccfd77e2 -F qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f364e664-d42a-434e-bed2-93aeccfd77e2.831496cf-dd39-43c8-aeb9-066fc95570cf" returned: 0 in 0.298s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:40:26 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-865ef9d3-fae1-44db-a4eb-a253760f10c0 tempest-CinderUnicodeTest-1069380389 None] /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f364e664-d42a-434e-bed2-93aeccfd77e2.831496cf-dd39-43c8-aeb9-066fc95570cf is being set with open permissions: ugo+rw Nov 06 15:40:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-865ef9d3-fae1-44db-a4eb-a253760f10c0 tempest-CinderUnicodeTest-1069380389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f364e664-d42a-434e-bed2-93aeccfd77e2.831496cf-dd39-43c8-aeb9-066fc95570cf {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:40:26 devstack sudo[106986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f364e664-d42a-434e-bed2-93aeccfd77e2.831496cf-dd39-43c8-aeb9-066fc95570cf Nov 06 15:40:26 devstack sudo[106986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:40:26 devstack sudo[106986]: pam_unix(sudo:session): session closed for user root Nov 06 15:40:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-865ef9d3-fae1-44db-a4eb-a253760f10c0 tempest-CinderUnicodeTest-1069380389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f364e664-d42a-434e-bed2-93aeccfd77e2.831496cf-dd39-43c8-aeb9-066fc95570cf" returned: 0 in 0.236s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:40:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-865ef9d3-fae1-44db-a4eb-a253760f10c0 tempest-CinderUnicodeTest-1069380389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f364e664-d42a-434e-bed2-93aeccfd77e2.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:40:26 devstack sudo[106989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f364e664-d42a-434e-bed2-93aeccfd77e2.info Nov 06 15:40:26 devstack sudo[106989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:40:26 devstack sudo[106989]: pam_unix(sudo:session): session closed for user root Nov 06 15:40:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-865ef9d3-fae1-44db-a4eb-a253760f10c0 tempest-CinderUnicodeTest-1069380389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f364e664-d42a-434e-bed2-93aeccfd77e2.info" returned: 0 in 0.247s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:40:26 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-865ef9d3-fae1-44db-a4eb-a253760f10c0 tempest-CinderUnicodeTest-1069380389 None] /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f364e664-d42a-434e-bed2-93aeccfd77e2.info is being set with open permissions: ugo+rw Nov 06 15:40:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-865ef9d3-fae1-44db-a4eb-a253760f10c0 tempest-CinderUnicodeTest-1069380389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f364e664-d42a-434e-bed2-93aeccfd77e2.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:40:26 devstack sudo[106992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f364e664-d42a-434e-bed2-93aeccfd77e2.info Nov 06 15:40:26 devstack sudo[106992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:40:27 devstack sudo[106992]: pam_unix(sudo:session): session closed for user root Nov 06 15:40:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-865ef9d3-fae1-44db-a4eb-a253760f10c0 tempest-CinderUnicodeTest-1069380389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f364e664-d42a-434e-bed2-93aeccfd77e2.info" returned: 0 in 0.236s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:40:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-865ef9d3-fae1-44db-a4eb-a253760f10c0 tempest-CinderUnicodeTest-1069380389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.834s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:40:27 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-865ef9d3-fae1-44db-a4eb-a253760f10c0 tempest-CinderUnicodeTest-1069380389 None] Create snapshot completed successfully Nov 06 15:40:27 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-dfc9bb83-1af6-4bf0-9bcd-122d87d23b43 tempest-CinderUnicodeTest-1069380389 None] Acquiring lock "cinder-831496cf-dd39-43c8-aeb9-066fc95570cf-delete_snapshot" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:40:27 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-dfc9bb83-1af6-4bf0-9bcd-122d87d23b43 tempest-CinderUnicodeTest-1069380389 None] Lock "cinder-831496cf-dd39-43c8-aeb9-066fc95570cf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:40:27 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-dfc9bb83-1af6-4bf0-9bcd-122d87d23b43 tempest-CinderUnicodeTest-1069380389 None] Acquiring lock "cinder-quobyte-f364e664-d42a-434e-bed2-93aeccfd77e2" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:40:27 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-dfc9bb83-1af6-4bf0-9bcd-122d87d23b43 tempest-CinderUnicodeTest-1069380389 None] Lock "cinder-quobyte-f364e664-d42a-434e-bed2-93aeccfd77e2" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:40:27 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-dfc9bb83-1af6-4bf0-9bcd-122d87d23b43 tempest-CinderUnicodeTest-1069380389 None] Acquiring lock "cinder-quobyte-831496cf-dd39-43c8-aeb9-066fc95570cf" by "_delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:40:27 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-dfc9bb83-1af6-4bf0-9bcd-122d87d23b43 tempest-CinderUnicodeTest-1069380389 None] Lock "cinder-quobyte-831496cf-dd39-43c8-aeb9-066fc95570cf" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:40:27 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-dfc9bb83-1af6-4bf0-9bcd-122d87d23b43 tempest-CinderUnicodeTest-1069380389 None] Deleting offline snapshot 831496cf-dd39-43c8-aeb9-066fc95570cf of volume f364e664-d42a-434e-bed2-93aeccfd77e2 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 15:40:27 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-dfc9bb83-1af6-4bf0-9bcd-122d87d23b43 tempest-CinderUnicodeTest-1069380389 None] snapshot_file for this snap is: volume-f364e664-d42a-434e-bed2-93aeccfd77e2.831496cf-dd39-43c8-aeb9-066fc95570cf {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 15:40:27 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f30e5bd-ed6c-4b1d-901a-c98ded2adb1a]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:40:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-dfc9bb83-1af6-4bf0-9bcd-122d87d23b43 tempest-CinderUnicodeTest-1069380389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f364e664-d42a-434e-bed2-93aeccfd77e2.831496cf-dd39-43c8-aeb9-066fc95570cf {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:40:27 devstack sudo[106995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f364e664-d42a-434e-bed2-93aeccfd77e2.831496cf-dd39-43c8-aeb9-066fc95570cf Nov 06 15:40:27 devstack sudo[106995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:40:27 devstack sudo[106995]: pam_unix(sudo:session): session closed for user root Nov 06 15:40:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-dfc9bb83-1af6-4bf0-9bcd-122d87d23b43 tempest-CinderUnicodeTest-1069380389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f364e664-d42a-434e-bed2-93aeccfd77e2.831496cf-dd39-43c8-aeb9-066fc95570cf" returned: 0 in 0.351s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:40:27 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-dfc9bb83-1af6-4bf0-9bcd-122d87d23b43 tempest-CinderUnicodeTest-1069380389 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f364e664-d42a-434e-bed2-93aeccfd77e2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 15:40:27 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[af7d96cf-c9ec-45ed-b403-ed16680c3d4f]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:40:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-dfc9bb83-1af6-4bf0-9bcd-122d87d23b43 tempest-CinderUnicodeTest-1069380389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f364e664-d42a-434e-bed2-93aeccfd77e2 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:40:27 devstack sudo[107000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f364e664-d42a-434e-bed2-93aeccfd77e2 Nov 06 15:40:27 devstack sudo[107000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:40:28 devstack sudo[107000]: pam_unix(sudo:session): session closed for user root Nov 06 15:40:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-dfc9bb83-1af6-4bf0-9bcd-122d87d23b43 tempest-CinderUnicodeTest-1069380389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f364e664-d42a-434e-bed2-93aeccfd77e2" returned: 0 in 0.352s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:40:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-dfc9bb83-1af6-4bf0-9bcd-122d87d23b43 tempest-CinderUnicodeTest-1069380389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f364e664-d42a-434e-bed2-93aeccfd77e2.831496cf-dd39-43c8-aeb9-066fc95570cf {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:40:28 devstack sudo[107005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f364e664-d42a-434e-bed2-93aeccfd77e2.831496cf-dd39-43c8-aeb9-066fc95570cf Nov 06 15:40:28 devstack sudo[107005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:40:28 devstack sudo[107005]: pam_unix(sudo:session): session closed for user root Nov 06 15:40:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-dfc9bb83-1af6-4bf0-9bcd-122d87d23b43 tempest-CinderUnicodeTest-1069380389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f364e664-d42a-434e-bed2-93aeccfd77e2.831496cf-dd39-43c8-aeb9-066fc95570cf" returned: 0 in 0.324s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:40:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-dfc9bb83-1af6-4bf0-9bcd-122d87d23b43 tempest-CinderUnicodeTest-1069380389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f364e664-d42a-434e-bed2-93aeccfd77e2.831496cf-dd39-43c8-aeb9-066fc95570cf {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:40:28 devstack sudo[107010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f364e664-d42a-434e-bed2-93aeccfd77e2.831496cf-dd39-43c8-aeb9-066fc95570cf Nov 06 15:40:28 devstack sudo[107010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:40:28 devstack sudo[107010]: pam_unix(sudo:session): session closed for user root Nov 06 15:40:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-dfc9bb83-1af6-4bf0-9bcd-122d87d23b43 tempest-CinderUnicodeTest-1069380389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f364e664-d42a-434e-bed2-93aeccfd77e2.831496cf-dd39-43c8-aeb9-066fc95570cf" returned: 0 in 0.247s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:40:28 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-dfc9bb83-1af6-4bf0-9bcd-122d87d23b43 tempest-CinderUnicodeTest-1069380389 None] Lock "cinder-quobyte-831496cf-dd39-43c8-aeb9-066fc95570cf" released by "_delete_snapshot" :: held 1.374s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:40:28 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-dfc9bb83-1af6-4bf0-9bcd-122d87d23b43 tempest-CinderUnicodeTest-1069380389 None] Lock "cinder-quobyte-f364e664-d42a-434e-bed2-93aeccfd77e2" released by "delete_snapshot" :: held 1.394s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:40:28 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-dfc9bb83-1af6-4bf0-9bcd-122d87d23b43 tempest-CinderUnicodeTest-1069380389 None] Created reservations ['9a0c5a02-9b65-44e6-ba03-81cccf656846', '96be1828-dd35-4684-98c8-6d68411b4e76', '62fdd198-dc5e-4924-a19d-bb5d4e9ed72a', '3e2710e4-c082-4f5a-8d3a-1af800e003ca'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:40:28 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-dfc9bb83-1af6-4bf0-9bcd-122d87d23b43 tempest-CinderUnicodeTest-1069380389 None] Delete snapshot completed successfully. Nov 06 15:40:28 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-dfc9bb83-1af6-4bf0-9bcd-122d87d23b43 tempest-CinderUnicodeTest-1069380389 None] Lock "cinder-831496cf-dd39-43c8-aeb9-066fc95570cf-delete_snapshot" released by "delete_snapshot" :: held 1.512s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:40:29 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-53e5f776-2789-455f-85c4-93b7ad615a1b tempest-CinderUnicodeTest-1069380389 None] Acquiring lock "cinder-f364e664-d42a-434e-bed2-93aeccfd77e2-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:40:29 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-53e5f776-2789-455f-85c4-93b7ad615a1b tempest-CinderUnicodeTest-1069380389 None] Lock "cinder-f364e664-d42a-434e-bed2-93aeccfd77e2-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:40:29 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-53e5f776-2789-455f-85c4-93b7ad615a1b tempest-CinderUnicodeTest-1069380389 None] Acquiring lock "cinder-quobyte-f364e664-d42a-434e-bed2-93aeccfd77e2" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:40:29 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-53e5f776-2789-455f-85c4-93b7ad615a1b tempest-CinderUnicodeTest-1069380389 None] Lock "cinder-quobyte-f364e664-d42a-434e-bed2-93aeccfd77e2" acquired by "delete_volume" :: waited 0.021s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:40:29 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[66725dbd-5f94-4117-9b73-b7f42b6d5a24]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:40:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-53e5f776-2789-455f-85c4-93b7ad615a1b tempest-CinderUnicodeTest-1069380389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f364e664-d42a-434e-bed2-93aeccfd77e2 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:40:29 devstack sudo[107013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f364e664-d42a-434e-bed2-93aeccfd77e2 Nov 06 15:40:29 devstack sudo[107013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:40:29 devstack sudo[107013]: pam_unix(sudo:session): session closed for user root Nov 06 15:40:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-53e5f776-2789-455f-85c4-93b7ad615a1b tempest-CinderUnicodeTest-1069380389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f364e664-d42a-434e-bed2-93aeccfd77e2" returned: 0 in 0.347s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:40:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-53e5f776-2789-455f-85c4-93b7ad615a1b tempest-CinderUnicodeTest-1069380389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f364e664-d42a-434e-bed2-93aeccfd77e2 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:40:29 devstack sudo[107018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f364e664-d42a-434e-bed2-93aeccfd77e2 Nov 06 15:40:29 devstack sudo[107018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:40:30 devstack sudo[107018]: pam_unix(sudo:session): session closed for user root Nov 06 15:40:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-53e5f776-2789-455f-85c4-93b7ad615a1b tempest-CinderUnicodeTest-1069380389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f364e664-d42a-434e-bed2-93aeccfd77e2" returned: 0 in 0.242s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:40:30 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-53e5f776-2789-455f-85c4-93b7ad615a1b tempest-CinderUnicodeTest-1069380389 None] Lock "cinder-quobyte-f364e664-d42a-434e-bed2-93aeccfd77e2" released by "delete_volume" :: held 0.648s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:40:30 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-53e5f776-2789-455f-85c4-93b7ad615a1b tempest-CinderUnicodeTest-1069380389 None] Created reservations ['59d73a8e-2cde-4c3e-930e-b3be60c75dd1', 'b821e657-aaac-4a1e-ad99-af81ed4583f3', '06f8fa6e-93df-437a-8c38-fcc5c3374160', 'd4fabfcb-1acd-45ad-8769-32c589a9310a'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:40:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-53e5f776-2789-455f-85c4-93b7ad615a1b tempest-CinderUnicodeTest-1069380389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:40:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-53e5f776-2789-455f-85c4-93b7ad615a1b tempest-CinderUnicodeTest-1069380389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:40:30 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-53e5f776-2789-455f-85c4-93b7ad615a1b tempest-CinderUnicodeTest-1069380389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:40:30 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-53e5f776-2789-455f-85c4-93b7ad615a1b tempest-CinderUnicodeTest-1069380389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:40:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-53e5f776-2789-455f-85c4-93b7ad615a1b tempest-CinderUnicodeTest-1069380389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:40:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-53e5f776-2789-455f-85c4-93b7ad615a1b tempest-CinderUnicodeTest-1069380389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:40:30 devstack sudo[107021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:40:30 devstack sudo[107021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:40:30 devstack sudo[107021]: pam_unix(sudo:session): session closed for user root Nov 06 15:40:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-53e5f776-2789-455f-85c4-93b7ad615a1b tempest-CinderUnicodeTest-1069380389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.239s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:40:30 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-53e5f776-2789-455f-85c4-93b7ad615a1b tempest-CinderUnicodeTest-1069380389 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:40:30 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-53e5f776-2789-455f-85c4-93b7ad615a1b tempest-CinderUnicodeTest-1069380389 None] Deleted volume successfully. Nov 06 15:40:30 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-53e5f776-2789-455f-85c4-93b7ad615a1b tempest-CinderUnicodeTest-1069380389 None] Lock "cinder-f364e664-d42a-434e-bed2-93aeccfd77e2-delete_volume" released by "delete_volume" :: held 1.083s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:40:30 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-55bef340-0f86-40b3-bc0d-0cbcd53d653d tempest-CinderUnicodeTest-1069380389 None] Acquiring lock "cinder-e9499b39-32bb-476e-b072-c4541722d959-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:40:30 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-55bef340-0f86-40b3-bc0d-0cbcd53d653d tempest-CinderUnicodeTest-1069380389 None] Lock "cinder-e9499b39-32bb-476e-b072-c4541722d959-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:40:30 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-55bef340-0f86-40b3-bc0d-0cbcd53d653d tempest-CinderUnicodeTest-1069380389 None] Acquiring lock "cinder-quobyte-e9499b39-32bb-476e-b072-c4541722d959" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:40:30 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-55bef340-0f86-40b3-bc0d-0cbcd53d653d tempest-CinderUnicodeTest-1069380389 None] Lock "cinder-quobyte-e9499b39-32bb-476e-b072-c4541722d959" acquired by "delete_volume" :: waited 0.015s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:40:30 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fc2c6d0-becd-4fad-8134-921b07194a17]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:40:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-55bef340-0f86-40b3-bc0d-0cbcd53d653d tempest-CinderUnicodeTest-1069380389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-e9499b39-32bb-476e-b072-c4541722d959 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:40:30 devstack sudo[107024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-e9499b39-32bb-476e-b072-c4541722d959 Nov 06 15:40:30 devstack sudo[107024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:40:31 devstack sudo[107024]: pam_unix(sudo:session): session closed for user root Nov 06 15:40:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-55bef340-0f86-40b3-bc0d-0cbcd53d653d tempest-CinderUnicodeTest-1069380389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-e9499b39-32bb-476e-b072-c4541722d959" returned: 0 in 0.352s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:40:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-55bef340-0f86-40b3-bc0d-0cbcd53d653d tempest-CinderUnicodeTest-1069380389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-e9499b39-32bb-476e-b072-c4541722d959 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:40:31 devstack sudo[107029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-e9499b39-32bb-476e-b072-c4541722d959 Nov 06 15:40:31 devstack sudo[107029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:40:31 devstack sudo[107029]: pam_unix(sudo:session): session closed for user root Nov 06 15:40:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-55bef340-0f86-40b3-bc0d-0cbcd53d653d tempest-CinderUnicodeTest-1069380389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-e9499b39-32bb-476e-b072-c4541722d959" returned: 0 in 0.238s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:40:31 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-55bef340-0f86-40b3-bc0d-0cbcd53d653d tempest-CinderUnicodeTest-1069380389 None] Lock "cinder-quobyte-e9499b39-32bb-476e-b072-c4541722d959" released by "delete_volume" :: held 0.630s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:40:31 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-55bef340-0f86-40b3-bc0d-0cbcd53d653d tempest-CinderUnicodeTest-1069380389 None] Created reservations ['59ea9f05-b259-45b5-b4a8-efccb5358cba', '2eb3b319-69e9-4ad6-b8d6-faab5f5ba7d8', '79ad448e-26d0-4b99-b556-537fa9dbe332', '7a5bb262-f15e-470a-a754-27673f63948f'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:40:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-55bef340-0f86-40b3-bc0d-0cbcd53d653d tempest-CinderUnicodeTest-1069380389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:40:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-55bef340-0f86-40b3-bc0d-0cbcd53d653d tempest-CinderUnicodeTest-1069380389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:40:31 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-55bef340-0f86-40b3-bc0d-0cbcd53d653d tempest-CinderUnicodeTest-1069380389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:40:31 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-55bef340-0f86-40b3-bc0d-0cbcd53d653d tempest-CinderUnicodeTest-1069380389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:40:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-55bef340-0f86-40b3-bc0d-0cbcd53d653d tempest-CinderUnicodeTest-1069380389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:40:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-55bef340-0f86-40b3-bc0d-0cbcd53d653d tempest-CinderUnicodeTest-1069380389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:40:31 devstack sudo[107032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:40:31 devstack sudo[107032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:40:31 devstack sudo[107032]: pam_unix(sudo:session): session closed for user root Nov 06 15:40:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-55bef340-0f86-40b3-bc0d-0cbcd53d653d tempest-CinderUnicodeTest-1069380389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.236s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:40:31 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-55bef340-0f86-40b3-bc0d-0cbcd53d653d tempest-CinderUnicodeTest-1069380389 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:40:31 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-55bef340-0f86-40b3-bc0d-0cbcd53d653d tempest-CinderUnicodeTest-1069380389 None] Deleted volume successfully. Nov 06 15:40:31 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-55bef340-0f86-40b3-bc0d-0cbcd53d653d tempest-CinderUnicodeTest-1069380389 None] Lock "cinder-e9499b39-32bb-476e-b072-c4541722d959-delete_volume" released by "delete_volume" :: held 1.045s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:40:34 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8ddcc65-7554-48cc-80a0-ca769faa2794 tempest-ProjectReaderTests-1454810006 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:40:34 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a8ddcc65-7554-48cc-80a0-ca769faa2794 tempest-ProjectReaderTests-1454810006 None] Flow 'volume_create_manager' (1013e4d9-fd0c-4dc5-a559-90167b42e39c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:40:34 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a8ddcc65-7554-48cc-80a0-ca769faa2794 tempest-ProjectReaderTests-1454810006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd5f3db7-9c31-4105-beb6-1f63404aa583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:40:34 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a8ddcc65-7554-48cc-80a0-ca769faa2794 tempest-ProjectReaderTests-1454810006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd5f3db7-9c31-4105-beb6-1f63404aa583) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:40:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-269736437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be3b129a-bf58-44a7-b8fd-1d7eaaa0bccf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11fcc47ac12048a8ae2bf74a67c783a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:40:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:40:35Z,use_quota=True,user_id='7cee42688b45431ab0fdabf055095eac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:40:34 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a8ddcc65-7554-48cc-80a0-ca769faa2794 tempest-ProjectReaderTests-1454810006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60e96c89-02be-414f-beab-9b8692140b1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:40:35 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a8ddcc65-7554-48cc-80a0-ca769faa2794 tempest-ProjectReaderTests-1454810006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60e96c89-02be-414f-beab-9b8692140b1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:40:35 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a8ddcc65-7554-48cc-80a0-ca769faa2794 tempest-ProjectReaderTests-1454810006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (990712b3-d159-467b-aafc-8033ed97393c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:40:35 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a8ddcc65-7554-48cc-80a0-ca769faa2794 tempest-ProjectReaderTests-1454810006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (990712b3-d159-467b-aafc-8033ed97393c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be3b129a-bf58-44a7-b8fd-1d7eaaa0bccf', 'volume_name': 'volume-be3b129a-bf58-44a7-b8fd-1d7eaaa0bccf', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:40:35 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a8ddcc65-7554-48cc-80a0-ca769faa2794 tempest-ProjectReaderTests-1454810006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9eac446c-5750-482c-a0ec-f650ce4e7b33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:40:35 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a8ddcc65-7554-48cc-80a0-ca769faa2794 tempest-ProjectReaderTests-1454810006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9eac446c-5750-482c-a0ec-f650ce4e7b33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:40:35 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a8ddcc65-7554-48cc-80a0-ca769faa2794 tempest-ProjectReaderTests-1454810006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e803eb57-d195-4d8a-9e0a-5abdfb1a8fc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:40:35 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-a8ddcc65-7554-48cc-80a0-ca769faa2794 tempest-ProjectReaderTests-1454810006 None] Volume be3b129a-bf58-44a7-b8fd-1d7eaaa0bccf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be3b129a-bf58-44a7-b8fd-1d7eaaa0bccf', 'volume_size': 1} Nov 06 15:40:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a8ddcc65-7554-48cc-80a0-ca769faa2794 tempest-ProjectReaderTests-1454810006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:40:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a8ddcc65-7554-48cc-80a0-ca769faa2794 tempest-ProjectReaderTests-1454810006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:40:35 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-a8ddcc65-7554-48cc-80a0-ca769faa2794 tempest-ProjectReaderTests-1454810006 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:40:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-269736437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be3b129a-bf58-44a7-b8fd-1d7eaaa0bccf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11fcc47ac12048a8ae2bf74a67c783a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:40:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:40:35Z,use_quota=True,user_id='7cee42688b45431ab0fdabf055095eac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:40:35 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-a8ddcc65-7554-48cc-80a0-ca769faa2794 tempest-ProjectReaderTests-1454810006 None] Creating volume be3b129a-bf58-44a7-b8fd-1d7eaaa0bccf {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:40:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a8ddcc65-7554-48cc-80a0-ca769faa2794 tempest-ProjectReaderTests-1454810006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:40:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a8ddcc65-7554-48cc-80a0-ca769faa2794 tempest-ProjectReaderTests-1454810006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:40:35 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-a8ddcc65-7554-48cc-80a0-ca769faa2794 tempest-ProjectReaderTests-1454810006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:40:35 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-a8ddcc65-7554-48cc-80a0-ca769faa2794 tempest-ProjectReaderTests-1454810006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:40:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a8ddcc65-7554-48cc-80a0-ca769faa2794 tempest-ProjectReaderTests-1454810006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:40:35 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-a8ddcc65-7554-48cc-80a0-ca769faa2794 tempest-ProjectReaderTests-1454810006 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:40:35 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-a8ddcc65-7554-48cc-80a0-ca769faa2794 tempest-ProjectReaderTests-1454810006 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:40:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a8ddcc65-7554-48cc-80a0-ca769faa2794 tempest-ProjectReaderTests-1454810006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-be3b129a-bf58-44a7-b8fd-1d7eaaa0bccf 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:40:35 devstack sudo[107035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-be3b129a-bf58-44a7-b8fd-1d7eaaa0bccf 1073741824 Nov 06 15:40:35 devstack sudo[107035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:40:35 devstack sudo[107035]: pam_unix(sudo:session): session closed for user root Nov 06 15:40:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a8ddcc65-7554-48cc-80a0-ca769faa2794 tempest-ProjectReaderTests-1454810006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-be3b129a-bf58-44a7-b8fd-1d7eaaa0bccf 1073741824" returned: 0 in 0.400s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:40:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a8ddcc65-7554-48cc-80a0-ca769faa2794 tempest-ProjectReaderTests-1454810006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-be3b129a-bf58-44a7-b8fd-1d7eaaa0bccf {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:40:35 devstack sudo[107040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-be3b129a-bf58-44a7-b8fd-1d7eaaa0bccf Nov 06 15:40:35 devstack sudo[107040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:40:35 devstack sudo[107040]: pam_unix(sudo:session): session closed for user root Nov 06 15:40:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a8ddcc65-7554-48cc-80a0-ca769faa2794 tempest-ProjectReaderTests-1454810006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-be3b129a-bf58-44a7-b8fd-1d7eaaa0bccf" returned: 0 in 0.237s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:40:35 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-a8ddcc65-7554-48cc-80a0-ca769faa2794 tempest-ProjectReaderTests-1454810006 None] <== create_volume: return (680ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:40:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a8ddcc65-7554-48cc-80a0-ca769faa2794 tempest-ProjectReaderTests-1454810006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.682s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:40:35 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a8ddcc65-7554-48cc-80a0-ca769faa2794 tempest-ProjectReaderTests-1454810006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e803eb57-d195-4d8a-9e0a-5abdfb1a8fc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be3b129a-bf58-44a7-b8fd-1d7eaaa0bccf', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:40:35 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a8ddcc65-7554-48cc-80a0-ca769faa2794 tempest-ProjectReaderTests-1454810006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07fd7f25-453f-4ab0-bbe4-1bb1e74bed25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:40:35 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-a8ddcc65-7554-48cc-80a0-ca769faa2794 tempest-ProjectReaderTests-1454810006 None] Volume volume-be3b129a-bf58-44a7-b8fd-1d7eaaa0bccf (be3b129a-bf58-44a7-b8fd-1d7eaaa0bccf): created successfully Nov 06 15:40:35 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a8ddcc65-7554-48cc-80a0-ca769faa2794 tempest-ProjectReaderTests-1454810006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07fd7f25-453f-4ab0-bbe4-1bb1e74bed25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:40:35 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a8ddcc65-7554-48cc-80a0-ca769faa2794 tempest-ProjectReaderTests-1454810006 None] Flow 'volume_create_manager' (1013e4d9-fd0c-4dc5-a559-90167b42e39c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:40:35 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-a8ddcc65-7554-48cc-80a0-ca769faa2794 tempest-ProjectReaderTests-1454810006 None] Created volume successfully. Nov 06 15:40:36 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-ec82501b-db56-4084-9892-a40f960ac6fa tempest-ProjectReaderTests-1454810006 None] Acquiring lock "cinder-be3b129a-bf58-44a7-b8fd-1d7eaaa0bccf-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:40:36 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-ec82501b-db56-4084-9892-a40f960ac6fa tempest-ProjectReaderTests-1454810006 None] Lock "cinder-be3b129a-bf58-44a7-b8fd-1d7eaaa0bccf-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:40:36 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-ec82501b-db56-4084-9892-a40f960ac6fa tempest-ProjectReaderTests-1454810006 None] Acquiring lock "cinder-quobyte-be3b129a-bf58-44a7-b8fd-1d7eaaa0bccf" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:40:36 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-ec82501b-db56-4084-9892-a40f960ac6fa tempest-ProjectReaderTests-1454810006 None] Lock "cinder-quobyte-be3b129a-bf58-44a7-b8fd-1d7eaaa0bccf" acquired by "delete_volume" :: waited 0.015s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:40:36 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[4719c557-a775-4532-b2fb-282790c8384b]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:40:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ec82501b-db56-4084-9892-a40f960ac6fa tempest-ProjectReaderTests-1454810006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-be3b129a-bf58-44a7-b8fd-1d7eaaa0bccf {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:40:36 devstack sudo[107044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-be3b129a-bf58-44a7-b8fd-1d7eaaa0bccf Nov 06 15:40:36 devstack sudo[107044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:40:36 devstack sudo[107044]: pam_unix(sudo:session): session closed for user root Nov 06 15:40:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ec82501b-db56-4084-9892-a40f960ac6fa tempest-ProjectReaderTests-1454810006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-be3b129a-bf58-44a7-b8fd-1d7eaaa0bccf" returned: 0 in 0.357s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:40:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ec82501b-db56-4084-9892-a40f960ac6fa tempest-ProjectReaderTests-1454810006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-be3b129a-bf58-44a7-b8fd-1d7eaaa0bccf {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:40:36 devstack sudo[107049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-be3b129a-bf58-44a7-b8fd-1d7eaaa0bccf Nov 06 15:40:36 devstack sudo[107049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:40:36 devstack sudo[107049]: pam_unix(sudo:session): session closed for user root Nov 06 15:40:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ec82501b-db56-4084-9892-a40f960ac6fa tempest-ProjectReaderTests-1454810006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-be3b129a-bf58-44a7-b8fd-1d7eaaa0bccf" returned: 0 in 0.237s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:40:36 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-ec82501b-db56-4084-9892-a40f960ac6fa tempest-ProjectReaderTests-1454810006 None] Lock "cinder-quobyte-be3b129a-bf58-44a7-b8fd-1d7eaaa0bccf" released by "delete_volume" :: held 0.633s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:40:36 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-ec82501b-db56-4084-9892-a40f960ac6fa tempest-ProjectReaderTests-1454810006 None] Created reservations ['0dd66d31-09ec-4c12-bfe7-177be0bf9966', '0ac8102c-2b8c-4212-8c84-21f0958031aa', '060fd43a-f15e-44c8-88fb-df0314ae53de', '2530f328-0314-427c-88ae-90687dd4cfb5'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:40:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ec82501b-db56-4084-9892-a40f960ac6fa tempest-ProjectReaderTests-1454810006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:40:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ec82501b-db56-4084-9892-a40f960ac6fa tempest-ProjectReaderTests-1454810006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:40:36 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-ec82501b-db56-4084-9892-a40f960ac6fa tempest-ProjectReaderTests-1454810006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:40:36 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-ec82501b-db56-4084-9892-a40f960ac6fa tempest-ProjectReaderTests-1454810006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:40:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ec82501b-db56-4084-9892-a40f960ac6fa tempest-ProjectReaderTests-1454810006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:40:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ec82501b-db56-4084-9892-a40f960ac6fa tempest-ProjectReaderTests-1454810006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:40:36 devstack sudo[107052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:40:36 devstack sudo[107052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:40:37 devstack sudo[107052]: pam_unix(sudo:session): session closed for user root Nov 06 15:40:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ec82501b-db56-4084-9892-a40f960ac6fa tempest-ProjectReaderTests-1454810006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.242s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:40:37 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-ec82501b-db56-4084-9892-a40f960ac6fa tempest-ProjectReaderTests-1454810006 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:40:37 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-ec82501b-db56-4084-9892-a40f960ac6fa tempest-ProjectReaderTests-1454810006 None] Deleted volume successfully. Nov 06 15:40:37 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-ec82501b-db56-4084-9892-a40f960ac6fa tempest-ProjectReaderTests-1454810006 None] Lock "cinder-be3b129a-bf58-44a7-b8fd-1d7eaaa0bccf-delete_volume" released by "delete_volume" :: held 1.057s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:40:37 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-8121c17f-0966-45d8-b319-67b301aae512 tempest-ProjectReaderTests-1454810006 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:40:37 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8121c17f-0966-45d8-b319-67b301aae512 tempest-ProjectReaderTests-1454810006 None] Flow 'volume_create_manager' (8817a78b-d520-4161-baa9-19c52487df33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:40:37 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8121c17f-0966-45d8-b319-67b301aae512 tempest-ProjectReaderTests-1454810006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7dd2512-be03-4ef3-b79e-a0cca76d2be9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:40:37 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8121c17f-0966-45d8-b319-67b301aae512 tempest-ProjectReaderTests-1454810006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7dd2512-be03-4ef3-b79e-a0cca76d2be9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:40:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1578452698',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab2e7c96-babd-4d37-bcb0-96239035285f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11fcc47ac12048a8ae2bf74a67c783a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:40:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:40:38Z,use_quota=True,user_id='7cee42688b45431ab0fdabf055095eac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:40:37 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8121c17f-0966-45d8-b319-67b301aae512 tempest-ProjectReaderTests-1454810006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e1f33f0-868b-45f9-8a39-c2f5b873a928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:40:37 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8121c17f-0966-45d8-b319-67b301aae512 tempest-ProjectReaderTests-1454810006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e1f33f0-868b-45f9-8a39-c2f5b873a928) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:40:37 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8121c17f-0966-45d8-b319-67b301aae512 tempest-ProjectReaderTests-1454810006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e94de111-e759-4a92-8cf2-9a056ad67c17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:40:37 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8121c17f-0966-45d8-b319-67b301aae512 tempest-ProjectReaderTests-1454810006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e94de111-e759-4a92-8cf2-9a056ad67c17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab2e7c96-babd-4d37-bcb0-96239035285f', 'volume_name': 'volume-ab2e7c96-babd-4d37-bcb0-96239035285f', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:40:37 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8121c17f-0966-45d8-b319-67b301aae512 tempest-ProjectReaderTests-1454810006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b40c236-1825-45b4-b193-2c93df4dba5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:40:37 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8121c17f-0966-45d8-b319-67b301aae512 tempest-ProjectReaderTests-1454810006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b40c236-1825-45b4-b193-2c93df4dba5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:40:37 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8121c17f-0966-45d8-b319-67b301aae512 tempest-ProjectReaderTests-1454810006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a9c56bb-87fe-4dcc-8c39-7d11171efb6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:40:37 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-8121c17f-0966-45d8-b319-67b301aae512 tempest-ProjectReaderTests-1454810006 None] Volume ab2e7c96-babd-4d37-bcb0-96239035285f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab2e7c96-babd-4d37-bcb0-96239035285f', 'volume_size': 1} Nov 06 15:40:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8121c17f-0966-45d8-b319-67b301aae512 tempest-ProjectReaderTests-1454810006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:40:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8121c17f-0966-45d8-b319-67b301aae512 tempest-ProjectReaderTests-1454810006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:40:37 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-8121c17f-0966-45d8-b319-67b301aae512 tempest-ProjectReaderTests-1454810006 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:40:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1578452698',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab2e7c96-babd-4d37-bcb0-96239035285f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11fcc47ac12048a8ae2bf74a67c783a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:40:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:40:38Z,use_quota=True,user_id='7cee42688b45431ab0fdabf055095eac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:40:37 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-8121c17f-0966-45d8-b319-67b301aae512 tempest-ProjectReaderTests-1454810006 None] Creating volume ab2e7c96-babd-4d37-bcb0-96239035285f {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:40:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8121c17f-0966-45d8-b319-67b301aae512 tempest-ProjectReaderTests-1454810006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:40:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8121c17f-0966-45d8-b319-67b301aae512 tempest-ProjectReaderTests-1454810006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:40:37 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-8121c17f-0966-45d8-b319-67b301aae512 tempest-ProjectReaderTests-1454810006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:40:37 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-8121c17f-0966-45d8-b319-67b301aae512 tempest-ProjectReaderTests-1454810006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:40:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8121c17f-0966-45d8-b319-67b301aae512 tempest-ProjectReaderTests-1454810006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:40:37 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-8121c17f-0966-45d8-b319-67b301aae512 tempest-ProjectReaderTests-1454810006 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:40:37 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-8121c17f-0966-45d8-b319-67b301aae512 tempest-ProjectReaderTests-1454810006 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:40:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8121c17f-0966-45d8-b319-67b301aae512 tempest-ProjectReaderTests-1454810006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ab2e7c96-babd-4d37-bcb0-96239035285f 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:40:37 devstack sudo[107055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ab2e7c96-babd-4d37-bcb0-96239035285f 1073741824 Nov 06 15:40:37 devstack sudo[107055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:40:38 devstack sudo[107055]: pam_unix(sudo:session): session closed for user root Nov 06 15:40:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8121c17f-0966-45d8-b319-67b301aae512 tempest-ProjectReaderTests-1454810006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ab2e7c96-babd-4d37-bcb0-96239035285f 1073741824" returned: 0 in 0.398s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:40:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8121c17f-0966-45d8-b319-67b301aae512 tempest-ProjectReaderTests-1454810006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ab2e7c96-babd-4d37-bcb0-96239035285f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:40:38 devstack sudo[107060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ab2e7c96-babd-4d37-bcb0-96239035285f Nov 06 15:40:38 devstack sudo[107060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:40:38 devstack sudo[107060]: pam_unix(sudo:session): session closed for user root Nov 06 15:40:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8121c17f-0966-45d8-b319-67b301aae512 tempest-ProjectReaderTests-1454810006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ab2e7c96-babd-4d37-bcb0-96239035285f" returned: 0 in 0.244s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:40:38 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-8121c17f-0966-45d8-b319-67b301aae512 tempest-ProjectReaderTests-1454810006 None] <== create_volume: return (680ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:40:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8121c17f-0966-45d8-b319-67b301aae512 tempest-ProjectReaderTests-1454810006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.683s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:40:38 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8121c17f-0966-45d8-b319-67b301aae512 tempest-ProjectReaderTests-1454810006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a9c56bb-87fe-4dcc-8c39-7d11171efb6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab2e7c96-babd-4d37-bcb0-96239035285f', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:40:38 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8121c17f-0966-45d8-b319-67b301aae512 tempest-ProjectReaderTests-1454810006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac7dbe98-ea0c-4485-825b-06e45d89e381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:40:38 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-8121c17f-0966-45d8-b319-67b301aae512 tempest-ProjectReaderTests-1454810006 None] Volume volume-ab2e7c96-babd-4d37-bcb0-96239035285f (ab2e7c96-babd-4d37-bcb0-96239035285f): created successfully Nov 06 15:40:38 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8121c17f-0966-45d8-b319-67b301aae512 tempest-ProjectReaderTests-1454810006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac7dbe98-ea0c-4485-825b-06e45d89e381) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:40:38 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8121c17f-0966-45d8-b319-67b301aae512 tempest-ProjectReaderTests-1454810006 None] Flow 'volume_create_manager' (8817a78b-d520-4161-baa9-19c52487df33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:40:38 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-8121c17f-0966-45d8-b319-67b301aae512 tempest-ProjectReaderTests-1454810006 None] Created volume successfully. Nov 06 15:40:38 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-0fe43d62-9a47-4de6-b567-54064ae161d3 tempest-ProjectReaderTests-1454810006 None] Acquiring lock "cinder-ab2e7c96-babd-4d37-bcb0-96239035285f-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:40:38 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-0fe43d62-9a47-4de6-b567-54064ae161d3 tempest-ProjectReaderTests-1454810006 None] Lock "cinder-ab2e7c96-babd-4d37-bcb0-96239035285f-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:40:38 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-0fe43d62-9a47-4de6-b567-54064ae161d3 tempest-ProjectReaderTests-1454810006 None] Acquiring lock "cinder-quobyte-ab2e7c96-babd-4d37-bcb0-96239035285f" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:40:38 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-0fe43d62-9a47-4de6-b567-54064ae161d3 tempest-ProjectReaderTests-1454810006 None] Lock "cinder-quobyte-ab2e7c96-babd-4d37-bcb0-96239035285f" acquired by "delete_volume" :: waited 0.014s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:40:38 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d258a13-5387-48ff-9727-f846abd1a330]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:40:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0fe43d62-9a47-4de6-b567-54064ae161d3 tempest-ProjectReaderTests-1454810006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ab2e7c96-babd-4d37-bcb0-96239035285f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:40:38 devstack sudo[107063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ab2e7c96-babd-4d37-bcb0-96239035285f Nov 06 15:40:38 devstack sudo[107063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:40:39 devstack sudo[107063]: pam_unix(sudo:session): session closed for user root Nov 06 15:40:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0fe43d62-9a47-4de6-b567-54064ae161d3 tempest-ProjectReaderTests-1454810006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ab2e7c96-babd-4d37-bcb0-96239035285f" returned: 0 in 0.354s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:40:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0fe43d62-9a47-4de6-b567-54064ae161d3 tempest-ProjectReaderTests-1454810006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ab2e7c96-babd-4d37-bcb0-96239035285f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:40:39 devstack sudo[107068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ab2e7c96-babd-4d37-bcb0-96239035285f Nov 06 15:40:39 devstack sudo[107068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:40:39 devstack sudo[107068]: pam_unix(sudo:session): session closed for user root Nov 06 15:40:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0fe43d62-9a47-4de6-b567-54064ae161d3 tempest-ProjectReaderTests-1454810006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ab2e7c96-babd-4d37-bcb0-96239035285f" returned: 0 in 0.246s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:40:39 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-0fe43d62-9a47-4de6-b567-54064ae161d3 tempest-ProjectReaderTests-1454810006 None] Lock "cinder-quobyte-ab2e7c96-babd-4d37-bcb0-96239035285f" released by "delete_volume" :: held 0.639s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:40:39 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-0fe43d62-9a47-4de6-b567-54064ae161d3 tempest-ProjectReaderTests-1454810006 None] Created reservations ['90227684-cf7d-4756-959f-d9d47697a009', '1f8ba45d-8866-49a7-845e-78d68cda300a', 'e3899835-3dd9-401a-af73-afa2b8ff4b73', '85114608-87df-467c-8907-29b001e884f6'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:40:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0fe43d62-9a47-4de6-b567-54064ae161d3 tempest-ProjectReaderTests-1454810006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:40:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0fe43d62-9a47-4de6-b567-54064ae161d3 tempest-ProjectReaderTests-1454810006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:40:39 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0fe43d62-9a47-4de6-b567-54064ae161d3 tempest-ProjectReaderTests-1454810006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:40:39 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0fe43d62-9a47-4de6-b567-54064ae161d3 tempest-ProjectReaderTests-1454810006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:40:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0fe43d62-9a47-4de6-b567-54064ae161d3 tempest-ProjectReaderTests-1454810006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:40:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0fe43d62-9a47-4de6-b567-54064ae161d3 tempest-ProjectReaderTests-1454810006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:40:39 devstack sudo[107071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:40:39 devstack sudo[107071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:40:39 devstack sudo[107071]: pam_unix(sudo:session): session closed for user root Nov 06 15:40:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0fe43d62-9a47-4de6-b567-54064ae161d3 tempest-ProjectReaderTests-1454810006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.243s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:40:39 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-0fe43d62-9a47-4de6-b567-54064ae161d3 tempest-ProjectReaderTests-1454810006 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:40:39 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-0fe43d62-9a47-4de6-b567-54064ae161d3 tempest-ProjectReaderTests-1454810006 None] Deleted volume successfully. Nov 06 15:40:39 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-0fe43d62-9a47-4de6-b567-54064ae161d3 tempest-ProjectReaderTests-1454810006 None] Lock "cinder-ab2e7c96-babd-4d37-bcb0-96239035285f-delete_volume" released by "delete_volume" :: held 1.077s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:40:40 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b409a58-c046-4c26-9cf1-f19cba175cac tempest-ProjectReaderTests-1454810006 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:40:40 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8b409a58-c046-4c26-9cf1-f19cba175cac tempest-ProjectReaderTests-1454810006 None] Flow 'volume_create_manager' (5012908d-b01c-498a-abad-429063c28768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:40:40 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8b409a58-c046-4c26-9cf1-f19cba175cac tempest-ProjectReaderTests-1454810006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7aa9933-f40c-40ec-bad5-a139bca254a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:40:40 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8b409a58-c046-4c26-9cf1-f19cba175cac tempest-ProjectReaderTests-1454810006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7aa9933-f40c-40ec-bad5-a139bca254a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:40:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-122644118',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40b37aee-35f8-436d-a05e-c3629c1879d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11fcc47ac12048a8ae2bf74a67c783a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:40:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:40:40Z,use_quota=True,user_id='7cee42688b45431ab0fdabf055095eac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:40:40 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8b409a58-c046-4c26-9cf1-f19cba175cac tempest-ProjectReaderTests-1454810006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7414a445-59a7-4f7b-87cd-6499bd13301c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:40:40 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8b409a58-c046-4c26-9cf1-f19cba175cac tempest-ProjectReaderTests-1454810006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7414a445-59a7-4f7b-87cd-6499bd13301c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:40:40 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8b409a58-c046-4c26-9cf1-f19cba175cac tempest-ProjectReaderTests-1454810006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38ca8ccc-13c4-4a4b-afe3-81ad3359a10e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:40:40 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8b409a58-c046-4c26-9cf1-f19cba175cac tempest-ProjectReaderTests-1454810006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38ca8ccc-13c4-4a4b-afe3-81ad3359a10e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40b37aee-35f8-436d-a05e-c3629c1879d9', 'volume_name': 'volume-40b37aee-35f8-436d-a05e-c3629c1879d9', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:40:40 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8b409a58-c046-4c26-9cf1-f19cba175cac tempest-ProjectReaderTests-1454810006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95d4d488-2c03-4268-8837-34281ea5b854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:40:40 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8b409a58-c046-4c26-9cf1-f19cba175cac tempest-ProjectReaderTests-1454810006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95d4d488-2c03-4268-8837-34281ea5b854) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:40:40 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8b409a58-c046-4c26-9cf1-f19cba175cac tempest-ProjectReaderTests-1454810006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5868706-882e-4003-9d67-0b4b9bac5d9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:40:40 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-8b409a58-c046-4c26-9cf1-f19cba175cac tempest-ProjectReaderTests-1454810006 None] Volume 40b37aee-35f8-436d-a05e-c3629c1879d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40b37aee-35f8-436d-a05e-c3629c1879d9', 'volume_size': 1} Nov 06 15:40:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8b409a58-c046-4c26-9cf1-f19cba175cac tempest-ProjectReaderTests-1454810006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:40:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8b409a58-c046-4c26-9cf1-f19cba175cac tempest-ProjectReaderTests-1454810006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:40:40 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-8b409a58-c046-4c26-9cf1-f19cba175cac tempest-ProjectReaderTests-1454810006 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:40:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-122644118',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40b37aee-35f8-436d-a05e-c3629c1879d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11fcc47ac12048a8ae2bf74a67c783a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:40:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:40:40Z,use_quota=True,user_id='7cee42688b45431ab0fdabf055095eac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:40:40 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-8b409a58-c046-4c26-9cf1-f19cba175cac tempest-ProjectReaderTests-1454810006 None] Creating volume 40b37aee-35f8-436d-a05e-c3629c1879d9 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:40:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8b409a58-c046-4c26-9cf1-f19cba175cac tempest-ProjectReaderTests-1454810006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:40:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8b409a58-c046-4c26-9cf1-f19cba175cac tempest-ProjectReaderTests-1454810006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:40:40 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-8b409a58-c046-4c26-9cf1-f19cba175cac tempest-ProjectReaderTests-1454810006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:40:40 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-8b409a58-c046-4c26-9cf1-f19cba175cac tempest-ProjectReaderTests-1454810006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:40:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8b409a58-c046-4c26-9cf1-f19cba175cac tempest-ProjectReaderTests-1454810006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:40:40 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-8b409a58-c046-4c26-9cf1-f19cba175cac tempest-ProjectReaderTests-1454810006 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:40:40 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-8b409a58-c046-4c26-9cf1-f19cba175cac tempest-ProjectReaderTests-1454810006 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:40:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8b409a58-c046-4c26-9cf1-f19cba175cac tempest-ProjectReaderTests-1454810006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-40b37aee-35f8-436d-a05e-c3629c1879d9 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:40:40 devstack sudo[107074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-40b37aee-35f8-436d-a05e-c3629c1879d9 1073741824 Nov 06 15:40:40 devstack sudo[107074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:40:40 devstack sudo[107074]: pam_unix(sudo:session): session closed for user root Nov 06 15:40:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8b409a58-c046-4c26-9cf1-f19cba175cac tempest-ProjectReaderTests-1454810006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-40b37aee-35f8-436d-a05e-c3629c1879d9 1073741824" returned: 0 in 0.390s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:40:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8b409a58-c046-4c26-9cf1-f19cba175cac tempest-ProjectReaderTests-1454810006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-40b37aee-35f8-436d-a05e-c3629c1879d9 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:40:40 devstack sudo[107080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-40b37aee-35f8-436d-a05e-c3629c1879d9 Nov 06 15:40:40 devstack sudo[107080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:40:41 devstack sudo[107080]: pam_unix(sudo:session): session closed for user root Nov 06 15:40:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8b409a58-c046-4c26-9cf1-f19cba175cac tempest-ProjectReaderTests-1454810006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-40b37aee-35f8-436d-a05e-c3629c1879d9" returned: 0 in 0.237s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:40:41 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-8b409a58-c046-4c26-9cf1-f19cba175cac tempest-ProjectReaderTests-1454810006 None] <== create_volume: return (666ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:40:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8b409a58-c046-4c26-9cf1-f19cba175cac tempest-ProjectReaderTests-1454810006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.669s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:40:41 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8b409a58-c046-4c26-9cf1-f19cba175cac tempest-ProjectReaderTests-1454810006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5868706-882e-4003-9d67-0b4b9bac5d9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40b37aee-35f8-436d-a05e-c3629c1879d9', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:40:41 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8b409a58-c046-4c26-9cf1-f19cba175cac tempest-ProjectReaderTests-1454810006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e119936-4359-44c7-a505-4b6c963b92e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:40:41 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-8b409a58-c046-4c26-9cf1-f19cba175cac tempest-ProjectReaderTests-1454810006 None] Volume volume-40b37aee-35f8-436d-a05e-c3629c1879d9 (40b37aee-35f8-436d-a05e-c3629c1879d9): created successfully Nov 06 15:40:41 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8b409a58-c046-4c26-9cf1-f19cba175cac tempest-ProjectReaderTests-1454810006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e119936-4359-44c7-a505-4b6c963b92e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:40:41 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8b409a58-c046-4c26-9cf1-f19cba175cac tempest-ProjectReaderTests-1454810006 None] Flow 'volume_create_manager' (5012908d-b01c-498a-abad-429063c28768) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:40:41 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-8b409a58-c046-4c26-9cf1-f19cba175cac tempest-ProjectReaderTests-1454810006 None] Created volume successfully. Nov 06 15:40:41 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-bf809a6c-7297-4b4c-9c6a-12515000a623 tempest-ProjectReaderTests-1454810006 None] Acquiring lock "cinder-40b37aee-35f8-436d-a05e-c3629c1879d9-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:40:41 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-bf809a6c-7297-4b4c-9c6a-12515000a623 tempest-ProjectReaderTests-1454810006 None] Lock "cinder-40b37aee-35f8-436d-a05e-c3629c1879d9-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:40:41 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-bf809a6c-7297-4b4c-9c6a-12515000a623 tempest-ProjectReaderTests-1454810006 None] Acquiring lock "cinder-quobyte-40b37aee-35f8-436d-a05e-c3629c1879d9" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:40:41 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-bf809a6c-7297-4b4c-9c6a-12515000a623 tempest-ProjectReaderTests-1454810006 None] Lock "cinder-quobyte-40b37aee-35f8-436d-a05e-c3629c1879d9" acquired by "delete_volume" :: waited 0.013s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:40:41 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f56cf68-79ea-40e7-ab03-9036d6a61a7b]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:40:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bf809a6c-7297-4b4c-9c6a-12515000a623 tempest-ProjectReaderTests-1454810006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-40b37aee-35f8-436d-a05e-c3629c1879d9 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:40:41 devstack sudo[107083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-40b37aee-35f8-436d-a05e-c3629c1879d9 Nov 06 15:40:41 devstack sudo[107083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:40:41 devstack sudo[107083]: pam_unix(sudo:session): session closed for user root Nov 06 15:40:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bf809a6c-7297-4b4c-9c6a-12515000a623 tempest-ProjectReaderTests-1454810006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-40b37aee-35f8-436d-a05e-c3629c1879d9" returned: 0 in 0.357s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:40:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bf809a6c-7297-4b4c-9c6a-12515000a623 tempest-ProjectReaderTests-1454810006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-40b37aee-35f8-436d-a05e-c3629c1879d9 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:40:41 devstack sudo[107088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-40b37aee-35f8-436d-a05e-c3629c1879d9 Nov 06 15:40:41 devstack sudo[107088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:40:42 devstack sudo[107088]: pam_unix(sudo:session): session closed for user root Nov 06 15:40:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bf809a6c-7297-4b4c-9c6a-12515000a623 tempest-ProjectReaderTests-1454810006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-40b37aee-35f8-436d-a05e-c3629c1879d9" returned: 0 in 0.234s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:40:42 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-bf809a6c-7297-4b4c-9c6a-12515000a623 tempest-ProjectReaderTests-1454810006 None] Lock "cinder-quobyte-40b37aee-35f8-436d-a05e-c3629c1879d9" released by "delete_volume" :: held 0.630s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:40:42 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-bf809a6c-7297-4b4c-9c6a-12515000a623 tempest-ProjectReaderTests-1454810006 None] Created reservations ['5ac36d0f-b91e-45fd-8385-f2d31e702ecd', 'ee7dee0f-4442-4a7c-a764-036db0711789', '9d74bed6-b2c9-4a1f-8c03-8ff164061d35', 'db3f671c-a5a7-4cd9-bc0c-d9c92915930d'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:40:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-bf809a6c-7297-4b4c-9c6a-12515000a623 tempest-ProjectReaderTests-1454810006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:40:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-bf809a6c-7297-4b4c-9c6a-12515000a623 tempest-ProjectReaderTests-1454810006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:40:42 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-bf809a6c-7297-4b4c-9c6a-12515000a623 tempest-ProjectReaderTests-1454810006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:40:42 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-bf809a6c-7297-4b4c-9c6a-12515000a623 tempest-ProjectReaderTests-1454810006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:40:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-bf809a6c-7297-4b4c-9c6a-12515000a623 tempest-ProjectReaderTests-1454810006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:40:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bf809a6c-7297-4b4c-9c6a-12515000a623 tempest-ProjectReaderTests-1454810006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:40:42 devstack sudo[107091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:40:42 devstack sudo[107091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:40:42 devstack sudo[107091]: pam_unix(sudo:session): session closed for user root Nov 06 15:40:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bf809a6c-7297-4b4c-9c6a-12515000a623 tempest-ProjectReaderTests-1454810006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.233s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:40:42 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-bf809a6c-7297-4b4c-9c6a-12515000a623 tempest-ProjectReaderTests-1454810006 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:40:42 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-bf809a6c-7297-4b4c-9c6a-12515000a623 tempest-ProjectReaderTests-1454810006 None] Deleted volume successfully. Nov 06 15:40:42 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-bf809a6c-7297-4b4c-9c6a-12515000a623 tempest-ProjectReaderTests-1454810006 None] Lock "cinder-40b37aee-35f8-436d-a05e-c3629c1879d9-delete_volume" released by "delete_volume" :: held 1.043s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:40:42 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-7eadd6c5-dbc0-48de-a897-bbfda353383c tempest-ProjectReaderTests-1454810006 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:40:42 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7eadd6c5-dbc0-48de-a897-bbfda353383c tempest-ProjectReaderTests-1454810006 None] Flow 'volume_create_manager' (acf00c3c-dea6-4e0c-8b2a-15215a24f3b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:40:42 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7eadd6c5-dbc0-48de-a897-bbfda353383c tempest-ProjectReaderTests-1454810006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (328311f7-ecce-44d8-a57f-4a7f7e0664b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:40:42 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7eadd6c5-dbc0-48de-a897-bbfda353383c tempest-ProjectReaderTests-1454810006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (328311f7-ecce-44d8-a57f-4a7f7e0664b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:40:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-266954177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=671b6179-a518-4b9d-8c5c-874a18324812,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11fcc47ac12048a8ae2bf74a67c783a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:40:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:40:43Z,use_quota=True,user_id='7cee42688b45431ab0fdabf055095eac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:40:42 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7eadd6c5-dbc0-48de-a897-bbfda353383c tempest-ProjectReaderTests-1454810006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa156972-a5a9-46ec-a237-db61fd75b316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:40:42 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7eadd6c5-dbc0-48de-a897-bbfda353383c tempest-ProjectReaderTests-1454810006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa156972-a5a9-46ec-a237-db61fd75b316) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:40:42 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7eadd6c5-dbc0-48de-a897-bbfda353383c tempest-ProjectReaderTests-1454810006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b43453a-31d1-4a3a-bd36-f612f4ff71f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:40:42 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7eadd6c5-dbc0-48de-a897-bbfda353383c tempest-ProjectReaderTests-1454810006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b43453a-31d1-4a3a-bd36-f612f4ff71f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '671b6179-a518-4b9d-8c5c-874a18324812', 'volume_name': 'volume-671b6179-a518-4b9d-8c5c-874a18324812', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:40:42 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7eadd6c5-dbc0-48de-a897-bbfda353383c tempest-ProjectReaderTests-1454810006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (499d73e8-caac-4c7a-a5eb-5602468ea0ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:40:42 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7eadd6c5-dbc0-48de-a897-bbfda353383c tempest-ProjectReaderTests-1454810006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (499d73e8-caac-4c7a-a5eb-5602468ea0ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:40:42 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7eadd6c5-dbc0-48de-a897-bbfda353383c tempest-ProjectReaderTests-1454810006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e57eda1-8d19-481e-9ee9-2b2ef5947448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:40:42 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-7eadd6c5-dbc0-48de-a897-bbfda353383c tempest-ProjectReaderTests-1454810006 None] Volume 671b6179-a518-4b9d-8c5c-874a18324812: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-671b6179-a518-4b9d-8c5c-874a18324812', 'volume_size': 1} Nov 06 15:40:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7eadd6c5-dbc0-48de-a897-bbfda353383c tempest-ProjectReaderTests-1454810006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:40:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7eadd6c5-dbc0-48de-a897-bbfda353383c tempest-ProjectReaderTests-1454810006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:40:43 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-7eadd6c5-dbc0-48de-a897-bbfda353383c tempest-ProjectReaderTests-1454810006 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:40:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-266954177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=671b6179-a518-4b9d-8c5c-874a18324812,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11fcc47ac12048a8ae2bf74a67c783a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:40:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:40:43Z,use_quota=True,user_id='7cee42688b45431ab0fdabf055095eac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:40:43 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-7eadd6c5-dbc0-48de-a897-bbfda353383c tempest-ProjectReaderTests-1454810006 None] Creating volume 671b6179-a518-4b9d-8c5c-874a18324812 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:40:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7eadd6c5-dbc0-48de-a897-bbfda353383c tempest-ProjectReaderTests-1454810006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:40:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7eadd6c5-dbc0-48de-a897-bbfda353383c tempest-ProjectReaderTests-1454810006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:40:43 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-7eadd6c5-dbc0-48de-a897-bbfda353383c tempest-ProjectReaderTests-1454810006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:40:43 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-7eadd6c5-dbc0-48de-a897-bbfda353383c tempest-ProjectReaderTests-1454810006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:40:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7eadd6c5-dbc0-48de-a897-bbfda353383c tempest-ProjectReaderTests-1454810006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:40:43 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-7eadd6c5-dbc0-48de-a897-bbfda353383c tempest-ProjectReaderTests-1454810006 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:40:43 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-7eadd6c5-dbc0-48de-a897-bbfda353383c tempest-ProjectReaderTests-1454810006 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:40:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7eadd6c5-dbc0-48de-a897-bbfda353383c tempest-ProjectReaderTests-1454810006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-671b6179-a518-4b9d-8c5c-874a18324812 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:40:43 devstack sudo[107094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-671b6179-a518-4b9d-8c5c-874a18324812 1073741824 Nov 06 15:40:43 devstack sudo[107094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:40:43 devstack sudo[107094]: pam_unix(sudo:session): session closed for user root Nov 06 15:40:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7eadd6c5-dbc0-48de-a897-bbfda353383c tempest-ProjectReaderTests-1454810006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-671b6179-a518-4b9d-8c5c-874a18324812 1073741824" returned: 0 in 0.386s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:40:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7eadd6c5-dbc0-48de-a897-bbfda353383c tempest-ProjectReaderTests-1454810006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-671b6179-a518-4b9d-8c5c-874a18324812 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:40:43 devstack sudo[107100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-671b6179-a518-4b9d-8c5c-874a18324812 Nov 06 15:40:43 devstack sudo[107100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:40:43 devstack sudo[107100]: pam_unix(sudo:session): session closed for user root Nov 06 15:40:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7eadd6c5-dbc0-48de-a897-bbfda353383c tempest-ProjectReaderTests-1454810006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-671b6179-a518-4b9d-8c5c-874a18324812" returned: 0 in 0.239s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:40:43 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-7eadd6c5-dbc0-48de-a897-bbfda353383c tempest-ProjectReaderTests-1454810006 None] <== create_volume: return (666ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:40:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7eadd6c5-dbc0-48de-a897-bbfda353383c tempest-ProjectReaderTests-1454810006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.669s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:40:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7eadd6c5-dbc0-48de-a897-bbfda353383c tempest-ProjectReaderTests-1454810006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e57eda1-8d19-481e-9ee9-2b2ef5947448) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-671b6179-a518-4b9d-8c5c-874a18324812', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:40:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7eadd6c5-dbc0-48de-a897-bbfda353383c tempest-ProjectReaderTests-1454810006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77a43a7f-3341-4912-a015-07354a127989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:40:43 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-7eadd6c5-dbc0-48de-a897-bbfda353383c tempest-ProjectReaderTests-1454810006 None] Volume volume-671b6179-a518-4b9d-8c5c-874a18324812 (671b6179-a518-4b9d-8c5c-874a18324812): created successfully Nov 06 15:40:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7eadd6c5-dbc0-48de-a897-bbfda353383c tempest-ProjectReaderTests-1454810006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77a43a7f-3341-4912-a015-07354a127989) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:40:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7eadd6c5-dbc0-48de-a897-bbfda353383c tempest-ProjectReaderTests-1454810006 None] Flow 'volume_create_manager' (acf00c3c-dea6-4e0c-8b2a-15215a24f3b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:40:43 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-7eadd6c5-dbc0-48de-a897-bbfda353383c tempest-ProjectReaderTests-1454810006 None] Created volume successfully. Nov 06 15:40:43 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-361808b5-8413-41ad-9775-4ba94c8fcd8a tempest-ProjectReaderTests-1454810006 None] Acquiring lock "cinder-671b6179-a518-4b9d-8c5c-874a18324812-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:40:43 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-361808b5-8413-41ad-9775-4ba94c8fcd8a tempest-ProjectReaderTests-1454810006 None] Lock "cinder-671b6179-a518-4b9d-8c5c-874a18324812-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:40:44 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-361808b5-8413-41ad-9775-4ba94c8fcd8a tempest-ProjectReaderTests-1454810006 None] Acquiring lock "cinder-quobyte-671b6179-a518-4b9d-8c5c-874a18324812" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:40:44 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-361808b5-8413-41ad-9775-4ba94c8fcd8a tempest-ProjectReaderTests-1454810006 None] Lock "cinder-quobyte-671b6179-a518-4b9d-8c5c-874a18324812" acquired by "delete_volume" :: waited 0.013s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:40:44 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a8c672a-7301-4dc4-a921-266b93872b7f]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:40:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-361808b5-8413-41ad-9775-4ba94c8fcd8a tempest-ProjectReaderTests-1454810006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-671b6179-a518-4b9d-8c5c-874a18324812 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:40:44 devstack sudo[107103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-671b6179-a518-4b9d-8c5c-874a18324812 Nov 06 15:40:44 devstack sudo[107103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:40:44 devstack sudo[107103]: pam_unix(sudo:session): session closed for user root Nov 06 15:40:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-361808b5-8413-41ad-9775-4ba94c8fcd8a tempest-ProjectReaderTests-1454810006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-671b6179-a518-4b9d-8c5c-874a18324812" returned: 0 in 0.340s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:40:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-361808b5-8413-41ad-9775-4ba94c8fcd8a tempest-ProjectReaderTests-1454810006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-671b6179-a518-4b9d-8c5c-874a18324812 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:40:44 devstack sudo[107108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-671b6179-a518-4b9d-8c5c-874a18324812 Nov 06 15:40:44 devstack sudo[107108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:40:44 devstack sudo[107108]: pam_unix(sudo:session): session closed for user root Nov 06 15:40:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-361808b5-8413-41ad-9775-4ba94c8fcd8a tempest-ProjectReaderTests-1454810006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-671b6179-a518-4b9d-8c5c-874a18324812" returned: 0 in 0.241s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:40:44 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-361808b5-8413-41ad-9775-4ba94c8fcd8a tempest-ProjectReaderTests-1454810006 None] Lock "cinder-quobyte-671b6179-a518-4b9d-8c5c-874a18324812" released by "delete_volume" :: held 0.620s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:40:44 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-361808b5-8413-41ad-9775-4ba94c8fcd8a tempest-ProjectReaderTests-1454810006 None] Created reservations ['7a71e79f-bec4-4549-9c95-af0f1872a1ce', '7c609f9f-e265-4205-8303-ed1d63f56c08', '2adb5fca-d850-49f2-8ec2-822f15c09df2', '75f1f205-2cad-4df2-830c-408a68c08368'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:40:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-361808b5-8413-41ad-9775-4ba94c8fcd8a tempest-ProjectReaderTests-1454810006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:40:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-361808b5-8413-41ad-9775-4ba94c8fcd8a tempest-ProjectReaderTests-1454810006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:40:44 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-361808b5-8413-41ad-9775-4ba94c8fcd8a tempest-ProjectReaderTests-1454810006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:40:44 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-361808b5-8413-41ad-9775-4ba94c8fcd8a tempest-ProjectReaderTests-1454810006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:40:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-361808b5-8413-41ad-9775-4ba94c8fcd8a tempest-ProjectReaderTests-1454810006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:40:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-361808b5-8413-41ad-9775-4ba94c8fcd8a tempest-ProjectReaderTests-1454810006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:40:44 devstack sudo[107111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:40:44 devstack sudo[107111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:40:44 devstack sudo[107111]: pam_unix(sudo:session): session closed for user root Nov 06 15:40:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-361808b5-8413-41ad-9775-4ba94c8fcd8a tempest-ProjectReaderTests-1454810006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.239s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:40:44 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-361808b5-8413-41ad-9775-4ba94c8fcd8a tempest-ProjectReaderTests-1454810006 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:40:44 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-361808b5-8413-41ad-9775-4ba94c8fcd8a tempest-ProjectReaderTests-1454810006 None] Deleted volume successfully. Nov 06 15:40:45 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-361808b5-8413-41ad-9775-4ba94c8fcd8a tempest-ProjectReaderTests-1454810006 None] Lock "cinder-671b6179-a518-4b9d-8c5c-874a18324812-delete_volume" released by "delete_volume" :: held 1.037s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:40:57 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-478a26bc-9350-4ed0-b5fe-705b8e7b0db3 tempest-VolumeDependencyTests-83919300 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:40:57 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-478a26bc-9350-4ed0-b5fe-705b8e7b0db3 tempest-VolumeDependencyTests-83919300 None] Flow 'volume_create_manager' (a0e3a267-6f0f-453a-8354-206ca87fc306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:40:57 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-478a26bc-9350-4ed0-b5fe-705b8e7b0db3 tempest-VolumeDependencyTests-83919300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83285be3-a69c-4ed2-9ce8-ddd95733409a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:40:57 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-478a26bc-9350-4ed0-b5fe-705b8e7b0db3 tempest-VolumeDependencyTests-83919300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83285be3-a69c-4ed2-9ce8-ddd95733409a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:40:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1459487484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a12aff2-b559-4779-a8d4-0de3527dfee1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4851653571ad4d6595603dd8bfd465c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:40:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:40:57Z,use_quota=True,user_id='0e3f0d29a1454997bdabddfe9c15368d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:40:57 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-478a26bc-9350-4ed0-b5fe-705b8e7b0db3 tempest-VolumeDependencyTests-83919300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5904203b-eaf3-4f15-98d2-d1b3f36837f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:40:57 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-478a26bc-9350-4ed0-b5fe-705b8e7b0db3 tempest-VolumeDependencyTests-83919300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5904203b-eaf3-4f15-98d2-d1b3f36837f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:40:57 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-478a26bc-9350-4ed0-b5fe-705b8e7b0db3 tempest-VolumeDependencyTests-83919300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10bbc303-3e82-48f7-b4db-1c6c1366390e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:40:57 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-478a26bc-9350-4ed0-b5fe-705b8e7b0db3 tempest-VolumeDependencyTests-83919300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10bbc303-3e82-48f7-b4db-1c6c1366390e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a12aff2-b559-4779-a8d4-0de3527dfee1', 'volume_name': 'volume-3a12aff2-b559-4779-a8d4-0de3527dfee1', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:40:57 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-478a26bc-9350-4ed0-b5fe-705b8e7b0db3 tempest-VolumeDependencyTests-83919300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (644aa6a2-021e-4da5-b49b-02e5ca82c8a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:40:57 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-478a26bc-9350-4ed0-b5fe-705b8e7b0db3 tempest-VolumeDependencyTests-83919300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (644aa6a2-021e-4da5-b49b-02e5ca82c8a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:40:57 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-478a26bc-9350-4ed0-b5fe-705b8e7b0db3 tempest-VolumeDependencyTests-83919300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7975703e-4de5-4ddb-913d-2da3573238a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:40:57 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-478a26bc-9350-4ed0-b5fe-705b8e7b0db3 tempest-VolumeDependencyTests-83919300 None] Volume 3a12aff2-b559-4779-a8d4-0de3527dfee1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a12aff2-b559-4779-a8d4-0de3527dfee1', 'volume_size': 1} Nov 06 15:40:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-478a26bc-9350-4ed0-b5fe-705b8e7b0db3 tempest-VolumeDependencyTests-83919300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:40:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-478a26bc-9350-4ed0-b5fe-705b8e7b0db3 tempest-VolumeDependencyTests-83919300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:40:57 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-478a26bc-9350-4ed0-b5fe-705b8e7b0db3 tempest-VolumeDependencyTests-83919300 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:40:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1459487484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a12aff2-b559-4779-a8d4-0de3527dfee1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4851653571ad4d6595603dd8bfd465c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:40:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:40:57Z,use_quota=True,user_id='0e3f0d29a1454997bdabddfe9c15368d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:40:57 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-478a26bc-9350-4ed0-b5fe-705b8e7b0db3 tempest-VolumeDependencyTests-83919300 None] Creating volume 3a12aff2-b559-4779-a8d4-0de3527dfee1 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:40:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-478a26bc-9350-4ed0-b5fe-705b8e7b0db3 tempest-VolumeDependencyTests-83919300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:40:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-478a26bc-9350-4ed0-b5fe-705b8e7b0db3 tempest-VolumeDependencyTests-83919300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:40:57 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-478a26bc-9350-4ed0-b5fe-705b8e7b0db3 tempest-VolumeDependencyTests-83919300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:40:57 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-478a26bc-9350-4ed0-b5fe-705b8e7b0db3 tempest-VolumeDependencyTests-83919300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:40:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-478a26bc-9350-4ed0-b5fe-705b8e7b0db3 tempest-VolumeDependencyTests-83919300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:40:57 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-478a26bc-9350-4ed0-b5fe-705b8e7b0db3 tempest-VolumeDependencyTests-83919300 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:40:57 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-478a26bc-9350-4ed0-b5fe-705b8e7b0db3 tempest-VolumeDependencyTests-83919300 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:40:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-478a26bc-9350-4ed0-b5fe-705b8e7b0db3 tempest-VolumeDependencyTests-83919300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-3a12aff2-b559-4779-a8d4-0de3527dfee1 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:40:57 devstack sudo[107155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-3a12aff2-b559-4779-a8d4-0de3527dfee1 1073741824 Nov 06 15:40:57 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef2fb0ee-a3a6-4351-ae32-291ac2ac74b0 tempest-CreateVolumesFromSnapshotTest-597264870 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:40:57 devstack sudo[107155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:40:57 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ef2fb0ee-a3a6-4351-ae32-291ac2ac74b0 tempest-CreateVolumesFromSnapshotTest-597264870 None] Flow 'volume_create_manager' (27f15f82-97bd-4f3f-a725-399b9347a20a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:40:57 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ef2fb0ee-a3a6-4351-ae32-291ac2ac74b0 tempest-CreateVolumesFromSnapshotTest-597264870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49700d8e-93f9-4d4d-b8d8-cc085a1e7f82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:40:57 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ef2fb0ee-a3a6-4351-ae32-291ac2ac74b0 tempest-CreateVolumesFromSnapshotTest-597264870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49700d8e-93f9-4d4d-b8d8-cc085a1e7f82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:40:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1695341028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4aa4c9ca-068b-4ce6-b155-59c0e6df9dd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1dd1416ca4b4ab78091d45ca8782b28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:40:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:40:57Z,use_quota=True,user_id='f0c1841ac23c45f4921295e6a25d28f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:40:57 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ef2fb0ee-a3a6-4351-ae32-291ac2ac74b0 tempest-CreateVolumesFromSnapshotTest-597264870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c3ce730-4ee3-428e-8ea9-2da09cee1c11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:40:57 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ef2fb0ee-a3a6-4351-ae32-291ac2ac74b0 tempest-CreateVolumesFromSnapshotTest-597264870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c3ce730-4ee3-428e-8ea9-2da09cee1c11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:40:57 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ef2fb0ee-a3a6-4351-ae32-291ac2ac74b0 tempest-CreateVolumesFromSnapshotTest-597264870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f234e56e-0016-487c-b88d-fa1450cc11e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:40:57 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ef2fb0ee-a3a6-4351-ae32-291ac2ac74b0 tempest-CreateVolumesFromSnapshotTest-597264870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f234e56e-0016-487c-b88d-fa1450cc11e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4aa4c9ca-068b-4ce6-b155-59c0e6df9dd7', 'volume_name': 'volume-4aa4c9ca-068b-4ce6-b155-59c0e6df9dd7', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:40:57 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ef2fb0ee-a3a6-4351-ae32-291ac2ac74b0 tempest-CreateVolumesFromSnapshotTest-597264870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1e802a0-3c68-435f-b676-315211d7d18e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:40:57 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ef2fb0ee-a3a6-4351-ae32-291ac2ac74b0 tempest-CreateVolumesFromSnapshotTest-597264870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1e802a0-3c68-435f-b676-315211d7d18e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:40:57 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ef2fb0ee-a3a6-4351-ae32-291ac2ac74b0 tempest-CreateVolumesFromSnapshotTest-597264870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5fab54b-f7c0-4e64-9612-60c38832f73a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:40:57 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-ef2fb0ee-a3a6-4351-ae32-291ac2ac74b0 tempest-CreateVolumesFromSnapshotTest-597264870 None] Volume 4aa4c9ca-068b-4ce6-b155-59c0e6df9dd7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4aa4c9ca-068b-4ce6-b155-59c0e6df9dd7', 'volume_size': 1} Nov 06 15:40:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ef2fb0ee-a3a6-4351-ae32-291ac2ac74b0 tempest-CreateVolumesFromSnapshotTest-597264870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:40:57 devstack sudo[107155]: pam_unix(sudo:session): session closed for user root Nov 06 15:40:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-478a26bc-9350-4ed0-b5fe-705b8e7b0db3 tempest-VolumeDependencyTests-83919300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-3a12aff2-b559-4779-a8d4-0de3527dfee1 1073741824" returned: 0 in 0.528s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:40:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-478a26bc-9350-4ed0-b5fe-705b8e7b0db3 tempest-VolumeDependencyTests-83919300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-3a12aff2-b559-4779-a8d4-0de3527dfee1 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:40:58 devstack sudo[107161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-3a12aff2-b559-4779-a8d4-0de3527dfee1 Nov 06 15:40:58 devstack sudo[107161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:40:58 devstack sudo[107161]: pam_unix(sudo:session): session closed for user root Nov 06 15:40:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-478a26bc-9350-4ed0-b5fe-705b8e7b0db3 tempest-VolumeDependencyTests-83919300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-3a12aff2-b559-4779-a8d4-0de3527dfee1" returned: 0 in 0.272s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:40:58 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-478a26bc-9350-4ed0-b5fe-705b8e7b0db3 tempest-VolumeDependencyTests-83919300 None] <== create_volume: return (856ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:40:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-478a26bc-9350-4ed0-b5fe-705b8e7b0db3 tempest-VolumeDependencyTests-83919300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.858s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:40:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ef2fb0ee-a3a6-4351-ae32-291ac2ac74b0 tempest-CreateVolumesFromSnapshotTest-597264870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.740s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:40:58 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-ef2fb0ee-a3a6-4351-ae32-291ac2ac74b0 tempest-CreateVolumesFromSnapshotTest-597264870 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:40:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1695341028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4aa4c9ca-068b-4ce6-b155-59c0e6df9dd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1dd1416ca4b4ab78091d45ca8782b28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:40:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:40:57Z,use_quota=True,user_id='f0c1841ac23c45f4921295e6a25d28f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:40:58 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-ef2fb0ee-a3a6-4351-ae32-291ac2ac74b0 tempest-CreateVolumesFromSnapshotTest-597264870 None] Creating volume 4aa4c9ca-068b-4ce6-b155-59c0e6df9dd7 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:40:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ef2fb0ee-a3a6-4351-ae32-291ac2ac74b0 tempest-CreateVolumesFromSnapshotTest-597264870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:40:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ef2fb0ee-a3a6-4351-ae32-291ac2ac74b0 tempest-CreateVolumesFromSnapshotTest-597264870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:40:58 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-ef2fb0ee-a3a6-4351-ae32-291ac2ac74b0 tempest-CreateVolumesFromSnapshotTest-597264870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:40:58 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-ef2fb0ee-a3a6-4351-ae32-291ac2ac74b0 tempest-CreateVolumesFromSnapshotTest-597264870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:40:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ef2fb0ee-a3a6-4351-ae32-291ac2ac74b0 tempest-CreateVolumesFromSnapshotTest-597264870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:40:58 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-ef2fb0ee-a3a6-4351-ae32-291ac2ac74b0 tempest-CreateVolumesFromSnapshotTest-597264870 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:40:58 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-ef2fb0ee-a3a6-4351-ae32-291ac2ac74b0 tempest-CreateVolumesFromSnapshotTest-597264870 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:40:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ef2fb0ee-a3a6-4351-ae32-291ac2ac74b0 tempest-CreateVolumesFromSnapshotTest-597264870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-4aa4c9ca-068b-4ce6-b155-59c0e6df9dd7 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:40:58 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-478a26bc-9350-4ed0-b5fe-705b8e7b0db3 tempest-VolumeDependencyTests-83919300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7975703e-4de5-4ddb-913d-2da3573238a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a12aff2-b559-4779-a8d4-0de3527dfee1', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:40:58 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-478a26bc-9350-4ed0-b5fe-705b8e7b0db3 tempest-VolumeDependencyTests-83919300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95231344-1661-49e6-a6c7-7844d550fdfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:40:58 devstack sudo[107170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-4aa4c9ca-068b-4ce6-b155-59c0e6df9dd7 1073741824 Nov 06 15:40:58 devstack sudo[107170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:40:58 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-478a26bc-9350-4ed0-b5fe-705b8e7b0db3 tempest-VolumeDependencyTests-83919300 None] Volume volume-3a12aff2-b559-4779-a8d4-0de3527dfee1 (3a12aff2-b559-4779-a8d4-0de3527dfee1): created successfully Nov 06 15:40:58 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-478a26bc-9350-4ed0-b5fe-705b8e7b0db3 tempest-VolumeDependencyTests-83919300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95231344-1661-49e6-a6c7-7844d550fdfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:40:58 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-478a26bc-9350-4ed0-b5fe-705b8e7b0db3 tempest-VolumeDependencyTests-83919300 None] Flow 'volume_create_manager' (a0e3a267-6f0f-453a-8354-206ca87fc306) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:40:58 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-478a26bc-9350-4ed0-b5fe-705b8e7b0db3 tempest-VolumeDependencyTests-83919300 None] Created volume successfully. Nov 06 15:40:58 devstack sudo[107170]: pam_unix(sudo:session): session closed for user root Nov 06 15:40:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ef2fb0ee-a3a6-4351-ae32-291ac2ac74b0 tempest-CreateVolumesFromSnapshotTest-597264870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-4aa4c9ca-068b-4ce6-b155-59c0e6df9dd7 1073741824" returned: 0 in 0.529s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:40:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ef2fb0ee-a3a6-4351-ae32-291ac2ac74b0 tempest-CreateVolumesFromSnapshotTest-597264870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-4aa4c9ca-068b-4ce6-b155-59c0e6df9dd7 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:40:58 devstack sudo[107176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-4aa4c9ca-068b-4ce6-b155-59c0e6df9dd7 Nov 06 15:40:58 devstack sudo[107176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:40:59 devstack sudo[107176]: pam_unix(sudo:session): session closed for user root Nov 06 15:40:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ef2fb0ee-a3a6-4351-ae32-291ac2ac74b0 tempest-CreateVolumesFromSnapshotTest-597264870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-4aa4c9ca-068b-4ce6-b155-59c0e6df9dd7" returned: 0 in 0.296s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:40:59 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-ef2fb0ee-a3a6-4351-ae32-291ac2ac74b0 tempest-CreateVolumesFromSnapshotTest-597264870 None] <== create_volume: return (878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:40:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ef2fb0ee-a3a6-4351-ae32-291ac2ac74b0 tempest-CreateVolumesFromSnapshotTest-597264870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.881s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:40:59 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ef2fb0ee-a3a6-4351-ae32-291ac2ac74b0 tempest-CreateVolumesFromSnapshotTest-597264870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5fab54b-f7c0-4e64-9612-60c38832f73a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4aa4c9ca-068b-4ce6-b155-59c0e6df9dd7', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:40:59 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ef2fb0ee-a3a6-4351-ae32-291ac2ac74b0 tempest-CreateVolumesFromSnapshotTest-597264870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a7c7d95-fa91-45be-9e56-a6de1b10fa5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:40:59 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-ef2fb0ee-a3a6-4351-ae32-291ac2ac74b0 tempest-CreateVolumesFromSnapshotTest-597264870 None] Volume volume-4aa4c9ca-068b-4ce6-b155-59c0e6df9dd7 (4aa4c9ca-068b-4ce6-b155-59c0e6df9dd7): created successfully Nov 06 15:40:59 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ef2fb0ee-a3a6-4351-ae32-291ac2ac74b0 tempest-CreateVolumesFromSnapshotTest-597264870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a7c7d95-fa91-45be-9e56-a6de1b10fa5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:40:59 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ef2fb0ee-a3a6-4351-ae32-291ac2ac74b0 tempest-CreateVolumesFromSnapshotTest-597264870 None] Flow 'volume_create_manager' (27f15f82-97bd-4f3f-a725-399b9347a20a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:40:59 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-ef2fb0ee-a3a6-4351-ae32-291ac2ac74b0 tempest-CreateVolumesFromSnapshotTest-597264870 None] Created volume successfully. Nov 06 15:40:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a324bc87-7758-4b31-81de-f72fed638291 tempest-VolumeDependencyTests-83919300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:40:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a324bc87-7758-4b31-81de-f72fed638291 tempest-VolumeDependencyTests-83919300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:40:59 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-a324bc87-7758-4b31-81de-f72fed638291 tempest-VolumeDependencyTests-83919300 None] Creating offline snapshot 3e186b4a-9bd8-4209-ae98-dd2c950830b3 of volume 3a12aff2-b559-4779-a8d4-0de3527dfee1 {{(pid=87132) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 15:40:59 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[0763f1a3-2d3c-4752-a337-caf0a7d48b03]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:40:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a324bc87-7758-4b31-81de-f72fed638291 tempest-VolumeDependencyTests-83919300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-3a12aff2-b559-4779-a8d4-0de3527dfee1 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:40:59 devstack sudo[107179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-3a12aff2-b559-4779-a8d4-0de3527dfee1 Nov 06 15:40:59 devstack sudo[107179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:40:59 devstack sudo[107179]: pam_unix(sudo:session): session closed for user root Nov 06 15:40:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a324bc87-7758-4b31-81de-f72fed638291 tempest-VolumeDependencyTests-83919300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-3a12aff2-b559-4779-a8d4-0de3527dfee1" returned: 0 in 0.426s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:40:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a324bc87-7758-4b31-81de-f72fed638291 tempest-VolumeDependencyTests-83919300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-3a12aff2-b559-4779-a8d4-0de3527dfee1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-3a12aff2-b559-4779-a8d4-0de3527dfee1.3e186b4a-9bd8-4209-ae98-dd2c950830b3 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:40:59 devstack sudo[107184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-3a12aff2-b559-4779-a8d4-0de3527dfee1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-3a12aff2-b559-4779-a8d4-0de3527dfee1.3e186b4a-9bd8-4209-ae98-dd2c950830b3 1G Nov 06 15:40:59 devstack sudo[107184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:40:59 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b81eeed-4e02-428c-a570-ebca91a572f7 tempest-VolumeImageDependencyTests-1054771306 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:41:00 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5b81eeed-4e02-428c-a570-ebca91a572f7 tempest-VolumeImageDependencyTests-1054771306 None] Flow 'volume_create_manager' (1ee720b9-85df-447a-b6a7-62d9ac598d77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:41:00 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5b81eeed-4e02-428c-a570-ebca91a572f7 tempest-VolumeImageDependencyTests-1054771306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0070456e-60e1-4968-ace3-615fda5b963d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:00 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5b81eeed-4e02-428c-a570-ebca91a572f7 tempest-VolumeImageDependencyTests-1054771306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0070456e-60e1-4968-ace3-615fda5b963d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:41:00Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9c0326b-e806-452a-afb0-e3633624bab6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccf384ce881147f3ac7a02f125d3644b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:41:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:41:00Z,use_quota=True,user_id='2900c01330d84738968aa0842df5732f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:00 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5b81eeed-4e02-428c-a570-ebca91a572f7 tempest-VolumeImageDependencyTests-1054771306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b43aea6-6494-4851-9cc5-20f88adc9e09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:00 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5b81eeed-4e02-428c-a570-ebca91a572f7 tempest-VolumeImageDependencyTests-1054771306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b43aea6-6494-4851-9cc5-20f88adc9e09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:00 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5b81eeed-4e02-428c-a570-ebca91a572f7 tempest-VolumeImageDependencyTests-1054771306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e711211-6934-4e54-b0b4-95d494c4c430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:00 devstack cinder-volume[87132]: DEBUG cinder.image.glance [None req-5b81eeed-4e02-428c-a570-ebca91a572f7 tempest-VolumeImageDependencyTests-1054771306 None] Creating Keystone auth plugin from conf {{(pid=87132) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 06 15:41:00 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5b81eeed-4e02-428c-a570-ebca91a572f7 tempest-VolumeImageDependencyTests-1054771306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e711211-6934-4e54-b0b4-95d494c4c430) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a9c0326b-e806-452a-afb0-e3633624bab6', 'volume_name': 'volume-a9c0326b-e806-452a-afb0-e3633624bab6', 'volume_size': 1, 'image_id': '262fed89-7121-4586-83c3-b8af290b8def', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/262fed89-7121-4586-83c3-b8af290b8def', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '051f492a8e058acca6e84a58285a9092', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ccf384ce881147f3ac7a02f125d3644b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4035387db6077b26bee3f25557ab3b0b3b837e1dd8fc73615ce99cc12670a9f5eecd7ea58d9f4cc410dfb9727ef5835cc19593bd9982ac9040958a3b7ac5fd08', 'id': '262fed89-7121-4586-83c3-b8af290b8def', 'created_at': datetime.datetime(2026, 11, 6, 14, 40, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 14, 40, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/262fed89-7121-4586-83c3-b8af290b8def/file', 'properties': {}}, 'image_service': }' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:00 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5b81eeed-4e02-428c-a570-ebca91a572f7 tempest-VolumeImageDependencyTests-1054771306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5180e158-8cb0-4a80-96db-b52b026b1558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:00 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5b81eeed-4e02-428c-a570-ebca91a572f7 tempest-VolumeImageDependencyTests-1054771306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5180e158-8cb0-4a80-96db-b52b026b1558) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:00 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5b81eeed-4e02-428c-a570-ebca91a572f7 tempest-VolumeImageDependencyTests-1054771306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d98580f0-7179-4249-901d-3c78d70ba8a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:00 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-5b81eeed-4e02-428c-a570-ebca91a572f7 tempest-VolumeImageDependencyTests-1054771306 None] Volume a9c0326b-e806-452a-afb0-e3633624bab6: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a9c0326b-e806-452a-afb0-e3633624bab6', 'volume_size': 1, 'image_id': '262fed89-7121-4586-83c3-b8af290b8def', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/262fed89-7121-4586-83c3-b8af290b8def', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '051f492a8e058acca6e84a58285a9092', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ccf384ce881147f3ac7a02f125d3644b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4035387db6077b26bee3f25557ab3b0b3b837e1dd8fc73615ce99cc12670a9f5eecd7ea58d9f4cc410dfb9727ef5835cc19593bd9982ac9040958a3b7ac5fd08', 'id': '262fed89-7121-4586-83c3-b8af290b8def', 'created_at': datetime.datetime(2026, 11, 6, 14, 40, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 14, 40, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/262fed89-7121-4586-83c3-b8af290b8def/file', 'properties': {}}, 'image_service': } Nov 06 15:41:00 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b81eeed-4e02-428c-a570-ebca91a572f7 tempest-VolumeImageDependencyTests-1054771306 None] Trying to clone a9c0326b-e806-452a-afb0-e3633624bab6 from image 262fed89-7121-4586-83c3-b8af290b8def at location (None, [{'url': 'file:///opt/stack/data/glance/images/262fed89-7121-4586-83c3-b8af290b8def', 'metadata': {}}]). {{(pid=87132) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 06 15:41:00 devstack sudo[107184]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a324bc87-7758-4b31-81de-f72fed638291 tempest-VolumeDependencyTests-83919300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-3a12aff2-b559-4779-a8d4-0de3527dfee1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-3a12aff2-b559-4779-a8d4-0de3527dfee1.3e186b4a-9bd8-4209-ae98-dd2c950830b3 1G" returned: 0 in 0.546s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a324bc87-7758-4b31-81de-f72fed638291 tempest-VolumeDependencyTests-83919300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a12aff2-b559-4779-a8d4-0de3527dfee1 -F qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-3a12aff2-b559-4779-a8d4-0de3527dfee1.3e186b4a-9bd8-4209-ae98-dd2c950830b3 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:00 devstack sudo[107189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a12aff2-b559-4779-a8d4-0de3527dfee1 -F qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-3a12aff2-b559-4779-a8d4-0de3527dfee1.3e186b4a-9bd8-4209-ae98-dd2c950830b3 Nov 06 15:41:00 devstack sudo[107189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:00 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-5b81eeed-4e02-428c-a570-ebca91a572f7 tempest-VolumeImageDependencyTests-1054771306 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_262fed89-7121-4586-83c3-b8af290b8def_qcvqcqkodevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87132) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 06 15:41:00 devstack cinder-volume[87132]: INFO cinder.image.image_utils [None req-5b81eeed-4e02-428c-a570-ebca91a572f7 tempest-VolumeImageDependencyTests-1054771306 None] Image download 0.00 MB at 0.00 MB/s Nov 06 15:41:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-71a0a82f-64d2-4ef7-ba9b-d1fe6e6eb0ae tempest-CreateVolumesFromSnapshotTest-597264870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:41:00 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[c53397b3-09da-4677-af3d-bc5098adb858]: (4, 'raw') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:41:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5b81eeed-4e02-428c-a570-ebca91a572f7 tempest-VolumeImageDependencyTests-1054771306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_262fed89-7121-4586-83c3-b8af290b8def_qcvqcqkodevstack@QuobyteHD {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:00 devstack sudo[107191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_262fed89-7121-4586-83c3-b8af290b8def_qcvqcqkodevstack@QuobyteHD Nov 06 15:41:00 devstack sudo[107191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:00 devstack sudo[107189]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a324bc87-7758-4b31-81de-f72fed638291 tempest-VolumeDependencyTests-83919300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a12aff2-b559-4779-a8d4-0de3527dfee1 -F qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-3a12aff2-b559-4779-a8d4-0de3527dfee1.3e186b4a-9bd8-4209-ae98-dd2c950830b3" returned: 0 in 0.356s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:00 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-a324bc87-7758-4b31-81de-f72fed638291 tempest-VolumeDependencyTests-83919300 None] /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-3a12aff2-b559-4779-a8d4-0de3527dfee1.3e186b4a-9bd8-4209-ae98-dd2c950830b3 is being set with open permissions: ugo+rw Nov 06 15:41:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a324bc87-7758-4b31-81de-f72fed638291 tempest-VolumeDependencyTests-83919300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-3a12aff2-b559-4779-a8d4-0de3527dfee1.3e186b4a-9bd8-4209-ae98-dd2c950830b3 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:00 devstack sudo[107196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-3a12aff2-b559-4779-a8d4-0de3527dfee1.3e186b4a-9bd8-4209-ae98-dd2c950830b3 Nov 06 15:41:00 devstack sudo[107196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:00 devstack sudo[107191]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5b81eeed-4e02-428c-a570-ebca91a572f7 tempest-VolumeImageDependencyTests-1054771306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_262fed89-7121-4586-83c3-b8af290b8def_qcvqcqkodevstack@QuobyteHD" returned: 0 in 0.384s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5b81eeed-4e02-428c-a570-ebca91a572f7 tempest-VolumeImageDependencyTests-1054771306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_262fed89-7121-4586-83c3-b8af290b8def_qcvqcqkodevstack@QuobyteHD {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:01 devstack sudo[107196]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a324bc87-7758-4b31-81de-f72fed638291 tempest-VolumeDependencyTests-83919300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-3a12aff2-b559-4779-a8d4-0de3527dfee1.3e186b4a-9bd8-4209-ae98-dd2c950830b3" returned: 0 in 0.280s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:01 devstack sudo[107200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_262fed89-7121-4586-83c3-b8af290b8def_qcvqcqkodevstack@QuobyteHD Nov 06 15:41:01 devstack sudo[107200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:01 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:SELECT=111,cinder:INSERT=32,cinder:UPDATE=144,cinder:DELETE=12 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 15:41:01 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbb8fa18-fa8a-4a59-9000-de88fd4ff481 tempest-VolumeAndVolumeTypeFromImageTest-353123403 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:41:01 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-dbb8fa18-fa8a-4a59-9000-de88fd4ff481 tempest-VolumeAndVolumeTypeFromImageTest-353123403 None] Flow 'volume_create_manager' (99b903d4-cca7-43eb-a6b3-84595d661f87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:41:01 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-dbb8fa18-fa8a-4a59-9000-de88fd4ff481 tempest-VolumeAndVolumeTypeFromImageTest-353123403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (306bb7aa-3e2a-46a8-9059-929211fbbeb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:01 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:SELECT=113,cinder:UPDATE=166,cinder:DELETE=16,cinder:INSERT=41 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 15:41:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a324bc87-7758-4b31-81de-f72fed638291 tempest-VolumeDependencyTests-83919300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-3a12aff2-b559-4779-a8d4-0de3527dfee1.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:01 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-dbb8fa18-fa8a-4a59-9000-de88fd4ff481 tempest-VolumeAndVolumeTypeFromImageTest-353123403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (306bb7aa-3e2a-46a8-9059-929211fbbeb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:41:01Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=951cf559-4799-4995-8ef3-f05b4538fb47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98a8e245da0b4412bcb382149b277930',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:41:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:41:01Z,use_quota=True,user_id='056e15882f8c4b7590a480ac4812ce7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a6a3eb7-f734-4ed8-a8d2-d411fb96ebbb),volume_type_id=1a6a3eb7-f734-4ed8-a8d2-d411fb96ebbb)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:01 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-dbb8fa18-fa8a-4a59-9000-de88fd4ff481 tempest-VolumeAndVolumeTypeFromImageTest-353123403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcb1542f-087b-49eb-9cba-6935e145dc83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:01 devstack sudo[107203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-3a12aff2-b559-4779-a8d4-0de3527dfee1.info Nov 06 15:41:01 devstack sudo[107203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:01 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-dbb8fa18-fa8a-4a59-9000-de88fd4ff481 tempest-VolumeAndVolumeTypeFromImageTest-353123403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcb1542f-087b-49eb-9cba-6935e145dc83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:01 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-dbb8fa18-fa8a-4a59-9000-de88fd4ff481 tempest-VolumeAndVolumeTypeFromImageTest-353123403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bd29243-4737-4950-a802-c24ff29a8e29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:01 devstack cinder-volume[87132]: DEBUG cinder.image.glance [None req-dbb8fa18-fa8a-4a59-9000-de88fd4ff481 tempest-VolumeAndVolumeTypeFromImageTest-353123403 None] Creating Keystone auth plugin from conf {{(pid=87132) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 06 15:41:01 devstack sudo[107200]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5b81eeed-4e02-428c-a570-ebca91a572f7 tempest-VolumeImageDependencyTests-1054771306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_262fed89-7121-4586-83c3-b8af290b8def_qcvqcqkodevstack@QuobyteHD" returned: 1 in 0.356s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5b81eeed-4e02-428c-a570-ebca91a572f7 tempest-VolumeImageDependencyTests-1054771306 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_262fed89-7121-4586-83c3-b8af290b8def_qcvqcqkodevstack@QuobyteHD' failed. Not Retrying. {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 15:41:01 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-5b81eeed-4e02-428c-a570-ebca91a572f7 tempest-VolumeImageDependencyTests-1054771306 None] Temporary image 262fed89-7121-4586-83c3-b8af290b8def is fetched for user 2900c01330d84738968aa0842df5732f. {{(pid=87132) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 06 15:41:01 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[c34f9c61-3d60-49ab-8501-76c429f4581f]: (4, 'raw') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:41:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5b81eeed-4e02-428c-a570-ebca91a572f7 tempest-VolumeImageDependencyTests-1054771306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_262fed89-7121-4586-83c3-b8af290b8def_qcvqcqkodevstack@QuobyteHD {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:01 devstack sudo[107203]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:01 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-dbb8fa18-fa8a-4a59-9000-de88fd4ff481 tempest-VolumeAndVolumeTypeFromImageTest-353123403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bd29243-4737-4950-a802-c24ff29a8e29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '951cf559-4799-4995-8ef3-f05b4538fb47', 'volume_name': 'volume-951cf559-4799-4995-8ef3-f05b4538fb47', 'volume_size': 1, 'image_id': 'e72de57d-d8ff-4afa-aa0d-2fcc97e3d166', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e72de57d-d8ff-4afa-aa0d-2fcc97e3d166', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8f3cc8921de37083f9932d8a118497ad', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '98a8e245da0b4412bcb382149b277930', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3cfef1c71700c4af9f95fc6a9544a8fc125e25e926acaaebc45f3b51a853d35022130ac3b0ed2fccc4a94be10e1c92f7e20df3c81671a93097daa6e815a93966', 'id': 'e72de57d-d8ff-4afa-aa0d-2fcc97e3d166', 'created_at': datetime.datetime(2026, 11, 6, 14, 40, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 14, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e72de57d-d8ff-4afa-aa0d-2fcc97e3d166/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:01 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-dbb8fa18-fa8a-4a59-9000-de88fd4ff481 tempest-VolumeAndVolumeTypeFromImageTest-353123403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0650c42-07b8-4337-aa64-5cbb1358c58d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:01 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-dbb8fa18-fa8a-4a59-9000-de88fd4ff481 tempest-VolumeAndVolumeTypeFromImageTest-353123403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0650c42-07b8-4337-aa64-5cbb1358c58d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:01 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-dbb8fa18-fa8a-4a59-9000-de88fd4ff481 tempest-VolumeAndVolumeTypeFromImageTest-353123403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8982788-40f6-4a7c-af1a-3fa9ff32bcad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:01 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-dbb8fa18-fa8a-4a59-9000-de88fd4ff481 tempest-VolumeAndVolumeTypeFromImageTest-353123403 None] Volume 951cf559-4799-4995-8ef3-f05b4538fb47: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-951cf559-4799-4995-8ef3-f05b4538fb47', 'volume_size': 1, 'image_id': 'e72de57d-d8ff-4afa-aa0d-2fcc97e3d166', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e72de57d-d8ff-4afa-aa0d-2fcc97e3d166', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8f3cc8921de37083f9932d8a118497ad', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '98a8e245da0b4412bcb382149b277930', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3cfef1c71700c4af9f95fc6a9544a8fc125e25e926acaaebc45f3b51a853d35022130ac3b0ed2fccc4a94be10e1c92f7e20df3c81671a93097daa6e815a93966', 'id': 'e72de57d-d8ff-4afa-aa0d-2fcc97e3d166', 'created_at': datetime.datetime(2026, 11, 6, 14, 40, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 14, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e72de57d-d8ff-4afa-aa0d-2fcc97e3d166/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Nov 06 15:41:01 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbb8fa18-fa8a-4a59-9000-de88fd4ff481 tempest-VolumeAndVolumeTypeFromImageTest-353123403 None] Trying to clone 951cf559-4799-4995-8ef3-f05b4538fb47 from image e72de57d-d8ff-4afa-aa0d-2fcc97e3d166 at location (None, [{'url': 'file:///opt/stack/data/glance/images/e72de57d-d8ff-4afa-aa0d-2fcc97e3d166', 'metadata': {}}]). {{(pid=87132) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 06 15:41:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a324bc87-7758-4b31-81de-f72fed638291 tempest-VolumeDependencyTests-83919300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-3a12aff2-b559-4779-a8d4-0de3527dfee1.info" returned: 0 in 0.310s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:01 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-a324bc87-7758-4b31-81de-f72fed638291 tempest-VolumeDependencyTests-83919300 None] /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-3a12aff2-b559-4779-a8d4-0de3527dfee1.info is being set with open permissions: ugo+rw Nov 06 15:41:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a324bc87-7758-4b31-81de-f72fed638291 tempest-VolumeDependencyTests-83919300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-3a12aff2-b559-4779-a8d4-0de3527dfee1.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:01 devstack sudo[107224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-3a12aff2-b559-4779-a8d4-0de3527dfee1.info Nov 06 15:41:01 devstack sudo[107224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:01 devstack sudo[107209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_262fed89-7121-4586-83c3-b8af290b8def_qcvqcqkodevstack@QuobyteHD Nov 06 15:41:01 devstack sudo[107209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:01 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-dbb8fa18-fa8a-4a59-9000-de88fd4ff481 tempest-VolumeAndVolumeTypeFromImageTest-353123403 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e72de57d-d8ff-4afa-aa0d-2fcc97e3d166_shpwllmcdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87132) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 06 15:41:01 devstack cinder-volume[87132]: INFO cinder.image.image_utils [None req-dbb8fa18-fa8a-4a59-9000-de88fd4ff481 tempest-VolumeAndVolumeTypeFromImageTest-353123403 None] Image download 0.00 MB at 0.00 MB/s Nov 06 15:41:01 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2f4dcaf-6294-436c-a8a2-62f3d792bdc4]: (4, 'raw') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:41:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-dbb8fa18-fa8a-4a59-9000-de88fd4ff481 tempest-VolumeAndVolumeTypeFromImageTest-353123403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e72de57d-d8ff-4afa-aa0d-2fcc97e3d166_shpwllmcdevstack@QuobyteHD {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:01 devstack sudo[107209]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5b81eeed-4e02-428c-a570-ebca91a572f7 tempest-VolumeImageDependencyTests-1054771306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_262fed89-7121-4586-83c3-b8af290b8def_qcvqcqkodevstack@QuobyteHD" returned: 0 in 0.394s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5b81eeed-4e02-428c-a570-ebca91a572f7 tempest-VolumeImageDependencyTests-1054771306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_262fed89-7121-4586-83c3-b8af290b8def_qcvqcqkodevstack@QuobyteHD {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:01 devstack sudo[107247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e72de57d-d8ff-4afa-aa0d-2fcc97e3d166_shpwllmcdevstack@QuobyteHD Nov 06 15:41:01 devstack sudo[107247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:01 devstack sudo[107224]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a324bc87-7758-4b31-81de-f72fed638291 tempest-VolumeDependencyTests-83919300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-3a12aff2-b559-4779-a8d4-0de3527dfee1.info" returned: 0 in 0.400s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a324bc87-7758-4b31-81de-f72fed638291 tempest-VolumeDependencyTests-83919300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.483s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:41:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-71a0a82f-64d2-4ef7-ba9b-d1fe6e6eb0ae tempest-CreateVolumesFromSnapshotTest-597264870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.360s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:41:01 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-71a0a82f-64d2-4ef7-ba9b-d1fe6e6eb0ae tempest-CreateVolumesFromSnapshotTest-597264870 None] Creating offline snapshot b262df46-516c-4a3b-b1d7-26a097a26e42 of volume 4aa4c9ca-068b-4ce6-b155-59c0e6df9dd7 {{(pid=87132) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 15:41:01 devstack sudo[107252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_262fed89-7121-4586-83c3-b8af290b8def_qcvqcqkodevstack@QuobyteHD Nov 06 15:41:01 devstack sudo[107252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:01 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-a324bc87-7758-4b31-81de-f72fed638291 tempest-VolumeDependencyTests-83919300 None] Create snapshot completed successfully Nov 06 15:41:01 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[abff3318-3706-4c9c-a5dd-60700f35dcae]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:41:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-71a0a82f-64d2-4ef7-ba9b-d1fe6e6eb0ae tempest-CreateVolumesFromSnapshotTest-597264870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-4aa4c9ca-068b-4ce6-b155-59c0e6df9dd7 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:02 devstack sudo[107256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-4aa4c9ca-068b-4ce6-b155-59c0e6df9dd7 Nov 06 15:41:02 devstack sudo[107256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:02 devstack sudo[107247]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-dbb8fa18-fa8a-4a59-9000-de88fd4ff481 tempest-VolumeAndVolumeTypeFromImageTest-353123403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e72de57d-d8ff-4afa-aa0d-2fcc97e3d166_shpwllmcdevstack@QuobyteHD" returned: 0 in 0.404s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-dbb8fa18-fa8a-4a59-9000-de88fd4ff481 tempest-VolumeAndVolumeTypeFromImageTest-353123403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e72de57d-d8ff-4afa-aa0d-2fcc97e3d166_shpwllmcdevstack@QuobyteHD {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:02 devstack sudo[107252]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5b81eeed-4e02-428c-a570-ebca91a572f7 tempest-VolumeImageDependencyTests-1054771306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_262fed89-7121-4586-83c3-b8af290b8def_qcvqcqkodevstack@QuobyteHD" returned: 1 in 0.391s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5b81eeed-4e02-428c-a570-ebca91a572f7 tempest-VolumeImageDependencyTests-1054771306 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_262fed89-7121-4586-83c3-b8af290b8def_qcvqcqkodevstack@QuobyteHD' failed. Not Retrying. {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 15:41:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5b81eeed-4e02-428c-a570-ebca91a572f7 tempest-VolumeImageDependencyTests-1054771306 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:41:02 devstack sudo[107260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e72de57d-d8ff-4afa-aa0d-2fcc97e3d166_shpwllmcdevstack@QuobyteHD Nov 06 15:41:02 devstack sudo[107260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:02 devstack sudo[107256]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-71a0a82f-64d2-4ef7-ba9b-d1fe6e6eb0ae tempest-CreateVolumesFromSnapshotTest-597264870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-4aa4c9ca-068b-4ce6-b155-59c0e6df9dd7" returned: 0 in 0.370s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-71a0a82f-64d2-4ef7-ba9b-d1fe6e6eb0ae tempest-CreateVolumesFromSnapshotTest-597264870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-4aa4c9ca-068b-4ce6-b155-59c0e6df9dd7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-4aa4c9ca-068b-4ce6-b155-59c0e6df9dd7.b262df46-516c-4a3b-b1d7-26a097a26e42 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:02 devstack sudo[107268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-4aa4c9ca-068b-4ce6-b155-59c0e6df9dd7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-4aa4c9ca-068b-4ce6-b155-59c0e6df9dd7.b262df46-516c-4a3b-b1d7-26a097a26e42 1G Nov 06 15:41:02 devstack sudo[107268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:02 devstack sudo[107260]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-dbb8fa18-fa8a-4a59-9000-de88fd4ff481 tempest-VolumeAndVolumeTypeFromImageTest-353123403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e72de57d-d8ff-4afa-aa0d-2fcc97e3d166_shpwllmcdevstack@QuobyteHD" returned: 1 in 0.338s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-dbb8fa18-fa8a-4a59-9000-de88fd4ff481 tempest-VolumeAndVolumeTypeFromImageTest-353123403 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e72de57d-d8ff-4afa-aa0d-2fcc97e3d166_shpwllmcdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 15:41:02 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-dbb8fa18-fa8a-4a59-9000-de88fd4ff481 tempest-VolumeAndVolumeTypeFromImageTest-353123403 None] Temporary image e72de57d-d8ff-4afa-aa0d-2fcc97e3d166 is fetched for user 056e15882f8c4b7590a480ac4812ce7f. {{(pid=87132) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 06 15:41:02 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aafa02f-af76-4ea9-8707-68dbd3e713b6]: (4, 'raw') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:41:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-dbb8fa18-fa8a-4a59-9000-de88fd4ff481 tempest-VolumeAndVolumeTypeFromImageTest-353123403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e72de57d-d8ff-4afa-aa0d-2fcc97e3d166_shpwllmcdevstack@QuobyteHD {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:02 devstack sudo[107273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e72de57d-d8ff-4afa-aa0d-2fcc97e3d166_shpwllmcdevstack@QuobyteHD Nov 06 15:41:02 devstack sudo[107273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:02 devstack sudo[107268]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-71a0a82f-64d2-4ef7-ba9b-d1fe6e6eb0ae tempest-CreateVolumesFromSnapshotTest-597264870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-4aa4c9ca-068b-4ce6-b155-59c0e6df9dd7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-4aa4c9ca-068b-4ce6-b155-59c0e6df9dd7.b262df46-516c-4a3b-b1d7-26a097a26e42 1G" returned: 0 in 0.452s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-71a0a82f-64d2-4ef7-ba9b-d1fe6e6eb0ae tempest-CreateVolumesFromSnapshotTest-597264870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4aa4c9ca-068b-4ce6-b155-59c0e6df9dd7 -F qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-4aa4c9ca-068b-4ce6-b155-59c0e6df9dd7.b262df46-516c-4a3b-b1d7-26a097a26e42 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:02 devstack sudo[107279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4aa4c9ca-068b-4ce6-b155-59c0e6df9dd7 -F qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-4aa4c9ca-068b-4ce6-b155-59c0e6df9dd7.b262df46-516c-4a3b-b1d7-26a097a26e42 Nov 06 15:41:02 devstack sudo[107279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:02 devstack sudo[107273]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-dbb8fa18-fa8a-4a59-9000-de88fd4ff481 tempest-VolumeAndVolumeTypeFromImageTest-353123403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e72de57d-d8ff-4afa-aa0d-2fcc97e3d166_shpwllmcdevstack@QuobyteHD" returned: 0 in 0.394s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-dbb8fa18-fa8a-4a59-9000-de88fd4ff481 tempest-VolumeAndVolumeTypeFromImageTest-353123403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e72de57d-d8ff-4afa-aa0d-2fcc97e3d166_shpwllmcdevstack@QuobyteHD {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:03 devstack sudo[107283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e72de57d-d8ff-4afa-aa0d-2fcc97e3d166_shpwllmcdevstack@QuobyteHD Nov 06 15:41:03 devstack sudo[107283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:03 devstack sudo[107279]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-71a0a82f-64d2-4ef7-ba9b-d1fe6e6eb0ae tempest-CreateVolumesFromSnapshotTest-597264870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4aa4c9ca-068b-4ce6-b155-59c0e6df9dd7 -F qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-4aa4c9ca-068b-4ce6-b155-59c0e6df9dd7.b262df46-516c-4a3b-b1d7-26a097a26e42" returned: 0 in 0.364s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:03 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-71a0a82f-64d2-4ef7-ba9b-d1fe6e6eb0ae tempest-CreateVolumesFromSnapshotTest-597264870 None] /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-4aa4c9ca-068b-4ce6-b155-59c0e6df9dd7.b262df46-516c-4a3b-b1d7-26a097a26e42 is being set with open permissions: ugo+rw Nov 06 15:41:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-71a0a82f-64d2-4ef7-ba9b-d1fe6e6eb0ae tempest-CreateVolumesFromSnapshotTest-597264870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-4aa4c9ca-068b-4ce6-b155-59c0e6df9dd7.b262df46-516c-4a3b-b1d7-26a097a26e42 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:03 devstack sudo[107288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-4aa4c9ca-068b-4ce6-b155-59c0e6df9dd7.b262df46-516c-4a3b-b1d7-26a097a26e42 Nov 06 15:41:03 devstack sudo[107288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:03 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f2113ad-f339-452c-a5d5-033013e9a310 tempest-VolumeDependencyTests-83919300 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:41:03 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6f2113ad-f339-452c-a5d5-033013e9a310 tempest-VolumeDependencyTests-83919300 None] Flow 'volume_create_manager' (5e1f4fda-54ac-4223-b2d5-fb2cfaf71520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:41:03 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6f2113ad-f339-452c-a5d5-033013e9a310 tempest-VolumeDependencyTests-83919300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d840323e-52bd-4527-ab0a-b0451d2d8802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:03 devstack sudo[107283]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-dbb8fa18-fa8a-4a59-9000-de88fd4ff481 tempest-VolumeAndVolumeTypeFromImageTest-353123403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e72de57d-d8ff-4afa-aa0d-2fcc97e3d166_shpwllmcdevstack@QuobyteHD" returned: 1 in 0.389s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-dbb8fa18-fa8a-4a59-9000-de88fd4ff481 tempest-VolumeAndVolumeTypeFromImageTest-353123403 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e72de57d-d8ff-4afa-aa0d-2fcc97e3d166_shpwllmcdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 15:41:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-dbb8fa18-fa8a-4a59-9000-de88fd4ff481 tempest-VolumeAndVolumeTypeFromImageTest-353123403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:41:03 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6f2113ad-f339-452c-a5d5-033013e9a310 tempest-VolumeDependencyTests-83919300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d840323e-52bd-4527-ab0a-b0451d2d8802) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:41:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1766441035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb9985c5-0f9d-4cae-b37d-a40451610be2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4851653571ad4d6595603dd8bfd465c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:41:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=3e186b4a-9bd8-4209-ae98-dd2c950830b3,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:41:03Z,use_quota=True,user_id='0e3f0d29a1454997bdabddfe9c15368d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:03 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6f2113ad-f339-452c-a5d5-033013e9a310 tempest-VolumeDependencyTests-83919300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a189b1f-b8bb-4d03-9f37-73cfef926783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:03 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6f2113ad-f339-452c-a5d5-033013e9a310 tempest-VolumeDependencyTests-83919300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a189b1f-b8bb-4d03-9f37-73cfef926783) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:03 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6f2113ad-f339-452c-a5d5-033013e9a310 tempest-VolumeDependencyTests-83919300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (102b92a0-da17-4635-82ec-36c0b6df5b16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:03 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6f2113ad-f339-452c-a5d5-033013e9a310 tempest-VolumeDependencyTests-83919300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (102b92a0-da17-4635-82ec-36c0b6df5b16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'fb9985c5-0f9d-4cae-b37d-a40451610be2', 'volume_name': 'volume-fb9985c5-0f9d-4cae-b37d-a40451610be2', 'volume_size': 1, 'snapshot_id': '3e186b4a-9bd8-4209-ae98-dd2c950830b3'}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:03 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6f2113ad-f339-452c-a5d5-033013e9a310 tempest-VolumeDependencyTests-83919300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fd76351-b5db-4e16-bd4d-6fbcec27dc8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:03 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6f2113ad-f339-452c-a5d5-033013e9a310 tempest-VolumeDependencyTests-83919300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fd76351-b5db-4e16-bd4d-6fbcec27dc8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:03 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6f2113ad-f339-452c-a5d5-033013e9a310 tempest-VolumeDependencyTests-83919300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bd2f7b5-8226-4be0-a717-08d8cd0044f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:03 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-6f2113ad-f339-452c-a5d5-033013e9a310 tempest-VolumeDependencyTests-83919300 None] Volume fb9985c5-0f9d-4cae-b37d-a40451610be2: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-fb9985c5-0f9d-4cae-b37d-a40451610be2', 'volume_size': 1, 'snapshot_id': '3e186b4a-9bd8-4209-ae98-dd2c950830b3'} Nov 06 15:41:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6f2113ad-f339-452c-a5d5-033013e9a310 tempest-VolumeDependencyTests-83919300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:41:03 devstack sudo[107288]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-71a0a82f-64d2-4ef7-ba9b-d1fe6e6eb0ae tempest-CreateVolumesFromSnapshotTest-597264870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-4aa4c9ca-068b-4ce6-b155-59c0e6df9dd7.b262df46-516c-4a3b-b1d7-26a097a26e42" returned: 0 in 0.265s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-71a0a82f-64d2-4ef7-ba9b-d1fe6e6eb0ae tempest-CreateVolumesFromSnapshotTest-597264870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-4aa4c9ca-068b-4ce6-b155-59c0e6df9dd7.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:03 devstack sudo[107294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-4aa4c9ca-068b-4ce6-b155-59c0e6df9dd7.info Nov 06 15:41:03 devstack sudo[107294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:03 devstack sudo[107294]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-71a0a82f-64d2-4ef7-ba9b-d1fe6e6eb0ae tempest-CreateVolumesFromSnapshotTest-597264870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-4aa4c9ca-068b-4ce6-b155-59c0e6df9dd7.info" returned: 0 in 0.256s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:03 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-71a0a82f-64d2-4ef7-ba9b-d1fe6e6eb0ae tempest-CreateVolumesFromSnapshotTest-597264870 None] /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-4aa4c9ca-068b-4ce6-b155-59c0e6df9dd7.info is being set with open permissions: ugo+rw Nov 06 15:41:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-71a0a82f-64d2-4ef7-ba9b-d1fe6e6eb0ae tempest-CreateVolumesFromSnapshotTest-597264870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-4aa4c9ca-068b-4ce6-b155-59c0e6df9dd7.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:03 devstack sudo[107297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-4aa4c9ca-068b-4ce6-b155-59c0e6df9dd7.info Nov 06 15:41:03 devstack sudo[107297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:03 devstack sudo[107297]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-71a0a82f-64d2-4ef7-ba9b-d1fe6e6eb0ae tempest-CreateVolumesFromSnapshotTest-597264870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-4aa4c9ca-068b-4ce6-b155-59c0e6df9dd7.info" returned: 0 in 0.239s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-71a0a82f-64d2-4ef7-ba9b-d1fe6e6eb0ae tempest-CreateVolumesFromSnapshotTest-597264870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.053s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:41:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5b81eeed-4e02-428c-a570-ebca91a572f7 tempest-VolumeImageDependencyTests-1054771306 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.804s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:41:03 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-5b81eeed-4e02-428c-a570-ebca91a572f7 tempest-VolumeImageDependencyTests-1054771306 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:41:00Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9c0326b-e806-452a-afb0-e3633624bab6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccf384ce881147f3ac7a02f125d3644b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:41:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:41:00Z,use_quota=True,user_id='2900c01330d84738968aa0842df5732f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:41:03 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-5b81eeed-4e02-428c-a570-ebca91a572f7 tempest-VolumeImageDependencyTests-1054771306 None] Creating volume a9c0326b-e806-452a-afb0-e3633624bab6 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:41:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5b81eeed-4e02-428c-a570-ebca91a572f7 tempest-VolumeImageDependencyTests-1054771306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:41:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5b81eeed-4e02-428c-a570-ebca91a572f7 tempest-VolumeImageDependencyTests-1054771306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:41:03 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-5b81eeed-4e02-428c-a570-ebca91a572f7 tempest-VolumeImageDependencyTests-1054771306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:41:04 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-5b81eeed-4e02-428c-a570-ebca91a572f7 tempest-VolumeImageDependencyTests-1054771306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:41:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5b81eeed-4e02-428c-a570-ebca91a572f7 tempest-VolumeImageDependencyTests-1054771306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:41:04 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-5b81eeed-4e02-428c-a570-ebca91a572f7 tempest-VolumeImageDependencyTests-1054771306 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:41:04 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-5b81eeed-4e02-428c-a570-ebca91a572f7 tempest-VolumeImageDependencyTests-1054771306 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:41:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5b81eeed-4e02-428c-a570-ebca91a572f7 tempest-VolumeImageDependencyTests-1054771306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a9c0326b-e806-452a-afb0-e3633624bab6 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:04 devstack sudo[107300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a9c0326b-e806-452a-afb0-e3633624bab6 1073741824 Nov 06 15:41:04 devstack sudo[107300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:04 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-71a0a82f-64d2-4ef7-ba9b-d1fe6e6eb0ae tempest-CreateVolumesFromSnapshotTest-597264870 None] Create snapshot completed successfully Nov 06 15:41:04 devstack sudo[107300]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5b81eeed-4e02-428c-a570-ebca91a572f7 tempest-VolumeImageDependencyTests-1054771306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a9c0326b-e806-452a-afb0-e3633624bab6 1073741824" returned: 0 in 0.413s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5b81eeed-4e02-428c-a570-ebca91a572f7 tempest-VolumeImageDependencyTests-1054771306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a9c0326b-e806-452a-afb0-e3633624bab6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:04 devstack sudo[107306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a9c0326b-e806-452a-afb0-e3633624bab6 Nov 06 15:41:04 devstack sudo[107306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:04 devstack sudo[107306]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5b81eeed-4e02-428c-a570-ebca91a572f7 tempest-VolumeImageDependencyTests-1054771306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a9c0326b-e806-452a-afb0-e3633624bab6" returned: 0 in 0.252s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:04 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-5b81eeed-4e02-428c-a570-ebca91a572f7 tempest-VolumeImageDependencyTests-1054771306 None] <== create_volume: return (702ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:41:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5b81eeed-4e02-428c-a570-ebca91a572f7 tempest-VolumeImageDependencyTests-1054771306 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.705s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:41:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-dbb8fa18-fa8a-4a59-9000-de88fd4ff481 tempest-VolumeAndVolumeTypeFromImageTest-353123403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.410s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:41:04 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-dbb8fa18-fa8a-4a59-9000-de88fd4ff481 tempest-VolumeAndVolumeTypeFromImageTest-353123403 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:41:01Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=951cf559-4799-4995-8ef3-f05b4538fb47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98a8e245da0b4412bcb382149b277930',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:41:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:41:01Z,use_quota=True,user_id='056e15882f8c4b7590a480ac4812ce7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a6a3eb7-f734-4ed8-a8d2-d411fb96ebbb),volume_type_id=1a6a3eb7-f734-4ed8-a8d2-d411fb96ebbb)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:41:04 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-dbb8fa18-fa8a-4a59-9000-de88fd4ff481 tempest-VolumeAndVolumeTypeFromImageTest-353123403 None] Creating volume 951cf559-4799-4995-8ef3-f05b4538fb47 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:41:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-dbb8fa18-fa8a-4a59-9000-de88fd4ff481 tempest-VolumeAndVolumeTypeFromImageTest-353123403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:41:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-dbb8fa18-fa8a-4a59-9000-de88fd4ff481 tempest-VolumeAndVolumeTypeFromImageTest-353123403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:41:04 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-dbb8fa18-fa8a-4a59-9000-de88fd4ff481 tempest-VolumeAndVolumeTypeFromImageTest-353123403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:41:04 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-dbb8fa18-fa8a-4a59-9000-de88fd4ff481 tempest-VolumeAndVolumeTypeFromImageTest-353123403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:41:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-dbb8fa18-fa8a-4a59-9000-de88fd4ff481 tempest-VolumeAndVolumeTypeFromImageTest-353123403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:41:04 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-dbb8fa18-fa8a-4a59-9000-de88fd4ff481 tempest-VolumeAndVolumeTypeFromImageTest-353123403 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:41:04 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-dbb8fa18-fa8a-4a59-9000-de88fd4ff481 tempest-VolumeAndVolumeTypeFromImageTest-353123403 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:41:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-dbb8fa18-fa8a-4a59-9000-de88fd4ff481 tempest-VolumeAndVolumeTypeFromImageTest-353123403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-951cf559-4799-4995-8ef3-f05b4538fb47 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:04 devstack sudo[107309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-951cf559-4799-4995-8ef3-f05b4538fb47 1073741824 Nov 06 15:41:04 devstack sudo[107309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:04 devstack cinder-volume[87132]: DEBUG cinder.volume.volume_utils [None req-5b81eeed-4e02-428c-a570-ebca91a572f7 tempest-VolumeImageDependencyTests-1054771306 None] Attempting download of 262fed89-7121-4586-83c3-b8af290b8def ((None, [{'url': 'file:///opt/stack/data/glance/images/262fed89-7121-4586-83c3-b8af290b8def', 'metadata': {}}])) to volume a9c0326b-e806-452a-afb0-e3633624bab6. {{(pid=87132) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 06 15:41:04 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0ab3329-0e4c-4cad-bc52-01770179a5e6]: (4, 'raw') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:41:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5b81eeed-4e02-428c-a570-ebca91a572f7 tempest-VolumeImageDependencyTests-1054771306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_262fed89-7121-4586-83c3-b8af290b8def_gua3m4sm {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:04 devstack sudo[107311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_262fed89-7121-4586-83c3-b8af290b8def_gua3m4sm Nov 06 15:41:04 devstack sudo[107311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:05 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-004747c6-f7d1-4c09-9ee4-b1aaec57550e tempest-CreateVolumesFromSnapshotTest-597264870 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:41:05 devstack sudo[107311]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-004747c6-f7d1-4c09-9ee4-b1aaec57550e tempest-CreateVolumesFromSnapshotTest-597264870 None] Flow 'volume_create_manager' (0d38ae42-bf95-4818-a1de-0cfed176712e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:41:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-004747c6-f7d1-4c09-9ee4-b1aaec57550e tempest-CreateVolumesFromSnapshotTest-597264870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68847b0a-a79b-40d2-a429-59a8093429be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:05 devstack sudo[107309]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-dbb8fa18-fa8a-4a59-9000-de88fd4ff481 tempest-VolumeAndVolumeTypeFromImageTest-353123403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-951cf559-4799-4995-8ef3-f05b4538fb47 1073741824" returned: 0 in 0.545s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5b81eeed-4e02-428c-a570-ebca91a572f7 tempest-VolumeImageDependencyTests-1054771306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_262fed89-7121-4586-83c3-b8af290b8def_gua3m4sm" returned: 0 in 0.445s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5b81eeed-4e02-428c-a570-ebca91a572f7 tempest-VolumeImageDependencyTests-1054771306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_262fed89-7121-4586-83c3-b8af290b8def_gua3m4sm {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-004747c6-f7d1-4c09-9ee4-b1aaec57550e tempest-CreateVolumesFromSnapshotTest-597264870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68847b0a-a79b-40d2-a429-59a8093429be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:41:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2062489378',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5843b160-6efd-4d5d-81e2-718ae1fb0e7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1dd1416ca4b4ab78091d45ca8782b28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:41:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:41:05Z,use_quota=True,user_id='f0c1841ac23c45f4921295e6a25d28f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-004747c6-f7d1-4c09-9ee4-b1aaec57550e tempest-CreateVolumesFromSnapshotTest-597264870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f99b27f-b99a-4334-8d7b-73cebba01c82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-004747c6-f7d1-4c09-9ee4-b1aaec57550e tempest-CreateVolumesFromSnapshotTest-597264870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f99b27f-b99a-4334-8d7b-73cebba01c82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-004747c6-f7d1-4c09-9ee4-b1aaec57550e tempest-CreateVolumesFromSnapshotTest-597264870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af946c5c-127d-410f-843e-342b77c07e78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-004747c6-f7d1-4c09-9ee4-b1aaec57550e tempest-CreateVolumesFromSnapshotTest-597264870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af946c5c-127d-410f-843e-342b77c07e78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5843b160-6efd-4d5d-81e2-718ae1fb0e7d', 'volume_name': 'volume-5843b160-6efd-4d5d-81e2-718ae1fb0e7d', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-004747c6-f7d1-4c09-9ee4-b1aaec57550e tempest-CreateVolumesFromSnapshotTest-597264870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d34a91b9-e5c1-49e3-9706-4328bac37890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-004747c6-f7d1-4c09-9ee4-b1aaec57550e tempest-CreateVolumesFromSnapshotTest-597264870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d34a91b9-e5c1-49e3-9706-4328bac37890) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-004747c6-f7d1-4c09-9ee4-b1aaec57550e tempest-CreateVolumesFromSnapshotTest-597264870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38aad2aa-290b-46ca-91f6-f995d41071af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:05 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-004747c6-f7d1-4c09-9ee4-b1aaec57550e tempest-CreateVolumesFromSnapshotTest-597264870 None] Volume 5843b160-6efd-4d5d-81e2-718ae1fb0e7d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5843b160-6efd-4d5d-81e2-718ae1fb0e7d', 'volume_size': 1} Nov 06 15:41:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-004747c6-f7d1-4c09-9ee4-b1aaec57550e tempest-CreateVolumesFromSnapshotTest-597264870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:41:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-dbb8fa18-fa8a-4a59-9000-de88fd4ff481 tempest-VolumeAndVolumeTypeFromImageTest-353123403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-951cf559-4799-4995-8ef3-f05b4538fb47 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:05 devstack sudo[107321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-951cf559-4799-4995-8ef3-f05b4538fb47 Nov 06 15:41:05 devstack sudo[107321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:05 devstack sudo[107320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_262fed89-7121-4586-83c3-b8af290b8def_gua3m4sm Nov 06 15:41:05 devstack sudo[107320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:05 devstack sudo[107321]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:05 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-1558f3e6-fc9c-40a6-ada8-ecc14c26c451 tempest-CreateVolumesFromSnapshotTest-597264870 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:41:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1558f3e6-fc9c-40a6-ada8-ecc14c26c451 tempest-CreateVolumesFromSnapshotTest-597264870 None] Flow 'volume_create_manager' (0b461525-1cf8-4e4e-807d-352a85843d97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:41:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1558f3e6-fc9c-40a6-ada8-ecc14c26c451 tempest-CreateVolumesFromSnapshotTest-597264870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd243f71-87ce-4d55-a97c-4a2b75c09b84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-dbb8fa18-fa8a-4a59-9000-de88fd4ff481 tempest-VolumeAndVolumeTypeFromImageTest-353123403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-951cf559-4799-4995-8ef3-f05b4538fb47" returned: 0 in 0.317s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:05 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-dbb8fa18-fa8a-4a59-9000-de88fd4ff481 tempest-VolumeAndVolumeTypeFromImageTest-353123403 None] <== create_volume: return (980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:41:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-dbb8fa18-fa8a-4a59-9000-de88fd4ff481 tempest-VolumeAndVolumeTypeFromImageTest-353123403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.982s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:41:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6f2113ad-f339-452c-a5d5-033013e9a310 tempest-VolumeDependencyTests-83919300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.345s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:41:05 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6f2113ad-f339-452c-a5d5-033013e9a310 tempest-VolumeDependencyTests-83919300 None] Acquiring lock "cinder-quobyte-3e186b4a-9bd8-4209-ae98-dd2c950830b3-fb9985c5-0f9d-4cae-b37d-a40451610be2" by "_create_volume_from_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:41:05 devstack sudo[107320]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1558f3e6-fc9c-40a6-ada8-ecc14c26c451 tempest-CreateVolumesFromSnapshotTest-597264870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd243f71-87ce-4d55-a97c-4a2b75c09b84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:41:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-710008126',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31a9eed7-eb24-4406-9bfd-3f203ef984c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1dd1416ca4b4ab78091d45ca8782b28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:41:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:41:06Z,use_quota=True,user_id='f0c1841ac23c45f4921295e6a25d28f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1558f3e6-fc9c-40a6-ada8-ecc14c26c451 tempest-CreateVolumesFromSnapshotTest-597264870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51998b88-8157-4290-8775-2d25a1c5d280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1558f3e6-fc9c-40a6-ada8-ecc14c26c451 tempest-CreateVolumesFromSnapshotTest-597264870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51998b88-8157-4290-8775-2d25a1c5d280) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1558f3e6-fc9c-40a6-ada8-ecc14c26c451 tempest-CreateVolumesFromSnapshotTest-597264870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58eb1cf1-59cb-4a97-be85-aeae632c6ef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1558f3e6-fc9c-40a6-ada8-ecc14c26c451 tempest-CreateVolumesFromSnapshotTest-597264870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58eb1cf1-59cb-4a97-be85-aeae632c6ef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31a9eed7-eb24-4406-9bfd-3f203ef984c1', 'volume_name': 'volume-31a9eed7-eb24-4406-9bfd-3f203ef984c1', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1558f3e6-fc9c-40a6-ada8-ecc14c26c451 tempest-CreateVolumesFromSnapshotTest-597264870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f22bb95b-a9aa-4fa6-91c4-a52f01125518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1558f3e6-fc9c-40a6-ada8-ecc14c26c451 tempest-CreateVolumesFromSnapshotTest-597264870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f22bb95b-a9aa-4fa6-91c4-a52f01125518) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1558f3e6-fc9c-40a6-ada8-ecc14c26c451 tempest-CreateVolumesFromSnapshotTest-597264870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62c26079-8173-4543-a2ef-c84ce12e2245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:05 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-1558f3e6-fc9c-40a6-ada8-ecc14c26c451 tempest-CreateVolumesFromSnapshotTest-597264870 None] Volume 31a9eed7-eb24-4406-9bfd-3f203ef984c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31a9eed7-eb24-4406-9bfd-3f203ef984c1', 'volume_size': 1} Nov 06 15:41:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1558f3e6-fc9c-40a6-ada8-ecc14c26c451 tempest-CreateVolumesFromSnapshotTest-597264870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:41:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5b81eeed-4e02-428c-a570-ebca91a572f7 tempest-VolumeImageDependencyTests-1054771306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_262fed89-7121-4586-83c3-b8af290b8def_gua3m4sm" returned: 1 in 0.475s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5b81eeed-4e02-428c-a570-ebca91a572f7 tempest-VolumeImageDependencyTests-1054771306 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_262fed89-7121-4586-83c3-b8af290b8def_gua3m4sm' failed. Not Retrying. {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 15:41:05 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[8218cee6-abf1-4092-adf7-2f44d2f3ff46]: (4, 'raw') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:41:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5b81eeed-4e02-428c-a570-ebca91a572f7 tempest-VolumeImageDependencyTests-1054771306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_262fed89-7121-4586-83c3-b8af290b8def_qcvqcqkodevstack@QuobyteHD {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:05 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6f2113ad-f339-452c-a5d5-033013e9a310 tempest-VolumeDependencyTests-83919300 None] Lock "cinder-quobyte-3e186b4a-9bd8-4209-ae98-dd2c950830b3-fb9985c5-0f9d-4cae-b37d-a40451610be2" acquired by "_create_volume_from_snapshot" :: waited 0.081s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:41:05 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-6f2113ad-f339-452c-a5d5-033013e9a310 tempest-VolumeDependencyTests-83919300 None] Creating volume fb9985c5-0f9d-4cae-b37d-a40451610be2 from snapshot 3e186b4a-9bd8-4209-ae98-dd2c950830b3 {{(pid=87132) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 06 15:41:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6f2113ad-f339-452c-a5d5-033013e9a310 tempest-VolumeDependencyTests-83919300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:41:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6f2113ad-f339-452c-a5d5-033013e9a310 tempest-VolumeDependencyTests-83919300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:41:05 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-6f2113ad-f339-452c-a5d5-033013e9a310 tempest-VolumeDependencyTests-83919300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:41:05 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-6f2113ad-f339-452c-a5d5-033013e9a310 tempest-VolumeDependencyTests-83919300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:41:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6f2113ad-f339-452c-a5d5-033013e9a310 tempest-VolumeDependencyTests-83919300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:41:05 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-6f2113ad-f339-452c-a5d5-033013e9a310 tempest-VolumeDependencyTests-83919300 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:41:05 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6f2113ad-f339-452c-a5d5-033013e9a310 tempest-VolumeDependencyTests-83919300 None] Acquiring lock "cinder-quobyte-fb9985c5-0f9d-4cae-b37d-a40451610be2" by "_copy_volume_from_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:41:05 devstack cinder-volume[87132]: DEBUG cinder.volume.volume_utils [None req-dbb8fa18-fa8a-4a59-9000-de88fd4ff481 tempest-VolumeAndVolumeTypeFromImageTest-353123403 None] Attempting download of e72de57d-d8ff-4afa-aa0d-2fcc97e3d166 ((None, [{'url': 'file:///opt/stack/data/glance/images/e72de57d-d8ff-4afa-aa0d-2fcc97e3d166', 'metadata': {}}])) to volume 951cf559-4799-4995-8ef3-f05b4538fb47. {{(pid=87132) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 06 15:41:05 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6f2113ad-f339-452c-a5d5-033013e9a310 tempest-VolumeDependencyTests-83919300 None] Lock "cinder-quobyte-fb9985c5-0f9d-4cae-b37d-a40451610be2" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:41:05 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-6f2113ad-f339-452c-a5d5-033013e9a310 tempest-VolumeDependencyTests-83919300 None] snapshot: 3e186b4a-9bd8-4209-ae98-dd2c950830b3, volume: fb9985c5-0f9d-4cae-b37d-a40451610be2, {{(pid=87132) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 06 15:41:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6f2113ad-f339-452c-a5d5-033013e9a310 tempest-VolumeDependencyTests-83919300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:41:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6f2113ad-f339-452c-a5d5-033013e9a310 tempest-VolumeDependencyTests-83919300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:41:05 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-6f2113ad-f339-452c-a5d5-033013e9a310 tempest-VolumeDependencyTests-83919300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:41:05 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-6f2113ad-f339-452c-a5d5-033013e9a310 tempest-VolumeDependencyTests-83919300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:41:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6f2113ad-f339-452c-a5d5-033013e9a310 tempest-VolumeDependencyTests-83919300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:41:05 devstack sudo[107327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_262fed89-7121-4586-83c3-b8af290b8def_qcvqcqkodevstack@QuobyteHD Nov 06 15:41:05 devstack sudo[107327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:05 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2d72b5a-b80c-4c21-ab1c-fbb6e203309b]: (4, 'raw') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:41:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-dbb8fa18-fa8a-4a59-9000-de88fd4ff481 tempest-VolumeAndVolumeTypeFromImageTest-353123403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e72de57d-d8ff-4afa-aa0d-2fcc97e3d166_fup9j0uh {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:05 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6519bf1-9c81-4e90-beb3-e6b11cf1be35]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:41:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6f2113ad-f339-452c-a5d5-033013e9a310 tempest-VolumeDependencyTests-83919300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-3a12aff2-b559-4779-a8d4-0de3527dfee1.3e186b4a-9bd8-4209-ae98-dd2c950830b3 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:06 devstack sudo[107331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e72de57d-d8ff-4afa-aa0d-2fcc97e3d166_fup9j0uh Nov 06 15:41:06 devstack sudo[107331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:06 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb49be2b-a058-4a96-826c-c9c2d6804af5 tempest-CreateVolumesFromSnapshotTest-597264870 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:41:06 devstack sudo[107332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-3a12aff2-b559-4779-a8d4-0de3527dfee1.3e186b4a-9bd8-4209-ae98-dd2c950830b3 Nov 06 15:41:06 devstack sudo[107332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-eb49be2b-a058-4a96-826c-c9c2d6804af5 tempest-CreateVolumesFromSnapshotTest-597264870 None] Flow 'volume_create_manager' (e9232926-d20a-4912-8fe4-9879cc8b9c3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:41:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-eb49be2b-a058-4a96-826c-c9c2d6804af5 tempest-CreateVolumesFromSnapshotTest-597264870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fd93a7f-5dca-45ff-97a3-0f0beec7dd9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:06 devstack sudo[107327]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-eb49be2b-a058-4a96-826c-c9c2d6804af5 tempest-CreateVolumesFromSnapshotTest-597264870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fd93a7f-5dca-45ff-97a3-0f0beec7dd9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:41:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1936694889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1926635-b302-4c66-bd42-9b1cbaafe041,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1dd1416ca4b4ab78091d45ca8782b28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:41:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:41:06Z,use_quota=True,user_id='f0c1841ac23c45f4921295e6a25d28f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-eb49be2b-a058-4a96-826c-c9c2d6804af5 tempest-CreateVolumesFromSnapshotTest-597264870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bd64934-d292-42b3-88da-31700f14f4be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-eb49be2b-a058-4a96-826c-c9c2d6804af5 tempest-CreateVolumesFromSnapshotTest-597264870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bd64934-d292-42b3-88da-31700f14f4be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-eb49be2b-a058-4a96-826c-c9c2d6804af5 tempest-CreateVolumesFromSnapshotTest-597264870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad804632-c55a-46e9-8c2a-0df4c9a6536f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-eb49be2b-a058-4a96-826c-c9c2d6804af5 tempest-CreateVolumesFromSnapshotTest-597264870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad804632-c55a-46e9-8c2a-0df4c9a6536f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1926635-b302-4c66-bd42-9b1cbaafe041', 'volume_name': 'volume-e1926635-b302-4c66-bd42-9b1cbaafe041', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-eb49be2b-a058-4a96-826c-c9c2d6804af5 tempest-CreateVolumesFromSnapshotTest-597264870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1a9fc78-103c-4a33-93ed-8c1fc2c151f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-eb49be2b-a058-4a96-826c-c9c2d6804af5 tempest-CreateVolumesFromSnapshotTest-597264870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1a9fc78-103c-4a33-93ed-8c1fc2c151f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-eb49be2b-a058-4a96-826c-c9c2d6804af5 tempest-CreateVolumesFromSnapshotTest-597264870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8155f864-7fff-4dbf-8c79-07dbe6aa9f48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:06 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-eb49be2b-a058-4a96-826c-c9c2d6804af5 tempest-CreateVolumesFromSnapshotTest-597264870 None] Volume e1926635-b302-4c66-bd42-9b1cbaafe041: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1926635-b302-4c66-bd42-9b1cbaafe041', 'volume_size': 1} Nov 06 15:41:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-eb49be2b-a058-4a96-826c-c9c2d6804af5 tempest-CreateVolumesFromSnapshotTest-597264870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:41:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5b81eeed-4e02-428c-a570-ebca91a572f7 tempest-VolumeImageDependencyTests-1054771306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_262fed89-7121-4586-83c3-b8af290b8def_qcvqcqkodevstack@QuobyteHD" returned: 0 in 0.488s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5b81eeed-4e02-428c-a570-ebca91a572f7 tempest-VolumeImageDependencyTests-1054771306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_262fed89-7121-4586-83c3-b8af290b8def_qcvqcqkodevstack@QuobyteHD {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:06 devstack sudo[107331]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-dbb8fa18-fa8a-4a59-9000-de88fd4ff481 tempest-VolumeAndVolumeTypeFromImageTest-353123403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e72de57d-d8ff-4afa-aa0d-2fcc97e3d166_fup9j0uh" returned: 0 in 0.440s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-dbb8fa18-fa8a-4a59-9000-de88fd4ff481 tempest-VolumeAndVolumeTypeFromImageTest-353123403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e72de57d-d8ff-4afa-aa0d-2fcc97e3d166_fup9j0uh {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:06 devstack sudo[107337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_262fed89-7121-4586-83c3-b8af290b8def_qcvqcqkodevstack@QuobyteHD Nov 06 15:41:06 devstack sudo[107337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:06 devstack sudo[107340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e72de57d-d8ff-4afa-aa0d-2fcc97e3d166_fup9j0uh Nov 06 15:41:06 devstack sudo[107340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:06 devstack sudo[107332]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6f2113ad-f339-452c-a5d5-033013e9a310 tempest-VolumeDependencyTests-83919300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-3a12aff2-b559-4779-a8d4-0de3527dfee1.3e186b4a-9bd8-4209-ae98-dd2c950830b3" returned: 0 in 0.713s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:06 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-6f2113ad-f339-452c-a5d5-033013e9a310 tempest-VolumeDependencyTests-83919300 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3a12aff2-b559-4779-a8d4-0de3527dfee1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 15:41:06 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[2181e7ba-4936-404c-b870-a34e3edd74fa]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:41:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6f2113ad-f339-452c-a5d5-033013e9a310 tempest-VolumeDependencyTests-83919300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-3a12aff2-b559-4779-a8d4-0de3527dfee1 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:06 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-6997924f-5c5d-492b-8ebb-e1588babb584 tempest-CreateVolumesFromSnapshotTest-597264870 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:41:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6997924f-5c5d-492b-8ebb-e1588babb584 tempest-CreateVolumesFromSnapshotTest-597264870 None] Flow 'volume_create_manager' (78a1b833-b416-404e-9777-9a585d66dd08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:41:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6997924f-5c5d-492b-8ebb-e1588babb584 tempest-CreateVolumesFromSnapshotTest-597264870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfbd0e90-bef2-4e58-a794-ef70fc8b8650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:06 devstack sudo[107337]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5b81eeed-4e02-428c-a570-ebca91a572f7 tempest-VolumeImageDependencyTests-1054771306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_262fed89-7121-4586-83c3-b8af290b8def_qcvqcqkodevstack@QuobyteHD" returned: 1 in 0.520s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5b81eeed-4e02-428c-a570-ebca91a572f7 tempest-VolumeImageDependencyTests-1054771306 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_262fed89-7121-4586-83c3-b8af290b8def_qcvqcqkodevstack@QuobyteHD' failed. Not Retrying. {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 15:41:06 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-5b81eeed-4e02-428c-a570-ebca91a572f7 tempest-VolumeImageDependencyTests-1054771306 None] 262fed89-7121-4586-83c3-b8af290b8def was raw, converting to qcow2 {{(pid=87132) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 06 15:41:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5b81eeed-4e02-428c-a570-ebca91a572f7 tempest-VolumeImageDependencyTests-1054771306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_262fed89-7121-4586-83c3-b8af290b8def_qcvqcqkodevstack@QuobyteHD /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a9c0326b-e806-452a-afb0-e3633624bab6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6997924f-5c5d-492b-8ebb-e1588babb584 tempest-CreateVolumesFromSnapshotTest-597264870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfbd0e90-bef2-4e58-a794-ef70fc8b8650) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:41:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1148027414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0918bd2-734a-419a-a15d-262b6c34503d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1dd1416ca4b4ab78091d45ca8782b28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:41:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:41:07Z,use_quota=True,user_id='f0c1841ac23c45f4921295e6a25d28f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6997924f-5c5d-492b-8ebb-e1588babb584 tempest-CreateVolumesFromSnapshotTest-597264870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c016ab38-5db1-4b39-adba-0b8f05234cc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6997924f-5c5d-492b-8ebb-e1588babb584 tempest-CreateVolumesFromSnapshotTest-597264870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c016ab38-5db1-4b39-adba-0b8f05234cc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6997924f-5c5d-492b-8ebb-e1588babb584 tempest-CreateVolumesFromSnapshotTest-597264870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (879e0e86-15e7-4d48-ab0f-b5778a9f8c9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6997924f-5c5d-492b-8ebb-e1588babb584 tempest-CreateVolumesFromSnapshotTest-597264870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (879e0e86-15e7-4d48-ab0f-b5778a9f8c9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0918bd2-734a-419a-a15d-262b6c34503d', 'volume_name': 'volume-d0918bd2-734a-419a-a15d-262b6c34503d', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:06 devstack sudo[107352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_262fed89-7121-4586-83c3-b8af290b8def_qcvqcqkodevstack@QuobyteHD /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a9c0326b-e806-452a-afb0-e3633624bab6 Nov 06 15:41:06 devstack sudo[107352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6997924f-5c5d-492b-8ebb-e1588babb584 tempest-CreateVolumesFromSnapshotTest-597264870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b39403f4-e56d-4f16-906a-f84739ce2329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:06 devstack sudo[107348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-3a12aff2-b559-4779-a8d4-0de3527dfee1 Nov 06 15:41:06 devstack sudo[107348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6997924f-5c5d-492b-8ebb-e1588babb584 tempest-CreateVolumesFromSnapshotTest-597264870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b39403f4-e56d-4f16-906a-f84739ce2329) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6997924f-5c5d-492b-8ebb-e1588babb584 tempest-CreateVolumesFromSnapshotTest-597264870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8a85473-df9e-4944-b7c4-072992ad5337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:06 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-6997924f-5c5d-492b-8ebb-e1588babb584 tempest-CreateVolumesFromSnapshotTest-597264870 None] Volume d0918bd2-734a-419a-a15d-262b6c34503d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0918bd2-734a-419a-a15d-262b6c34503d', 'volume_size': 1} Nov 06 15:41:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6997924f-5c5d-492b-8ebb-e1588babb584 tempest-CreateVolumesFromSnapshotTest-597264870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:41:06 devstack sudo[107340]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-dbb8fa18-fa8a-4a59-9000-de88fd4ff481 tempest-VolumeAndVolumeTypeFromImageTest-353123403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e72de57d-d8ff-4afa-aa0d-2fcc97e3d166_fup9j0uh" returned: 1 in 0.527s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-dbb8fa18-fa8a-4a59-9000-de88fd4ff481 tempest-VolumeAndVolumeTypeFromImageTest-353123403 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e72de57d-d8ff-4afa-aa0d-2fcc97e3d166_fup9j0uh' failed. Not Retrying. {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 15:41:06 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[75a6c104-1d8c-4278-b612-45e44e722ca8]: (4, 'raw') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:41:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-dbb8fa18-fa8a-4a59-9000-de88fd4ff481 tempest-VolumeAndVolumeTypeFromImageTest-353123403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e72de57d-d8ff-4afa-aa0d-2fcc97e3d166_shpwllmcdevstack@QuobyteHD {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:06 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-70c82618-3ba3-4345-baab-efb51da23eb1 tempest-CreateVolumesFromSnapshotTest-597264870 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:41:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-70c82618-3ba3-4345-baab-efb51da23eb1 tempest-CreateVolumesFromSnapshotTest-597264870 None] Flow 'volume_create_manager' (ba01913e-d76f-49e4-9244-cc19bd6fe6e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:41:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-70c82618-3ba3-4345-baab-efb51da23eb1 tempest-CreateVolumesFromSnapshotTest-597264870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39f3dc2a-b12b-4895-98e0-bd23dcf307c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-70c82618-3ba3-4345-baab-efb51da23eb1 tempest-CreateVolumesFromSnapshotTest-597264870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39f3dc2a-b12b-4895-98e0-bd23dcf307c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:41:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2101454480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5894ed60-f8d1-4af2-ad04-c9cf96bcfff9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1dd1416ca4b4ab78091d45ca8782b28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:41:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:41:07Z,use_quota=True,user_id='f0c1841ac23c45f4921295e6a25d28f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:07 devstack sudo[107357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e72de57d-d8ff-4afa-aa0d-2fcc97e3d166_shpwllmcdevstack@QuobyteHD Nov 06 15:41:07 devstack sudo[107357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-70c82618-3ba3-4345-baab-efb51da23eb1 tempest-CreateVolumesFromSnapshotTest-597264870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93bfe7d3-ad17-4e21-882c-79d145a9b294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-70c82618-3ba3-4345-baab-efb51da23eb1 tempest-CreateVolumesFromSnapshotTest-597264870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93bfe7d3-ad17-4e21-882c-79d145a9b294) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-70c82618-3ba3-4345-baab-efb51da23eb1 tempest-CreateVolumesFromSnapshotTest-597264870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e298fff-1e27-481b-abcd-71d2443b1c82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-70c82618-3ba3-4345-baab-efb51da23eb1 tempest-CreateVolumesFromSnapshotTest-597264870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e298fff-1e27-481b-abcd-71d2443b1c82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5894ed60-f8d1-4af2-ad04-c9cf96bcfff9', 'volume_name': 'volume-5894ed60-f8d1-4af2-ad04-c9cf96bcfff9', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-70c82618-3ba3-4345-baab-efb51da23eb1 tempest-CreateVolumesFromSnapshotTest-597264870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c2a7250-9d96-44e5-8760-36b4f1da060d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-70c82618-3ba3-4345-baab-efb51da23eb1 tempest-CreateVolumesFromSnapshotTest-597264870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c2a7250-9d96-44e5-8760-36b4f1da060d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-70c82618-3ba3-4345-baab-efb51da23eb1 tempest-CreateVolumesFromSnapshotTest-597264870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4663c0e4-9a3d-42b8-9c91-28860889fb73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:07 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-70c82618-3ba3-4345-baab-efb51da23eb1 tempest-CreateVolumesFromSnapshotTest-597264870 None] Volume 5894ed60-f8d1-4af2-ad04-c9cf96bcfff9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5894ed60-f8d1-4af2-ad04-c9cf96bcfff9', 'volume_size': 1} Nov 06 15:41:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-70c82618-3ba3-4345-baab-efb51da23eb1 tempest-CreateVolumesFromSnapshotTest-597264870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:41:07 devstack sudo[107348]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6f2113ad-f339-452c-a5d5-033013e9a310 tempest-VolumeDependencyTests-83919300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-3a12aff2-b559-4779-a8d4-0de3527dfee1" returned: 0 in 0.491s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:07 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-6f2113ad-f339-452c-a5d5-033013e9a310 tempest-VolumeDependencyTests-83919300 None] will copy from snapshot at /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-3a12aff2-b559-4779-a8d4-0de3527dfee1 {{(pid=87132) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 06 15:41:07 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-6f2113ad-f339-452c-a5d5-033013e9a310 tempest-VolumeDependencyTests-83919300 None] Creating direct copy from snapshot {{(pid=87132) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 06 15:41:07 devstack cinder-volume[87132]: DEBUG cinder.utils [None req-6f2113ad-f339-452c-a5d5-033013e9a310 tempest-VolumeDependencyTests-83919300 None] Path /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-fb9985c5-0f9d-4cae-b37d-a40451610be2 not found in is_blk_device check {{(pid=87132) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 06 15:41:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6f2113ad-f339-452c-a5d5-033013e9a310 tempest-VolumeDependencyTests-83919300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-3a12aff2-b559-4779-a8d4-0de3527dfee1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-fb9985c5-0f9d-4cae-b37d-a40451610be2 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:07 devstack sudo[107366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-3a12aff2-b559-4779-a8d4-0de3527dfee1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-fb9985c5-0f9d-4cae-b37d-a40451610be2 Nov 06 15:41:07 devstack sudo[107366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:07 devstack sudo[107357]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-dbb8fa18-fa8a-4a59-9000-de88fd4ff481 tempest-VolumeAndVolumeTypeFromImageTest-353123403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e72de57d-d8ff-4afa-aa0d-2fcc97e3d166_shpwllmcdevstack@QuobyteHD" returned: 0 in 0.421s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-dbb8fa18-fa8a-4a59-9000-de88fd4ff481 tempest-VolumeAndVolumeTypeFromImageTest-353123403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e72de57d-d8ff-4afa-aa0d-2fcc97e3d166_shpwllmcdevstack@QuobyteHD {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:07 devstack sudo[107352]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5b81eeed-4e02-428c-a570-ebca91a572f7 tempest-VolumeImageDependencyTests-1054771306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_262fed89-7121-4586-83c3-b8af290b8def_qcvqcqkodevstack@QuobyteHD /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a9c0326b-e806-452a-afb0-e3633624bab6" returned: 0 in 0.568s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:07 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-5b81eeed-4e02-428c-a570-ebca91a572f7 tempest-VolumeImageDependencyTests-1054771306 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_262fed89-7121-4586-83c3-b8af290b8def_qcvqcqkodevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a9c0326b-e806-452a-afb0-e3633624bab6 {{(pid=87132) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 06 15:41:07 devstack cinder-volume[87132]: INFO cinder.image.image_utils [None req-5b81eeed-4e02-428c-a570-ebca91a572f7 tempest-VolumeImageDependencyTests-1054771306 None] Converted 0.00 MB image at 0.00 MB/s Nov 06 15:41:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5b81eeed-4e02-428c-a570-ebca91a572f7 tempest-VolumeImageDependencyTests-1054771306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a9c0326b-e806-452a-afb0-e3633624bab6 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:07 devstack sudo[107372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a9c0326b-e806-452a-afb0-e3633624bab6 1G Nov 06 15:41:07 devstack sudo[107372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:07 devstack sudo[107371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e72de57d-d8ff-4afa-aa0d-2fcc97e3d166_shpwllmcdevstack@QuobyteHD Nov 06 15:41:07 devstack sudo[107371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:07 devstack sudo[107371]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-dbb8fa18-fa8a-4a59-9000-de88fd4ff481 tempest-VolumeAndVolumeTypeFromImageTest-353123403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e72de57d-d8ff-4afa-aa0d-2fcc97e3d166_shpwllmcdevstack@QuobyteHD" returned: 1 in 0.379s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-dbb8fa18-fa8a-4a59-9000-de88fd4ff481 tempest-VolumeAndVolumeTypeFromImageTest-353123403 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e72de57d-d8ff-4afa-aa0d-2fcc97e3d166_shpwllmcdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 15:41:07 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-dbb8fa18-fa8a-4a59-9000-de88fd4ff481 tempest-VolumeAndVolumeTypeFromImageTest-353123403 None] e72de57d-d8ff-4afa-aa0d-2fcc97e3d166 was raw, converting to qcow2 {{(pid=87132) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 06 15:41:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-dbb8fa18-fa8a-4a59-9000-de88fd4ff481 tempest-VolumeAndVolumeTypeFromImageTest-353123403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e72de57d-d8ff-4afa-aa0d-2fcc97e3d166_shpwllmcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-951cf559-4799-4995-8ef3-f05b4538fb47 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:07 devstack sudo[107372]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5b81eeed-4e02-428c-a570-ebca91a572f7 tempest-VolumeImageDependencyTests-1054771306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a9c0326b-e806-452a-afb0-e3633624bab6 1G" returned: 0 in 0.378s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:07 devstack cinder-volume[87132]: DEBUG cinder.volume.volume_utils [None req-5b81eeed-4e02-428c-a570-ebca91a572f7 tempest-VolumeImageDependencyTests-1054771306 None] Downloaded image 262fed89-7121-4586-83c3-b8af290b8def ((None, [{'url': 'file:///opt/stack/data/glance/images/262fed89-7121-4586-83c3-b8af290b8def', 'metadata': {}}])) to volume a9c0326b-e806-452a-afb0-e3633624bab6 successfully. {{(pid=87132) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 06 15:41:07 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-5b81eeed-4e02-428c-a570-ebca91a572f7 tempest-VolumeImageDependencyTests-1054771306 None] Temporary image 262fed89-7121-4586-83c3-b8af290b8def for user 2900c01330d84738968aa0842df5732f is deleted. {{(pid=87132) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 06 15:41:07 devstack cinder-volume[87132]: DEBUG cinder.volume.volume_utils [None req-5b81eeed-4e02-428c-a570-ebca91a572f7 tempest-VolumeImageDependencyTests-1054771306 None] Marking volume a9c0326b-e806-452a-afb0-e3633624bab6 as bootable. {{(pid=87132) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 06 15:41:07 devstack sudo[107388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e72de57d-d8ff-4afa-aa0d-2fcc97e3d166_shpwllmcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-951cf559-4799-4995-8ef3-f05b4538fb47 Nov 06 15:41:07 devstack sudo[107388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:07 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b81eeed-4e02-428c-a570-ebca91a572f7 tempest-VolumeImageDependencyTests-1054771306 None] Copying metadata from image 262fed89-7121-4586-83c3-b8af290b8def to a9c0326b-e806-452a-afb0-e3633624bab6. {{(pid=87132) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 06 15:41:07 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b81eeed-4e02-428c-a570-ebca91a572f7 tempest-VolumeImageDependencyTests-1054771306 None] Creating volume glance metadata for volume a9c0326b-e806-452a-afb0-e3633624bab6 backed by image 262fed89-7121-4586-83c3-b8af290b8def with: {'image_id': '262fed89-7121-4586-83c3-b8af290b8def', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '051f492a8e058acca6e84a58285a9092', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87132) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 06 15:41:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5b81eeed-4e02-428c-a570-ebca91a572f7 tempest-VolumeImageDependencyTests-1054771306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d98580f0-7179-4249-901d-3c78d70ba8a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9c0326b-e806-452a-afb0-e3633624bab6', 'volume_size': 1, 'image_id': '262fed89-7121-4586-83c3-b8af290b8def', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/262fed89-7121-4586-83c3-b8af290b8def', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '051f492a8e058acca6e84a58285a9092', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ccf384ce881147f3ac7a02f125d3644b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4035387db6077b26bee3f25557ab3b0b3b837e1dd8fc73615ce99cc12670a9f5eecd7ea58d9f4cc410dfb9727ef5835cc19593bd9982ac9040958a3b7ac5fd08', 'id': '262fed89-7121-4586-83c3-b8af290b8def', 'created_at': datetime.datetime(2026, 11, 6, 14, 40, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 14, 40, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/262fed89-7121-4586-83c3-b8af290b8def/file', 'properties': {}}, 'image_service': }' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5b81eeed-4e02-428c-a570-ebca91a572f7 tempest-VolumeImageDependencyTests-1054771306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9c84430-ead0-4e28-9cbd-354144df7e68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:07 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-5b81eeed-4e02-428c-a570-ebca91a572f7 tempest-VolumeImageDependencyTests-1054771306 None] Volume volume-a9c0326b-e806-452a-afb0-e3633624bab6 (a9c0326b-e806-452a-afb0-e3633624bab6): created successfully Nov 06 15:41:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5b81eeed-4e02-428c-a570-ebca91a572f7 tempest-VolumeImageDependencyTests-1054771306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9c84430-ead0-4e28-9cbd-354144df7e68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5b81eeed-4e02-428c-a570-ebca91a572f7 tempest-VolumeImageDependencyTests-1054771306 None] Flow 'volume_create_manager' (1ee720b9-85df-447a-b6a7-62d9ac598d77) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:41:08 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-5b81eeed-4e02-428c-a570-ebca91a572f7 tempest-VolumeImageDependencyTests-1054771306 None] Created volume successfully. Nov 06 15:41:08 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 15:41:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:41:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:41:08 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:41:08 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:41:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:41:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:08 devstack sudo[107397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:41:08 devstack sudo[107397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:08 devstack sudo[107397]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.442s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:08 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:41:08 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Running periodic task VolumeManager._thread_info {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 15:41:08 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] thread count: 28 {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 15:41:08 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] thread info: [<_MainThread(MainThread, started 140011251929216)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 06 15:41:08 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-50240c17-2d8f-43c8-82cd-c25d6143afac tempest-VolumeImageDependencyTests-1054771306 None] Acquiring lock "cinder-a9c0326b-e806-452a-afb0-e3633624bab6-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:41:08 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-50240c17-2d8f-43c8-82cd-c25d6143afac tempest-VolumeImageDependencyTests-1054771306 None] Lock "cinder-a9c0326b-e806-452a-afb0-e3633624bab6-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:41:08 devstack sudo[107388]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-dbb8fa18-fa8a-4a59-9000-de88fd4ff481 tempest-VolumeAndVolumeTypeFromImageTest-353123403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e72de57d-d8ff-4afa-aa0d-2fcc97e3d166_shpwllmcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-951cf559-4799-4995-8ef3-f05b4538fb47" returned: 0 in 1.076s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:08 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-dbb8fa18-fa8a-4a59-9000-de88fd4ff481 tempest-VolumeAndVolumeTypeFromImageTest-353123403 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e72de57d-d8ff-4afa-aa0d-2fcc97e3d166_shpwllmcdevstack@QuobyteHD, size 0.00 MB, duration 1.08 sec, destination /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-951cf559-4799-4995-8ef3-f05b4538fb47 {{(pid=87132) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 06 15:41:08 devstack cinder-volume[87132]: INFO cinder.image.image_utils [None req-dbb8fa18-fa8a-4a59-9000-de88fd4ff481 tempest-VolumeAndVolumeTypeFromImageTest-353123403 None] Converted 0.00 MB image at 0.00 MB/s Nov 06 15:41:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-dbb8fa18-fa8a-4a59-9000-de88fd4ff481 tempest-VolumeAndVolumeTypeFromImageTest-353123403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-951cf559-4799-4995-8ef3-f05b4538fb47 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:08 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-50240c17-2d8f-43c8-82cd-c25d6143afac tempest-VolumeImageDependencyTests-1054771306 None] Acquiring lock "cinder-quobyte-a9c0326b-e806-452a-afb0-e3633624bab6" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:41:08 devstack sudo[107402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-951cf559-4799-4995-8ef3-f05b4538fb47 1G Nov 06 15:41:08 devstack sudo[107402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:08 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-50240c17-2d8f-43c8-82cd-c25d6143afac tempest-VolumeImageDependencyTests-1054771306 None] Lock "cinder-quobyte-a9c0326b-e806-452a-afb0-e3633624bab6" acquired by "delete_volume" :: waited 0.035s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:41:08 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[90b2bbe9-07e0-4ffd-be5b-250b9c546d4f]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:41:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-50240c17-2d8f-43c8-82cd-c25d6143afac tempest-VolumeImageDependencyTests-1054771306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a9c0326b-e806-452a-afb0-e3633624bab6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:09 devstack sudo[107404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a9c0326b-e806-452a-afb0-e3633624bab6 Nov 06 15:41:09 devstack sudo[107404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:09 devstack sudo[107402]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-dbb8fa18-fa8a-4a59-9000-de88fd4ff481 tempest-VolumeAndVolumeTypeFromImageTest-353123403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-951cf559-4799-4995-8ef3-f05b4538fb47 1G" returned: 0 in 0.663s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:09 devstack cinder-volume[87132]: DEBUG cinder.volume.volume_utils [None req-dbb8fa18-fa8a-4a59-9000-de88fd4ff481 tempest-VolumeAndVolumeTypeFromImageTest-353123403 None] Downloaded image e72de57d-d8ff-4afa-aa0d-2fcc97e3d166 ((None, [{'url': 'file:///opt/stack/data/glance/images/e72de57d-d8ff-4afa-aa0d-2fcc97e3d166', 'metadata': {}}])) to volume 951cf559-4799-4995-8ef3-f05b4538fb47 successfully. {{(pid=87132) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 06 15:41:09 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-dbb8fa18-fa8a-4a59-9000-de88fd4ff481 tempest-VolumeAndVolumeTypeFromImageTest-353123403 None] Temporary image e72de57d-d8ff-4afa-aa0d-2fcc97e3d166 for user 056e15882f8c4b7590a480ac4812ce7f is deleted. {{(pid=87132) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 06 15:41:09 devstack cinder-volume[87132]: DEBUG cinder.volume.volume_utils [None req-dbb8fa18-fa8a-4a59-9000-de88fd4ff481 tempest-VolumeAndVolumeTypeFromImageTest-353123403 None] Marking volume 951cf559-4799-4995-8ef3-f05b4538fb47 as bootable. {{(pid=87132) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 06 15:41:09 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbb8fa18-fa8a-4a59-9000-de88fd4ff481 tempest-VolumeAndVolumeTypeFromImageTest-353123403 None] Copying metadata from image e72de57d-d8ff-4afa-aa0d-2fcc97e3d166 to 951cf559-4799-4995-8ef3-f05b4538fb47. {{(pid=87132) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 06 15:41:09 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbb8fa18-fa8a-4a59-9000-de88fd4ff481 tempest-VolumeAndVolumeTypeFromImageTest-353123403 None] Creating volume glance metadata for volume 951cf559-4799-4995-8ef3-f05b4538fb47 backed by image e72de57d-d8ff-4afa-aa0d-2fcc97e3d166 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'e72de57d-d8ff-4afa-aa0d-2fcc97e3d166', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '8f3cc8921de37083f9932d8a118497ad', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87132) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 06 15:41:09 devstack sudo[107404]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-50240c17-2d8f-43c8-82cd-c25d6143afac tempest-VolumeImageDependencyTests-1054771306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a9c0326b-e806-452a-afb0-e3633624bab6" returned: 0 in 0.580s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-50240c17-2d8f-43c8-82cd-c25d6143afac tempest-VolumeImageDependencyTests-1054771306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a9c0326b-e806-452a-afb0-e3633624bab6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:09 devstack sudo[107413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a9c0326b-e806-452a-afb0-e3633624bab6 Nov 06 15:41:09 devstack sudo[107413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:09 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-dbb8fa18-fa8a-4a59-9000-de88fd4ff481 tempest-VolumeAndVolumeTypeFromImageTest-353123403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8982788-40f6-4a7c-af1a-3fa9ff32bcad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-951cf559-4799-4995-8ef3-f05b4538fb47', 'volume_size': 1, 'image_id': 'e72de57d-d8ff-4afa-aa0d-2fcc97e3d166', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e72de57d-d8ff-4afa-aa0d-2fcc97e3d166', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8f3cc8921de37083f9932d8a118497ad', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '98a8e245da0b4412bcb382149b277930', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3cfef1c71700c4af9f95fc6a9544a8fc125e25e926acaaebc45f3b51a853d35022130ac3b0ed2fccc4a94be10e1c92f7e20df3c81671a93097daa6e815a93966', 'id': 'e72de57d-d8ff-4afa-aa0d-2fcc97e3d166', 'created_at': datetime.datetime(2026, 11, 6, 14, 40, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 14, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e72de57d-d8ff-4afa-aa0d-2fcc97e3d166/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:09 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-dbb8fa18-fa8a-4a59-9000-de88fd4ff481 tempest-VolumeAndVolumeTypeFromImageTest-353123403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cceee51-fa98-46dc-92d0-ab2816633ed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:09 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-dbb8fa18-fa8a-4a59-9000-de88fd4ff481 tempest-VolumeAndVolumeTypeFromImageTest-353123403 None] Volume volume-951cf559-4799-4995-8ef3-f05b4538fb47 (951cf559-4799-4995-8ef3-f05b4538fb47): created successfully Nov 06 15:41:09 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-dbb8fa18-fa8a-4a59-9000-de88fd4ff481 tempest-VolumeAndVolumeTypeFromImageTest-353123403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cceee51-fa98-46dc-92d0-ab2816633ed1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:09 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-dbb8fa18-fa8a-4a59-9000-de88fd4ff481 tempest-VolumeAndVolumeTypeFromImageTest-353123403 None] Flow 'volume_create_manager' (99b903d4-cca7-43eb-a6b3-84595d661f87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:41:09 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-dbb8fa18-fa8a-4a59-9000-de88fd4ff481 tempest-VolumeAndVolumeTypeFromImageTest-353123403 None] Created volume successfully. Nov 06 15:41:09 devstack sudo[107413]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-50240c17-2d8f-43c8-82cd-c25d6143afac tempest-VolumeImageDependencyTests-1054771306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a9c0326b-e806-452a-afb0-e3633624bab6" returned: 0 in 0.438s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:09 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-50240c17-2d8f-43c8-82cd-c25d6143afac tempest-VolumeImageDependencyTests-1054771306 None] Lock "cinder-quobyte-a9c0326b-e806-452a-afb0-e3633624bab6" released by "delete_volume" :: held 1.109s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:41:10 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-50240c17-2d8f-43c8-82cd-c25d6143afac tempest-VolumeImageDependencyTests-1054771306 None] Created reservations ['6539c205-213c-471b-b64f-cc3e6f1e3065', '8a5b9002-165c-4fe7-a65a-ba851f8cb8cd', 'd9e52099-436a-48f9-b0e3-b6a0f21e79e8', 'd193b8cd-299d-47f7-aca6-4e690385c843'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:41:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-50240c17-2d8f-43c8-82cd-c25d6143afac tempest-VolumeImageDependencyTests-1054771306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:41:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-50240c17-2d8f-43c8-82cd-c25d6143afac tempest-VolumeImageDependencyTests-1054771306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:41:10 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-50240c17-2d8f-43c8-82cd-c25d6143afac tempest-VolumeImageDependencyTests-1054771306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:41:10 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-50240c17-2d8f-43c8-82cd-c25d6143afac tempest-VolumeImageDependencyTests-1054771306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:41:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-50240c17-2d8f-43c8-82cd-c25d6143afac tempest-VolumeImageDependencyTests-1054771306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:41:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-50240c17-2d8f-43c8-82cd-c25d6143afac tempest-VolumeImageDependencyTests-1054771306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:10 devstack sudo[107416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:41:10 devstack sudo[107416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:10 devstack sudo[107416]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-50240c17-2d8f-43c8-82cd-c25d6143afac tempest-VolumeImageDependencyTests-1054771306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.321s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:10 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-50240c17-2d8f-43c8-82cd-c25d6143afac tempest-VolumeImageDependencyTests-1054771306 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:41:10 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-50240c17-2d8f-43c8-82cd-c25d6143afac tempest-VolumeImageDependencyTests-1054771306 None] Deleted volume successfully. Nov 06 15:41:10 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-50240c17-2d8f-43c8-82cd-c25d6143afac tempest-VolumeImageDependencyTests-1054771306 None] Lock "cinder-a9c0326b-e806-452a-afb0-e3633624bab6-delete_volume" released by "delete_volume" :: held 1.845s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:41:10 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-1b5cc8e0-38fe-401b-ac54-2f6796d733cd tempest-VolumeAndVolumeTypeFromImageTest-353123403 None] Acquiring lock "cinder-951cf559-4799-4995-8ef3-f05b4538fb47-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:41:11 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-1b5cc8e0-38fe-401b-ac54-2f6796d733cd tempest-VolumeAndVolumeTypeFromImageTest-353123403 None] Lock "cinder-951cf559-4799-4995-8ef3-f05b4538fb47-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:41:11 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-1b5cc8e0-38fe-401b-ac54-2f6796d733cd tempest-VolumeAndVolumeTypeFromImageTest-353123403 None] Acquiring lock "cinder-quobyte-951cf559-4799-4995-8ef3-f05b4538fb47" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:41:11 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-1b5cc8e0-38fe-401b-ac54-2f6796d733cd tempest-VolumeAndVolumeTypeFromImageTest-353123403 None] Lock "cinder-quobyte-951cf559-4799-4995-8ef3-f05b4538fb47" acquired by "delete_volume" :: waited 0.029s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:41:11 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[24c8cbad-c149-4a08-a77f-b22c17c6577c]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:41:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1b5cc8e0-38fe-401b-ac54-2f6796d733cd tempest-VolumeAndVolumeTypeFromImageTest-353123403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-951cf559-4799-4995-8ef3-f05b4538fb47 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:11 devstack sudo[107420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-951cf559-4799-4995-8ef3-f05b4538fb47 Nov 06 15:41:11 devstack sudo[107420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:12 devstack sudo[107420]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1b5cc8e0-38fe-401b-ac54-2f6796d733cd tempest-VolumeAndVolumeTypeFromImageTest-353123403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-951cf559-4799-4995-8ef3-f05b4538fb47" returned: 0 in 0.925s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1b5cc8e0-38fe-401b-ac54-2f6796d733cd tempest-VolumeAndVolumeTypeFromImageTest-353123403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-951cf559-4799-4995-8ef3-f05b4538fb47 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:12 devstack sudo[107425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-951cf559-4799-4995-8ef3-f05b4538fb47 Nov 06 15:41:12 devstack sudo[107425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:12 devstack sudo[107425]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1b5cc8e0-38fe-401b-ac54-2f6796d733cd tempest-VolumeAndVolumeTypeFromImageTest-353123403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-951cf559-4799-4995-8ef3-f05b4538fb47" returned: 0 in 0.379s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:12 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-1b5cc8e0-38fe-401b-ac54-2f6796d733cd tempest-VolumeAndVolumeTypeFromImageTest-353123403 None] Lock "cinder-quobyte-951cf559-4799-4995-8ef3-f05b4538fb47" released by "delete_volume" :: held 1.413s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:41:12 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-1b5cc8e0-38fe-401b-ac54-2f6796d733cd tempest-VolumeAndVolumeTypeFromImageTest-353123403 None] Created reservations ['60decaf6-4820-4758-85a7-17b89ee9e072', '88a03d97-db70-405d-89ee-17fe5be8c782', '1d6b2a98-49fa-41d9-ba85-067f68a261db', '02ace35d-1c6f-4452-8ad9-3cdfe8a16b0c'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:41:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1b5cc8e0-38fe-401b-ac54-2f6796d733cd tempest-VolumeAndVolumeTypeFromImageTest-353123403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:41:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1b5cc8e0-38fe-401b-ac54-2f6796d733cd tempest-VolumeAndVolumeTypeFromImageTest-353123403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:41:12 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1b5cc8e0-38fe-401b-ac54-2f6796d733cd tempest-VolumeAndVolumeTypeFromImageTest-353123403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:41:12 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1b5cc8e0-38fe-401b-ac54-2f6796d733cd tempest-VolumeAndVolumeTypeFromImageTest-353123403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:41:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1b5cc8e0-38fe-401b-ac54-2f6796d733cd tempest-VolumeAndVolumeTypeFromImageTest-353123403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:41:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1b5cc8e0-38fe-401b-ac54-2f6796d733cd tempest-VolumeAndVolumeTypeFromImageTest-353123403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:12 devstack sudo[107428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:41:12 devstack sudo[107428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:13 devstack sudo[107428]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1b5cc8e0-38fe-401b-ac54-2f6796d733cd tempest-VolumeAndVolumeTypeFromImageTest-353123403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.536s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:13 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-1b5cc8e0-38fe-401b-ac54-2f6796d733cd tempest-VolumeAndVolumeTypeFromImageTest-353123403 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:41:13 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-1b5cc8e0-38fe-401b-ac54-2f6796d733cd tempest-VolumeAndVolumeTypeFromImageTest-353123403 None] Deleted volume successfully. Nov 06 15:41:13 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-1b5cc8e0-38fe-401b-ac54-2f6796d733cd tempest-VolumeAndVolumeTypeFromImageTest-353123403 None] Lock "cinder-951cf559-4799-4995-8ef3-f05b4538fb47-delete_volume" released by "delete_volume" :: held 2.397s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:41:15 devstack sudo[107366]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6f2113ad-f339-452c-a5d5-033013e9a310 tempest-VolumeDependencyTests-83919300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-3a12aff2-b559-4779-a8d4-0de3527dfee1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-fb9985c5-0f9d-4cae-b37d-a40451610be2" returned: 0 in 8.333s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:15 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-6f2113ad-f339-452c-a5d5-033013e9a310 tempest-VolumeDependencyTests-83919300 None] Image conversion details: src /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-3a12aff2-b559-4779-a8d4-0de3527dfee1, size 1024.00 MB, duration 8.33 sec, destination /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-fb9985c5-0f9d-4cae-b37d-a40451610be2 {{(pid=87132) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 06 15:41:15 devstack cinder-volume[87132]: INFO cinder.image.image_utils [None req-6f2113ad-f339-452c-a5d5-033013e9a310 tempest-VolumeDependencyTests-83919300 None] Converted 1024.00 MB image at 122.87 MB/s Nov 06 15:41:15 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-6f2113ad-f339-452c-a5d5-033013e9a310 tempest-VolumeDependencyTests-83919300 None] /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-fb9985c5-0f9d-4cae-b37d-a40451610be2 is being set with open permissions: ugo+rw Nov 06 15:41:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6f2113ad-f339-452c-a5d5-033013e9a310 tempest-VolumeDependencyTests-83919300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-fb9985c5-0f9d-4cae-b37d-a40451610be2 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:15 devstack sudo[107432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-fb9985c5-0f9d-4cae-b37d-a40451610be2 Nov 06 15:41:15 devstack sudo[107432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:15 devstack sudo[107432]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6f2113ad-f339-452c-a5d5-033013e9a310 tempest-VolumeDependencyTests-83919300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-fb9985c5-0f9d-4cae-b37d-a40451610be2" returned: 0 in 0.268s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:15 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6f2113ad-f339-452c-a5d5-033013e9a310 tempest-VolumeDependencyTests-83919300 None] Lock "cinder-quobyte-fb9985c5-0f9d-4cae-b37d-a40451610be2" released by "_copy_volume_from_snapshot" :: held 9.959s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:41:15 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6f2113ad-f339-452c-a5d5-033013e9a310 tempest-VolumeDependencyTests-83919300 None] Lock "cinder-quobyte-3e186b4a-9bd8-4209-ae98-dd2c950830b3-fb9985c5-0f9d-4cae-b37d-a40451610be2" released by "_create_volume_from_snapshot" :: held 10.049s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:41:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6f2113ad-f339-452c-a5d5-033013e9a310 tempest-VolumeDependencyTests-83919300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.134s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:41:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-004747c6-f7d1-4c09-9ee4-b1aaec57550e tempest-CreateVolumesFromSnapshotTest-597264870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.487s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:41:15 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-004747c6-f7d1-4c09-9ee4-b1aaec57550e tempest-CreateVolumesFromSnapshotTest-597264870 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:41:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2062489378',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5843b160-6efd-4d5d-81e2-718ae1fb0e7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1dd1416ca4b4ab78091d45ca8782b28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:41:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:41:05Z,use_quota=True,user_id='f0c1841ac23c45f4921295e6a25d28f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:41:15 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-004747c6-f7d1-4c09-9ee4-b1aaec57550e tempest-CreateVolumesFromSnapshotTest-597264870 None] Creating volume 5843b160-6efd-4d5d-81e2-718ae1fb0e7d {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:41:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-004747c6-f7d1-4c09-9ee4-b1aaec57550e tempest-CreateVolumesFromSnapshotTest-597264870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:41:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-004747c6-f7d1-4c09-9ee4-b1aaec57550e tempest-CreateVolumesFromSnapshotTest-597264870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:41:15 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-004747c6-f7d1-4c09-9ee4-b1aaec57550e tempest-CreateVolumesFromSnapshotTest-597264870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:41:15 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-004747c6-f7d1-4c09-9ee4-b1aaec57550e tempest-CreateVolumesFromSnapshotTest-597264870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:41:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-004747c6-f7d1-4c09-9ee4-b1aaec57550e tempest-CreateVolumesFromSnapshotTest-597264870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:41:15 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-004747c6-f7d1-4c09-9ee4-b1aaec57550e tempest-CreateVolumesFromSnapshotTest-597264870 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:41:15 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-004747c6-f7d1-4c09-9ee4-b1aaec57550e tempest-CreateVolumesFromSnapshotTest-597264870 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:41:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-004747c6-f7d1-4c09-9ee4-b1aaec57550e tempest-CreateVolumesFromSnapshotTest-597264870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-5843b160-6efd-4d5d-81e2-718ae1fb0e7d 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6f2113ad-f339-452c-a5d5-033013e9a310 tempest-VolumeDependencyTests-83919300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bd2f7b5-8226-4be0-a717-08d8cd0044f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb9985c5-0f9d-4cae-b37d-a40451610be2', 'volume_size': 1, 'snapshot_id': '3e186b4a-9bd8-4209-ae98-dd2c950830b3'}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:15 devstack sudo[107436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-5843b160-6efd-4d5d-81e2-718ae1fb0e7d 1073741824 Nov 06 15:41:15 devstack sudo[107436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6f2113ad-f339-452c-a5d5-033013e9a310 tempest-VolumeDependencyTests-83919300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (daae563b-aa02-4045-b703-57f9d5f71f31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:15 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-6f2113ad-f339-452c-a5d5-033013e9a310 tempest-VolumeDependencyTests-83919300 None] Volume volume-fb9985c5-0f9d-4cae-b37d-a40451610be2 (fb9985c5-0f9d-4cae-b37d-a40451610be2): created successfully Nov 06 15:41:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6f2113ad-f339-452c-a5d5-033013e9a310 tempest-VolumeDependencyTests-83919300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (daae563b-aa02-4045-b703-57f9d5f71f31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6f2113ad-f339-452c-a5d5-033013e9a310 tempest-VolumeDependencyTests-83919300 None] Flow 'volume_create_manager' (5e1f4fda-54ac-4223-b2d5-fb2cfaf71520) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:41:15 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-6f2113ad-f339-452c-a5d5-033013e9a310 tempest-VolumeDependencyTests-83919300 None] Created volume successfully. Nov 06 15:41:16 devstack sudo[107436]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-004747c6-f7d1-4c09-9ee4-b1aaec57550e tempest-CreateVolumesFromSnapshotTest-597264870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-5843b160-6efd-4d5d-81e2-718ae1fb0e7d 1073741824" returned: 0 in 0.508s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-004747c6-f7d1-4c09-9ee4-b1aaec57550e tempest-CreateVolumesFromSnapshotTest-597264870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-5843b160-6efd-4d5d-81e2-718ae1fb0e7d {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:16 devstack sudo[107442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-5843b160-6efd-4d5d-81e2-718ae1fb0e7d Nov 06 15:41:16 devstack sudo[107442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:16 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-0e2991f1-ddf9-4bdd-81aa-db1ae440055c tempest-VolumeDependencyTests-83919300 None] Acquiring lock "cinder-3e186b4a-9bd8-4209-ae98-dd2c950830b3-delete_snapshot" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:41:16 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-0e2991f1-ddf9-4bdd-81aa-db1ae440055c tempest-VolumeDependencyTests-83919300 None] Lock "cinder-3e186b4a-9bd8-4209-ae98-dd2c950830b3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:41:16 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-0e2991f1-ddf9-4bdd-81aa-db1ae440055c tempest-VolumeDependencyTests-83919300 None] Acquiring lock "cinder-quobyte-3a12aff2-b559-4779-a8d4-0de3527dfee1" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:41:16 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-0e2991f1-ddf9-4bdd-81aa-db1ae440055c tempest-VolumeDependencyTests-83919300 None] Lock "cinder-quobyte-3a12aff2-b559-4779-a8d4-0de3527dfee1" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:41:16 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-0e2991f1-ddf9-4bdd-81aa-db1ae440055c tempest-VolumeDependencyTests-83919300 None] Acquiring lock "cinder-quobyte-3e186b4a-9bd8-4209-ae98-dd2c950830b3" by "_delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:41:16 devstack sudo[107442]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-004747c6-f7d1-4c09-9ee4-b1aaec57550e tempest-CreateVolumesFromSnapshotTest-597264870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-5843b160-6efd-4d5d-81e2-718ae1fb0e7d" returned: 0 in 0.345s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:16 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-004747c6-f7d1-4c09-9ee4-b1aaec57550e tempest-CreateVolumesFromSnapshotTest-597264870 None] <== create_volume: return (899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:41:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-004747c6-f7d1-4c09-9ee4-b1aaec57550e tempest-CreateVolumesFromSnapshotTest-597264870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.903s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:41:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1558f3e6-fc9c-40a6-ada8-ecc14c26c451 tempest-CreateVolumesFromSnapshotTest-597264870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.997s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:41:16 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1558f3e6-fc9c-40a6-ada8-ecc14c26c451 tempest-CreateVolumesFromSnapshotTest-597264870 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:41:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-710008126',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31a9eed7-eb24-4406-9bfd-3f203ef984c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1dd1416ca4b4ab78091d45ca8782b28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:41:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:41:06Z,use_quota=True,user_id='f0c1841ac23c45f4921295e6a25d28f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:41:16 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-1558f3e6-fc9c-40a6-ada8-ecc14c26c451 tempest-CreateVolumesFromSnapshotTest-597264870 None] Creating volume 31a9eed7-eb24-4406-9bfd-3f203ef984c1 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:41:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1558f3e6-fc9c-40a6-ada8-ecc14c26c451 tempest-CreateVolumesFromSnapshotTest-597264870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:41:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1558f3e6-fc9c-40a6-ada8-ecc14c26c451 tempest-CreateVolumesFromSnapshotTest-597264870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:41:16 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1558f3e6-fc9c-40a6-ada8-ecc14c26c451 tempest-CreateVolumesFromSnapshotTest-597264870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:41:16 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1558f3e6-fc9c-40a6-ada8-ecc14c26c451 tempest-CreateVolumesFromSnapshotTest-597264870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:41:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1558f3e6-fc9c-40a6-ada8-ecc14c26c451 tempest-CreateVolumesFromSnapshotTest-597264870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:41:16 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1558f3e6-fc9c-40a6-ada8-ecc14c26c451 tempest-CreateVolumesFromSnapshotTest-597264870 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:41:16 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-1558f3e6-fc9c-40a6-ada8-ecc14c26c451 tempest-CreateVolumesFromSnapshotTest-597264870 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:41:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1558f3e6-fc9c-40a6-ada8-ecc14c26c451 tempest-CreateVolumesFromSnapshotTest-597264870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-31a9eed7-eb24-4406-9bfd-3f203ef984c1 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:16 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-004747c6-f7d1-4c09-9ee4-b1aaec57550e tempest-CreateVolumesFromSnapshotTest-597264870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38aad2aa-290b-46ca-91f6-f995d41071af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5843b160-6efd-4d5d-81e2-718ae1fb0e7d', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:16 devstack sudo[107445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-31a9eed7-eb24-4406-9bfd-3f203ef984c1 1073741824 Nov 06 15:41:16 devstack sudo[107445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:16 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-004747c6-f7d1-4c09-9ee4-b1aaec57550e tempest-CreateVolumesFromSnapshotTest-597264870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8c24dac-8134-4f99-ba33-4f206d4c2eb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:16 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-0e2991f1-ddf9-4bdd-81aa-db1ae440055c tempest-VolumeDependencyTests-83919300 None] Lock "cinder-quobyte-3e186b4a-9bd8-4209-ae98-dd2c950830b3" acquired by "_delete_snapshot" :: waited 0.097s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:41:16 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-0e2991f1-ddf9-4bdd-81aa-db1ae440055c tempest-VolumeDependencyTests-83919300 None] Deleting offline snapshot 3e186b4a-9bd8-4209-ae98-dd2c950830b3 of volume 3a12aff2-b559-4779-a8d4-0de3527dfee1 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 15:41:16 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-0e2991f1-ddf9-4bdd-81aa-db1ae440055c tempest-VolumeDependencyTests-83919300 None] snapshot_file for this snap is: volume-3a12aff2-b559-4779-a8d4-0de3527dfee1.3e186b4a-9bd8-4209-ae98-dd2c950830b3 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 15:41:16 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5be9ef4-1656-4ca2-84d6-c591d6aa329b]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:41:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0e2991f1-ddf9-4bdd-81aa-db1ae440055c tempest-VolumeDependencyTests-83919300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-3a12aff2-b559-4779-a8d4-0de3527dfee1.3e186b4a-9bd8-4209-ae98-dd2c950830b3 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:16 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-004747c6-f7d1-4c09-9ee4-b1aaec57550e tempest-CreateVolumesFromSnapshotTest-597264870 None] Volume volume-5843b160-6efd-4d5d-81e2-718ae1fb0e7d (5843b160-6efd-4d5d-81e2-718ae1fb0e7d): created successfully Nov 06 15:41:16 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-004747c6-f7d1-4c09-9ee4-b1aaec57550e tempest-CreateVolumesFromSnapshotTest-597264870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8c24dac-8134-4f99-ba33-4f206d4c2eb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:16 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-004747c6-f7d1-4c09-9ee4-b1aaec57550e tempest-CreateVolumesFromSnapshotTest-597264870 None] Flow 'volume_create_manager' (0d38ae42-bf95-4818-a1de-0cfed176712e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:41:16 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-91db0e88-5750-4ddc-88af-ca3270d5e86f tempest-CinderUnicodeTest-485864985 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:41:16 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-91db0e88-5750-4ddc-88af-ca3270d5e86f tempest-CinderUnicodeTest-485864985 None] Flow 'volume_create_manager' (81e811de-e697-401a-a07a-c089455d2ccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:41:16 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-91db0e88-5750-4ddc-88af-ca3270d5e86f tempest-CinderUnicodeTest-485864985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3ec4d03-e847-4466-9921-fe744f6656bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:17 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-004747c6-f7d1-4c09-9ee4-b1aaec57550e tempest-CreateVolumesFromSnapshotTest-597264870 None] Created volume successfully. Nov 06 15:41:17 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-91db0e88-5750-4ddc-88af-ca3270d5e86f tempest-CinderUnicodeTest-485864985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3ec4d03-e847-4466-9921-fe744f6656bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:41:16Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ca746b7-2657-46c5-842c-b90bc7c46f21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cc93baf2a004ec0a4d22d1ec403e886',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:41:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:41:17Z,use_quota=True,user_id='064addf5f3734e1b980c2e32adfd8a1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:17 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-91db0e88-5750-4ddc-88af-ca3270d5e86f tempest-CinderUnicodeTest-485864985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (768d188e-c3fa-4415-ad07-1d397d8106e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:17 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-91db0e88-5750-4ddc-88af-ca3270d5e86f tempest-CinderUnicodeTest-485864985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (768d188e-c3fa-4415-ad07-1d397d8106e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:17 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-91db0e88-5750-4ddc-88af-ca3270d5e86f tempest-CinderUnicodeTest-485864985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d442d05c-f3ea-4e66-b461-9fea2ffed541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:17 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-91db0e88-5750-4ddc-88af-ca3270d5e86f tempest-CinderUnicodeTest-485864985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d442d05c-f3ea-4e66-b461-9fea2ffed541) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ca746b7-2657-46c5-842c-b90bc7c46f21', 'volume_name': 'volume-0ca746b7-2657-46c5-842c-b90bc7c46f21', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:17 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-91db0e88-5750-4ddc-88af-ca3270d5e86f tempest-CinderUnicodeTest-485864985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbad67e2-e36d-4421-bb1f-475e81e22b53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:17 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-91db0e88-5750-4ddc-88af-ca3270d5e86f tempest-CinderUnicodeTest-485864985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbad67e2-e36d-4421-bb1f-475e81e22b53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:17 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-91db0e88-5750-4ddc-88af-ca3270d5e86f tempest-CinderUnicodeTest-485864985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c06986e-6be9-4241-887a-d0c1d92292cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:17 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-91db0e88-5750-4ddc-88af-ca3270d5e86f tempest-CinderUnicodeTest-485864985 None] Volume 0ca746b7-2657-46c5-842c-b90bc7c46f21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ca746b7-2657-46c5-842c-b90bc7c46f21', 'volume_size': 1} Nov 06 15:41:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-91db0e88-5750-4ddc-88af-ca3270d5e86f tempest-CinderUnicodeTest-485864985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:41:17 devstack sudo[107447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-3a12aff2-b559-4779-a8d4-0de3527dfee1.3e186b4a-9bd8-4209-ae98-dd2c950830b3 Nov 06 15:41:17 devstack sudo[107447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:17 devstack sudo[107445]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1558f3e6-fc9c-40a6-ada8-ecc14c26c451 tempest-CreateVolumesFromSnapshotTest-597264870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-31a9eed7-eb24-4406-9bfd-3f203ef984c1 1073741824" returned: 0 in 0.637s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:17 devstack sudo[107447]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0e2991f1-ddf9-4bdd-81aa-db1ae440055c tempest-VolumeDependencyTests-83919300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-3a12aff2-b559-4779-a8d4-0de3527dfee1.3e186b4a-9bd8-4209-ae98-dd2c950830b3" returned: 0 in 0.517s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:17 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-0e2991f1-ddf9-4bdd-81aa-db1ae440055c tempest-VolumeDependencyTests-83919300 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3a12aff2-b559-4779-a8d4-0de3527dfee1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 15:41:17 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[55db4f5b-3480-43a4-bfe7-e878130f020e]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:41:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0e2991f1-ddf9-4bdd-81aa-db1ae440055c tempest-VolumeDependencyTests-83919300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-3a12aff2-b559-4779-a8d4-0de3527dfee1 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1558f3e6-fc9c-40a6-ada8-ecc14c26c451 tempest-CreateVolumesFromSnapshotTest-597264870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-31a9eed7-eb24-4406-9bfd-3f203ef984c1 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:17 devstack sudo[107457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-31a9eed7-eb24-4406-9bfd-3f203ef984c1 Nov 06 15:41:17 devstack sudo[107457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:17 devstack sudo[107456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-3a12aff2-b559-4779-a8d4-0de3527dfee1 Nov 06 15:41:17 devstack sudo[107456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:17 devstack sudo[107457]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1558f3e6-fc9c-40a6-ada8-ecc14c26c451 tempest-CreateVolumesFromSnapshotTest-597264870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-31a9eed7-eb24-4406-9bfd-3f203ef984c1" returned: 0 in 0.309s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:17 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1558f3e6-fc9c-40a6-ada8-ecc14c26c451 tempest-CreateVolumesFromSnapshotTest-597264870 None] <== create_volume: return (1030ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:41:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1558f3e6-fc9c-40a6-ada8-ecc14c26c451 tempest-CreateVolumesFromSnapshotTest-597264870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.033s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:41:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-eb49be2b-a058-4a96-826c-c9c2d6804af5 tempest-CreateVolumesFromSnapshotTest-597264870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.543s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:41:17 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-eb49be2b-a058-4a96-826c-c9c2d6804af5 tempest-CreateVolumesFromSnapshotTest-597264870 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:41:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1936694889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1926635-b302-4c66-bd42-9b1cbaafe041,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1dd1416ca4b4ab78091d45ca8782b28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:41:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:41:06Z,use_quota=True,user_id='f0c1841ac23c45f4921295e6a25d28f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:41:17 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-eb49be2b-a058-4a96-826c-c9c2d6804af5 tempest-CreateVolumesFromSnapshotTest-597264870 None] Creating volume e1926635-b302-4c66-bd42-9b1cbaafe041 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:41:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-eb49be2b-a058-4a96-826c-c9c2d6804af5 tempest-CreateVolumesFromSnapshotTest-597264870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:41:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-eb49be2b-a058-4a96-826c-c9c2d6804af5 tempest-CreateVolumesFromSnapshotTest-597264870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:41:17 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-eb49be2b-a058-4a96-826c-c9c2d6804af5 tempest-CreateVolumesFromSnapshotTest-597264870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:41:17 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-eb49be2b-a058-4a96-826c-c9c2d6804af5 tempest-CreateVolumesFromSnapshotTest-597264870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:41:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-eb49be2b-a058-4a96-826c-c9c2d6804af5 tempest-CreateVolumesFromSnapshotTest-597264870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:41:17 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-eb49be2b-a058-4a96-826c-c9c2d6804af5 tempest-CreateVolumesFromSnapshotTest-597264870 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:41:17 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-eb49be2b-a058-4a96-826c-c9c2d6804af5 tempest-CreateVolumesFromSnapshotTest-597264870 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:41:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-eb49be2b-a058-4a96-826c-c9c2d6804af5 tempest-CreateVolumesFromSnapshotTest-597264870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-e1926635-b302-4c66-bd42-9b1cbaafe041 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:17 devstack sudo[107463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-e1926635-b302-4c66-bd42-9b1cbaafe041 1073741824 Nov 06 15:41:17 devstack sudo[107463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:17 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1558f3e6-fc9c-40a6-ada8-ecc14c26c451 tempest-CreateVolumesFromSnapshotTest-597264870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62c26079-8173-4543-a2ef-c84ce12e2245) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31a9eed7-eb24-4406-9bfd-3f203ef984c1', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:17 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1558f3e6-fc9c-40a6-ada8-ecc14c26c451 tempest-CreateVolumesFromSnapshotTest-597264870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03086c4a-3199-4441-908f-f9ec4460774a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:17 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-1558f3e6-fc9c-40a6-ada8-ecc14c26c451 tempest-CreateVolumesFromSnapshotTest-597264870 None] Volume volume-31a9eed7-eb24-4406-9bfd-3f203ef984c1 (31a9eed7-eb24-4406-9bfd-3f203ef984c1): created successfully Nov 06 15:41:17 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1558f3e6-fc9c-40a6-ada8-ecc14c26c451 tempest-CreateVolumesFromSnapshotTest-597264870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03086c4a-3199-4441-908f-f9ec4460774a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:17 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1558f3e6-fc9c-40a6-ada8-ecc14c26c451 tempest-CreateVolumesFromSnapshotTest-597264870 None] Flow 'volume_create_manager' (0b461525-1cf8-4e4e-807d-352a85843d97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:41:17 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-1558f3e6-fc9c-40a6-ada8-ecc14c26c451 tempest-CreateVolumesFromSnapshotTest-597264870 None] Created volume successfully. Nov 06 15:41:18 devstack sudo[107456]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0e2991f1-ddf9-4bdd-81aa-db1ae440055c tempest-VolumeDependencyTests-83919300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-3a12aff2-b559-4779-a8d4-0de3527dfee1" returned: 0 in 0.612s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0e2991f1-ddf9-4bdd-81aa-db1ae440055c tempest-VolumeDependencyTests-83919300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-3a12aff2-b559-4779-a8d4-0de3527dfee1.3e186b4a-9bd8-4209-ae98-dd2c950830b3 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:18 devstack sudo[107469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-3a12aff2-b559-4779-a8d4-0de3527dfee1.3e186b4a-9bd8-4209-ae98-dd2c950830b3 Nov 06 15:41:18 devstack sudo[107469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:18 devstack sudo[107463]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-eb49be2b-a058-4a96-826c-c9c2d6804af5 tempest-CreateVolumesFromSnapshotTest-597264870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-e1926635-b302-4c66-bd42-9b1cbaafe041 1073741824" returned: 0 in 0.539s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-eb49be2b-a058-4a96-826c-c9c2d6804af5 tempest-CreateVolumesFromSnapshotTest-597264870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-e1926635-b302-4c66-bd42-9b1cbaafe041 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:18 devstack sudo[107476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-e1926635-b302-4c66-bd42-9b1cbaafe041 Nov 06 15:41:18 devstack sudo[107476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:18 devstack sudo[107469]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0e2991f1-ddf9-4bdd-81aa-db1ae440055c tempest-VolumeDependencyTests-83919300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-3a12aff2-b559-4779-a8d4-0de3527dfee1.3e186b4a-9bd8-4209-ae98-dd2c950830b3" returned: 0 in 0.379s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0e2991f1-ddf9-4bdd-81aa-db1ae440055c tempest-VolumeDependencyTests-83919300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-3a12aff2-b559-4779-a8d4-0de3527dfee1.3e186b4a-9bd8-4209-ae98-dd2c950830b3 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:18 devstack sudo[107478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-3a12aff2-b559-4779-a8d4-0de3527dfee1.3e186b4a-9bd8-4209-ae98-dd2c950830b3 Nov 06 15:41:18 devstack sudo[107478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:18 devstack sudo[107476]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-eb49be2b-a058-4a96-826c-c9c2d6804af5 tempest-CreateVolumesFromSnapshotTest-597264870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-e1926635-b302-4c66-bd42-9b1cbaafe041" returned: 0 in 0.263s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:18 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-eb49be2b-a058-4a96-826c-c9c2d6804af5 tempest-CreateVolumesFromSnapshotTest-597264870 None] <== create_volume: return (847ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:41:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-eb49be2b-a058-4a96-826c-c9c2d6804af5 tempest-CreateVolumesFromSnapshotTest-597264870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.855s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:41:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6997924f-5c5d-492b-8ebb-e1588babb584 tempest-CreateVolumesFromSnapshotTest-597264870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.789s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:41:18 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-6997924f-5c5d-492b-8ebb-e1588babb584 tempest-CreateVolumesFromSnapshotTest-597264870 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:41:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1148027414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0918bd2-734a-419a-a15d-262b6c34503d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1dd1416ca4b4ab78091d45ca8782b28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:41:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:41:07Z,use_quota=True,user_id='f0c1841ac23c45f4921295e6a25d28f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:41:18 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-6997924f-5c5d-492b-8ebb-e1588babb584 tempest-CreateVolumesFromSnapshotTest-597264870 None] Creating volume d0918bd2-734a-419a-a15d-262b6c34503d {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:41:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6997924f-5c5d-492b-8ebb-e1588babb584 tempest-CreateVolumesFromSnapshotTest-597264870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:41:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6997924f-5c5d-492b-8ebb-e1588babb584 tempest-CreateVolumesFromSnapshotTest-597264870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:41:18 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-6997924f-5c5d-492b-8ebb-e1588babb584 tempest-CreateVolumesFromSnapshotTest-597264870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:41:18 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-6997924f-5c5d-492b-8ebb-e1588babb584 tempest-CreateVolumesFromSnapshotTest-597264870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:41:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6997924f-5c5d-492b-8ebb-e1588babb584 tempest-CreateVolumesFromSnapshotTest-597264870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:41:18 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-6997924f-5c5d-492b-8ebb-e1588babb584 tempest-CreateVolumesFromSnapshotTest-597264870 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:41:18 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-6997924f-5c5d-492b-8ebb-e1588babb584 tempest-CreateVolumesFromSnapshotTest-597264870 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:41:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6997924f-5c5d-492b-8ebb-e1588babb584 tempest-CreateVolumesFromSnapshotTest-597264870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d0918bd2-734a-419a-a15d-262b6c34503d 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:18 devstack sudo[107482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d0918bd2-734a-419a-a15d-262b6c34503d 1073741824 Nov 06 15:41:18 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-eb49be2b-a058-4a96-826c-c9c2d6804af5 tempest-CreateVolumesFromSnapshotTest-597264870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8155f864-7fff-4dbf-8c79-07dbe6aa9f48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1926635-b302-4c66-bd42-9b1cbaafe041', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:18 devstack sudo[107482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:18 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-eb49be2b-a058-4a96-826c-c9c2d6804af5 tempest-CreateVolumesFromSnapshotTest-597264870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c85cf7f5-5b10-4af6-b823-a37f4cde2704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:18 devstack sudo[107478]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0e2991f1-ddf9-4bdd-81aa-db1ae440055c tempest-VolumeDependencyTests-83919300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-3a12aff2-b559-4779-a8d4-0de3527dfee1.3e186b4a-9bd8-4209-ae98-dd2c950830b3" returned: 0 in 0.269s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:18 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-eb49be2b-a058-4a96-826c-c9c2d6804af5 tempest-CreateVolumesFromSnapshotTest-597264870 None] Volume volume-e1926635-b302-4c66-bd42-9b1cbaafe041 (e1926635-b302-4c66-bd42-9b1cbaafe041): created successfully Nov 06 15:41:18 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-eb49be2b-a058-4a96-826c-c9c2d6804af5 tempest-CreateVolumesFromSnapshotTest-597264870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c85cf7f5-5b10-4af6-b823-a37f4cde2704) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:18 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-eb49be2b-a058-4a96-826c-c9c2d6804af5 tempest-CreateVolumesFromSnapshotTest-597264870 None] Flow 'volume_create_manager' (e9232926-d20a-4912-8fe4-9879cc8b9c3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:41:18 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-eb49be2b-a058-4a96-826c-c9c2d6804af5 tempest-CreateVolumesFromSnapshotTest-597264870 None] Created volume successfully. Nov 06 15:41:18 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-0e2991f1-ddf9-4bdd-81aa-db1ae440055c tempest-VolumeDependencyTests-83919300 None] Lock "cinder-quobyte-3e186b4a-9bd8-4209-ae98-dd2c950830b3" released by "_delete_snapshot" :: held 1.949s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:41:18 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-0e2991f1-ddf9-4bdd-81aa-db1ae440055c tempest-VolumeDependencyTests-83919300 None] Lock "cinder-quobyte-3a12aff2-b559-4779-a8d4-0de3527dfee1" released by "delete_snapshot" :: held 2.065s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:41:18 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-0e2991f1-ddf9-4bdd-81aa-db1ae440055c tempest-VolumeDependencyTests-83919300 None] Created reservations ['b49dc476-162b-4f5f-a237-6bce318e7f92', 'ddc2c51a-82f0-4946-9b63-0944575e518b', '1f6b04b2-d274-4012-837d-4915e48dac0f', 'a6d6d173-4f92-4ac7-a752-e55d706656fb'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:41:18 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-0e2991f1-ddf9-4bdd-81aa-db1ae440055c tempest-VolumeDependencyTests-83919300 None] Delete snapshot completed successfully. Nov 06 15:41:18 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-0e2991f1-ddf9-4bdd-81aa-db1ae440055c tempest-VolumeDependencyTests-83919300 None] Lock "cinder-3e186b4a-9bd8-4209-ae98-dd2c950830b3-delete_snapshot" released by "delete_snapshot" :: held 2.227s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:41:19 devstack sudo[107482]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6997924f-5c5d-492b-8ebb-e1588babb584 tempest-CreateVolumesFromSnapshotTest-597264870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d0918bd2-734a-419a-a15d-262b6c34503d 1073741824" returned: 0 in 0.541s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:19 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-232f2906-1ed2-4dc5-8231-b6e793877fef tempest-CreateVolumesFromImageTest-463197901 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:41:19 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-232f2906-1ed2-4dc5-8231-b6e793877fef tempest-CreateVolumesFromImageTest-463197901 None] Flow 'volume_create_manager' (db7a309f-655d-401f-9f6d-c4452978fd07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:41:19 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-232f2906-1ed2-4dc5-8231-b6e793877fef tempest-CreateVolumesFromImageTest-463197901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26965bdb-7975-481c-9fc4-98d8b046ee1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:19 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-232f2906-1ed2-4dc5-8231-b6e793877fef tempest-CreateVolumesFromImageTest-463197901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26965bdb-7975-481c-9fc4-98d8b046ee1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:41:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1105104746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5227f57-9551-4aea-813f-b0cd0a6b27b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='293de253becd4c3eb05b5355db62af32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:41:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:41:19Z,use_quota=True,user_id='f79dac2101724a7cad74f7796b2e62b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:19 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-232f2906-1ed2-4dc5-8231-b6e793877fef tempest-CreateVolumesFromImageTest-463197901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (399a0bea-1803-4341-a629-3a48c3551c90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:19 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-232f2906-1ed2-4dc5-8231-b6e793877fef tempest-CreateVolumesFromImageTest-463197901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (399a0bea-1803-4341-a629-3a48c3551c90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:19 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-232f2906-1ed2-4dc5-8231-b6e793877fef tempest-CreateVolumesFromImageTest-463197901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (327c709f-4557-4388-8c20-94d6309c9267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:19 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-232f2906-1ed2-4dc5-8231-b6e793877fef tempest-CreateVolumesFromImageTest-463197901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (327c709f-4557-4388-8c20-94d6309c9267) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5227f57-9551-4aea-813f-b0cd0a6b27b9', 'volume_name': 'volume-e5227f57-9551-4aea-813f-b0cd0a6b27b9', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:19 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-232f2906-1ed2-4dc5-8231-b6e793877fef tempest-CreateVolumesFromImageTest-463197901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a44dddbc-8d4b-412d-bfd7-b2eea12fa86d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:19 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-232f2906-1ed2-4dc5-8231-b6e793877fef tempest-CreateVolumesFromImageTest-463197901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a44dddbc-8d4b-412d-bfd7-b2eea12fa86d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:19 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-232f2906-1ed2-4dc5-8231-b6e793877fef tempest-CreateVolumesFromImageTest-463197901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cd5dc28-6bed-40b9-ac3f-feece6f13b07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:19 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-232f2906-1ed2-4dc5-8231-b6e793877fef tempest-CreateVolumesFromImageTest-463197901 None] Volume e5227f57-9551-4aea-813f-b0cd0a6b27b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5227f57-9551-4aea-813f-b0cd0a6b27b9', 'volume_size': 1} Nov 06 15:41:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-232f2906-1ed2-4dc5-8231-b6e793877fef tempest-CreateVolumesFromImageTest-463197901 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:41:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6997924f-5c5d-492b-8ebb-e1588babb584 tempest-CreateVolumesFromSnapshotTest-597264870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d0918bd2-734a-419a-a15d-262b6c34503d {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:19 devstack sudo[107488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d0918bd2-734a-419a-a15d-262b6c34503d Nov 06 15:41:19 devstack sudo[107488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:19 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-59b83a61-c99c-4fba-a238-1ed1ab0a8933 tempest-CreateVolumesFromImageTest-463197901 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:41:19 devstack sudo[107488]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:19 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-59b83a61-c99c-4fba-a238-1ed1ab0a8933 tempest-CreateVolumesFromImageTest-463197901 None] Flow 'volume_create_manager' (51ae621d-5038-42a8-87d7-a9d400e6d66a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:41:19 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-59b83a61-c99c-4fba-a238-1ed1ab0a8933 tempest-CreateVolumesFromImageTest-463197901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94a4ffc5-b2d0-4bda-96f0-22a6d1324879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6997924f-5c5d-492b-8ebb-e1588babb584 tempest-CreateVolumesFromSnapshotTest-597264870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d0918bd2-734a-419a-a15d-262b6c34503d" returned: 0 in 0.283s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:19 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-6997924f-5c5d-492b-8ebb-e1588babb584 tempest-CreateVolumesFromSnapshotTest-597264870 None] <== create_volume: return (962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:41:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6997924f-5c5d-492b-8ebb-e1588babb584 tempest-CreateVolumesFromSnapshotTest-597264870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.967s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:41:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-70c82618-3ba3-4345-baab-efb51da23eb1 tempest-CreateVolumesFromSnapshotTest-597264870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.510s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:41:19 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-70c82618-3ba3-4345-baab-efb51da23eb1 tempest-CreateVolumesFromSnapshotTest-597264870 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:41:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2101454480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5894ed60-f8d1-4af2-ad04-c9cf96bcfff9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1dd1416ca4b4ab78091d45ca8782b28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:41:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:41:07Z,use_quota=True,user_id='f0c1841ac23c45f4921295e6a25d28f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:41:19 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-70c82618-3ba3-4345-baab-efb51da23eb1 tempest-CreateVolumesFromSnapshotTest-597264870 None] Creating volume 5894ed60-f8d1-4af2-ad04-c9cf96bcfff9 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:41:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-70c82618-3ba3-4345-baab-efb51da23eb1 tempest-CreateVolumesFromSnapshotTest-597264870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:41:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-70c82618-3ba3-4345-baab-efb51da23eb1 tempest-CreateVolumesFromSnapshotTest-597264870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:41:19 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-70c82618-3ba3-4345-baab-efb51da23eb1 tempest-CreateVolumesFromSnapshotTest-597264870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:41:19 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-70c82618-3ba3-4345-baab-efb51da23eb1 tempest-CreateVolumesFromSnapshotTest-597264870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:41:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-70c82618-3ba3-4345-baab-efb51da23eb1 tempest-CreateVolumesFromSnapshotTest-597264870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:41:19 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-70c82618-3ba3-4345-baab-efb51da23eb1 tempest-CreateVolumesFromSnapshotTest-597264870 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:41:19 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-70c82618-3ba3-4345-baab-efb51da23eb1 tempest-CreateVolumesFromSnapshotTest-597264870 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:41:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-70c82618-3ba3-4345-baab-efb51da23eb1 tempest-CreateVolumesFromSnapshotTest-597264870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-5894ed60-f8d1-4af2-ad04-c9cf96bcfff9 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:19 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-59b83a61-c99c-4fba-a238-1ed1ab0a8933 tempest-CreateVolumesFromImageTest-463197901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94a4ffc5-b2d0-4bda-96f0-22a6d1324879) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:41:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1170859864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb1e9c89-7ddd-422d-9c45-9bd29fd2568d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='293de253becd4c3eb05b5355db62af32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:41:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:41:20Z,use_quota=True,user_id='f79dac2101724a7cad74f7796b2e62b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:19 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-59b83a61-c99c-4fba-a238-1ed1ab0a8933 tempest-CreateVolumesFromImageTest-463197901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bd67dab-dc35-42d1-934a-7d5f472b9f1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:19 devstack sudo[107491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-5894ed60-f8d1-4af2-ad04-c9cf96bcfff9 1073741824 Nov 06 15:41:19 devstack sudo[107491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:19 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-59b83a61-c99c-4fba-a238-1ed1ab0a8933 tempest-CreateVolumesFromImageTest-463197901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bd67dab-dc35-42d1-934a-7d5f472b9f1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:19 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-59b83a61-c99c-4fba-a238-1ed1ab0a8933 tempest-CreateVolumesFromImageTest-463197901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bbde84d-d32e-45d9-a463-11766f3f02d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:19 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-59b83a61-c99c-4fba-a238-1ed1ab0a8933 tempest-CreateVolumesFromImageTest-463197901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bbde84d-d32e-45d9-a463-11766f3f02d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb1e9c89-7ddd-422d-9c45-9bd29fd2568d', 'volume_name': 'volume-fb1e9c89-7ddd-422d-9c45-9bd29fd2568d', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:19 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-59b83a61-c99c-4fba-a238-1ed1ab0a8933 tempest-CreateVolumesFromImageTest-463197901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34b285d7-0344-46db-b6ca-7327e8410427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:19 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-59b83a61-c99c-4fba-a238-1ed1ab0a8933 tempest-CreateVolumesFromImageTest-463197901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34b285d7-0344-46db-b6ca-7327e8410427) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:19 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-59b83a61-c99c-4fba-a238-1ed1ab0a8933 tempest-CreateVolumesFromImageTest-463197901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae1af6ed-496c-44c5-b861-7d8d747833c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:19 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-59b83a61-c99c-4fba-a238-1ed1ab0a8933 tempest-CreateVolumesFromImageTest-463197901 None] Volume fb1e9c89-7ddd-422d-9c45-9bd29fd2568d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb1e9c89-7ddd-422d-9c45-9bd29fd2568d', 'volume_size': 1} Nov 06 15:41:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-59b83a61-c99c-4fba-a238-1ed1ab0a8933 tempest-CreateVolumesFromImageTest-463197901 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:41:19 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6997924f-5c5d-492b-8ebb-e1588babb584 tempest-CreateVolumesFromSnapshotTest-597264870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8a85473-df9e-4944-b7c4-072992ad5337) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0918bd2-734a-419a-a15d-262b6c34503d', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:19 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6997924f-5c5d-492b-8ebb-e1588babb584 tempest-CreateVolumesFromSnapshotTest-597264870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f9858eb-29ec-45e2-b9bb-4aa11a0385f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:19 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-6997924f-5c5d-492b-8ebb-e1588babb584 tempest-CreateVolumesFromSnapshotTest-597264870 None] Volume volume-d0918bd2-734a-419a-a15d-262b6c34503d (d0918bd2-734a-419a-a15d-262b6c34503d): created successfully Nov 06 15:41:19 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6997924f-5c5d-492b-8ebb-e1588babb584 tempest-CreateVolumesFromSnapshotTest-597264870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f9858eb-29ec-45e2-b9bb-4aa11a0385f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:19 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6997924f-5c5d-492b-8ebb-e1588babb584 tempest-CreateVolumesFromSnapshotTest-597264870 None] Flow 'volume_create_manager' (78a1b833-b416-404e-9777-9a585d66dd08) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:41:19 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-6997924f-5c5d-492b-8ebb-e1588babb584 tempest-CreateVolumesFromSnapshotTest-597264870 None] Created volume successfully. Nov 06 15:41:19 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc818259-7d34-4d57-ab66-a21bf82f340e tempest-CreateVolumesFromImageTest-463197901 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:41:19 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-dc818259-7d34-4d57-ab66-a21bf82f340e tempest-CreateVolumesFromImageTest-463197901 None] Flow 'volume_create_manager' (f89b948b-3ea2-4dc7-930d-2a0f9bd22cb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:41:19 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-dc818259-7d34-4d57-ab66-a21bf82f340e tempest-CreateVolumesFromImageTest-463197901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f732f3c2-6f5a-4a69-9eb0-81f47f9070c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:20 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-dc818259-7d34-4d57-ab66-a21bf82f340e tempest-CreateVolumesFromImageTest-463197901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f732f3c2-6f5a-4a69-9eb0-81f47f9070c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:41:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-926208746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e495e853-dc18-4dfc-9554-813e30e9a720,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='293de253becd4c3eb05b5355db62af32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:41:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:41:20Z,use_quota=True,user_id='f79dac2101724a7cad74f7796b2e62b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:20 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-dc818259-7d34-4d57-ab66-a21bf82f340e tempest-CreateVolumesFromImageTest-463197901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (004ce51d-7512-47ff-b15e-db6c1e3f192f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:20 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-dc818259-7d34-4d57-ab66-a21bf82f340e tempest-CreateVolumesFromImageTest-463197901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (004ce51d-7512-47ff-b15e-db6c1e3f192f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:20 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-dc818259-7d34-4d57-ab66-a21bf82f340e tempest-CreateVolumesFromImageTest-463197901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2789892f-dcfc-4a55-9bf9-ff612b5a5574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:20 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-dc818259-7d34-4d57-ab66-a21bf82f340e tempest-CreateVolumesFromImageTest-463197901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2789892f-dcfc-4a55-9bf9-ff612b5a5574) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e495e853-dc18-4dfc-9554-813e30e9a720', 'volume_name': 'volume-e495e853-dc18-4dfc-9554-813e30e9a720', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:20 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-dc818259-7d34-4d57-ab66-a21bf82f340e tempest-CreateVolumesFromImageTest-463197901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35a50dad-d2ce-4e60-94d3-018efb05b71c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:20 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-dc818259-7d34-4d57-ab66-a21bf82f340e tempest-CreateVolumesFromImageTest-463197901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35a50dad-d2ce-4e60-94d3-018efb05b71c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:20 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-dc818259-7d34-4d57-ab66-a21bf82f340e tempest-CreateVolumesFromImageTest-463197901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (060773d9-aa85-4ca9-9dc0-b2f109fef990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:20 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-dc818259-7d34-4d57-ab66-a21bf82f340e tempest-CreateVolumesFromImageTest-463197901 None] Volume e495e853-dc18-4dfc-9554-813e30e9a720: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e495e853-dc18-4dfc-9554-813e30e9a720', 'volume_size': 1} Nov 06 15:41:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-dc818259-7d34-4d57-ab66-a21bf82f340e tempest-CreateVolumesFromImageTest-463197901 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:41:20 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a8b997b4-45d0-42e1-8136-8645f8c3c26c tempest-VolumeDependencyTests-83919300 None] Acquiring lock "cinder-3a12aff2-b559-4779-a8d4-0de3527dfee1-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:41:20 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a8b997b4-45d0-42e1-8136-8645f8c3c26c tempest-VolumeDependencyTests-83919300 None] Lock "cinder-3a12aff2-b559-4779-a8d4-0de3527dfee1-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:41:20 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a8b997b4-45d0-42e1-8136-8645f8c3c26c tempest-VolumeDependencyTests-83919300 None] Acquiring lock "cinder-quobyte-3a12aff2-b559-4779-a8d4-0de3527dfee1" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:41:20 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a8b997b4-45d0-42e1-8136-8645f8c3c26c tempest-VolumeDependencyTests-83919300 None] Lock "cinder-quobyte-3a12aff2-b559-4779-a8d4-0de3527dfee1" acquired by "delete_volume" :: waited 0.017s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:41:20 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b210863-ba7f-4fa4-9ee0-b1991e50eccc]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:41:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a8b997b4-45d0-42e1-8136-8645f8c3c26c tempest-VolumeDependencyTests-83919300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-3a12aff2-b559-4779-a8d4-0de3527dfee1 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:20 devstack sudo[107491]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-70c82618-3ba3-4345-baab-efb51da23eb1 tempest-CreateVolumesFromSnapshotTest-597264870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-5894ed60-f8d1-4af2-ad04-c9cf96bcfff9 1073741824" returned: 0 in 0.586s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-70c82618-3ba3-4345-baab-efb51da23eb1 tempest-CreateVolumesFromSnapshotTest-597264870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-5894ed60-f8d1-4af2-ad04-c9cf96bcfff9 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:20 devstack sudo[107498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-5894ed60-f8d1-4af2-ad04-c9cf96bcfff9 Nov 06 15:41:20 devstack sudo[107498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:20 devstack sudo[107497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-3a12aff2-b559-4779-a8d4-0de3527dfee1 Nov 06 15:41:20 devstack sudo[107497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:20 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-d30fc01c-8782-4966-ae4f-7b859e82114d tempest-CreateVolumesFromImageTest-463197901 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:41:20 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d30fc01c-8782-4966-ae4f-7b859e82114d tempest-CreateVolumesFromImageTest-463197901 None] Flow 'volume_create_manager' (9f4d589e-0acd-4095-954c-2364b0f654e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:41:20 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d30fc01c-8782-4966-ae4f-7b859e82114d tempest-CreateVolumesFromImageTest-463197901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d12d0e83-7c10-4b13-aa64-0953c0b72e70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:20 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d30fc01c-8782-4966-ae4f-7b859e82114d tempest-CreateVolumesFromImageTest-463197901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d12d0e83-7c10-4b13-aa64-0953c0b72e70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:41:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1014546828',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed3c210a-3524-43ec-9838-e296b5c9642d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='293de253becd4c3eb05b5355db62af32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:41:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:41:20Z,use_quota=True,user_id='f79dac2101724a7cad74f7796b2e62b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:20 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d30fc01c-8782-4966-ae4f-7b859e82114d tempest-CreateVolumesFromImageTest-463197901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca0bab4f-2997-4ee9-a03f-873efa62eece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:20 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d30fc01c-8782-4966-ae4f-7b859e82114d tempest-CreateVolumesFromImageTest-463197901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca0bab4f-2997-4ee9-a03f-873efa62eece) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:20 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d30fc01c-8782-4966-ae4f-7b859e82114d tempest-CreateVolumesFromImageTest-463197901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fda0ede-cae0-4169-950f-47e6fce76921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:20 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d30fc01c-8782-4966-ae4f-7b859e82114d tempest-CreateVolumesFromImageTest-463197901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fda0ede-cae0-4169-950f-47e6fce76921) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed3c210a-3524-43ec-9838-e296b5c9642d', 'volume_name': 'volume-ed3c210a-3524-43ec-9838-e296b5c9642d', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:20 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d30fc01c-8782-4966-ae4f-7b859e82114d tempest-CreateVolumesFromImageTest-463197901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fea0f6fd-a679-4e3f-8622-2ff85cebea87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:20 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d30fc01c-8782-4966-ae4f-7b859e82114d tempest-CreateVolumesFromImageTest-463197901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fea0f6fd-a679-4e3f-8622-2ff85cebea87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:20 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d30fc01c-8782-4966-ae4f-7b859e82114d tempest-CreateVolumesFromImageTest-463197901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efa0d74b-8255-4550-9307-4d11084636cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:20 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-d30fc01c-8782-4966-ae4f-7b859e82114d tempest-CreateVolumesFromImageTest-463197901 None] Volume ed3c210a-3524-43ec-9838-e296b5c9642d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed3c210a-3524-43ec-9838-e296b5c9642d', 'volume_size': 1} Nov 06 15:41:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-d30fc01c-8782-4966-ae4f-7b859e82114d tempest-CreateVolumesFromImageTest-463197901 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:41:20 devstack sudo[107498]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-70c82618-3ba3-4345-baab-efb51da23eb1 tempest-CreateVolumesFromSnapshotTest-597264870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-5894ed60-f8d1-4af2-ad04-c9cf96bcfff9" returned: 0 in 0.380s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:20 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-70c82618-3ba3-4345-baab-efb51da23eb1 tempest-CreateVolumesFromSnapshotTest-597264870 None] <== create_volume: return (1013ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:41:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-70c82618-3ba3-4345-baab-efb51da23eb1 tempest-CreateVolumesFromSnapshotTest-597264870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.016s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:41:20 devstack sudo[107502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0ca746b7-2657-46c5-842c-b90bc7c46f21 1073741824 Nov 06 15:41:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-91db0e88-5750-4ddc-88af-ca3270d5e86f tempest-CinderUnicodeTest-485864985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.565s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:41:20 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-91db0e88-5750-4ddc-88af-ca3270d5e86f tempest-CinderUnicodeTest-485864985 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:41:16Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ca746b7-2657-46c5-842c-b90bc7c46f21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cc93baf2a004ec0a4d22d1ec403e886',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:41:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:41:17Z,use_quota=True,user_id='064addf5f3734e1b980c2e32adfd8a1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:41:20 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-91db0e88-5750-4ddc-88af-ca3270d5e86f tempest-CinderUnicodeTest-485864985 None] Creating volume 0ca746b7-2657-46c5-842c-b90bc7c46f21 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:41:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-91db0e88-5750-4ddc-88af-ca3270d5e86f tempest-CinderUnicodeTest-485864985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:41:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-91db0e88-5750-4ddc-88af-ca3270d5e86f tempest-CinderUnicodeTest-485864985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:41:20 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-91db0e88-5750-4ddc-88af-ca3270d5e86f tempest-CinderUnicodeTest-485864985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:41:20 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-91db0e88-5750-4ddc-88af-ca3270d5e86f tempest-CinderUnicodeTest-485864985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:41:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-91db0e88-5750-4ddc-88af-ca3270d5e86f tempest-CinderUnicodeTest-485864985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:41:20 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-91db0e88-5750-4ddc-88af-ca3270d5e86f tempest-CinderUnicodeTest-485864985 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:41:20 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-91db0e88-5750-4ddc-88af-ca3270d5e86f tempest-CinderUnicodeTest-485864985 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:41:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-91db0e88-5750-4ddc-88af-ca3270d5e86f tempest-CinderUnicodeTest-485864985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0ca746b7-2657-46c5-842c-b90bc7c46f21 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:20 devstack sudo[107502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:20 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-70c82618-3ba3-4345-baab-efb51da23eb1 tempest-CreateVolumesFromSnapshotTest-597264870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4663c0e4-9a3d-42b8-9c91-28860889fb73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5894ed60-f8d1-4af2-ad04-c9cf96bcfff9', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:20 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-70c82618-3ba3-4345-baab-efb51da23eb1 tempest-CreateVolumesFromSnapshotTest-597264870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87b5e5cc-66cc-49d4-89a0-f21d2517066a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:20 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-70c82618-3ba3-4345-baab-efb51da23eb1 tempest-CreateVolumesFromSnapshotTest-597264870 None] Volume volume-5894ed60-f8d1-4af2-ad04-c9cf96bcfff9 (5894ed60-f8d1-4af2-ad04-c9cf96bcfff9): created successfully Nov 06 15:41:20 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-70c82618-3ba3-4345-baab-efb51da23eb1 tempest-CreateVolumesFromSnapshotTest-597264870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87b5e5cc-66cc-49d4-89a0-f21d2517066a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:20 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-70c82618-3ba3-4345-baab-efb51da23eb1 tempest-CreateVolumesFromSnapshotTest-597264870 None] Flow 'volume_create_manager' (ba01913e-d76f-49e4-9244-cc19bd6fe6e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:41:20 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-70c82618-3ba3-4345-baab-efb51da23eb1 tempest-CreateVolumesFromSnapshotTest-597264870 None] Created volume successfully. Nov 06 15:41:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a8b997b4-45d0-42e1-8136-8645f8c3c26c tempest-VolumeDependencyTests-83919300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-3a12aff2-b559-4779-a8d4-0de3527dfee1" returned: 0 in 0.610s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a8b997b4-45d0-42e1-8136-8645f8c3c26c tempest-VolumeDependencyTests-83919300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-3a12aff2-b559-4779-a8d4-0de3527dfee1 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:20 devstack sudo[107497]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:20 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-fccc43cf-4239-42c2-98ec-acb24d2191dd tempest-CreateVolumesFromImageTest-463197901 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:41:20 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fccc43cf-4239-42c2-98ec-acb24d2191dd tempest-CreateVolumesFromImageTest-463197901 None] Flow 'volume_create_manager' (7c5daefa-2336-45bd-b449-e388f8c45f4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:41:20 devstack sudo[107509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-3a12aff2-b559-4779-a8d4-0de3527dfee1 Nov 06 15:41:20 devstack sudo[107509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:20 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fccc43cf-4239-42c2-98ec-acb24d2191dd tempest-CreateVolumesFromImageTest-463197901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e096429-baa5-4b93-893e-58a69ba4cf44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:20 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fccc43cf-4239-42c2-98ec-acb24d2191dd tempest-CreateVolumesFromImageTest-463197901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e096429-baa5-4b93-893e-58a69ba4cf44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:41:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-281191428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba528664-970b-4c9b-a9fd-e1c205191cef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='293de253becd4c3eb05b5355db62af32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:41:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:41:21Z,use_quota=True,user_id='f79dac2101724a7cad74f7796b2e62b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:20 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fccc43cf-4239-42c2-98ec-acb24d2191dd tempest-CreateVolumesFromImageTest-463197901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a26ab6c-8576-4635-b3ef-7870ac92c008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:20 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fccc43cf-4239-42c2-98ec-acb24d2191dd tempest-CreateVolumesFromImageTest-463197901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a26ab6c-8576-4635-b3ef-7870ac92c008) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:20 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fccc43cf-4239-42c2-98ec-acb24d2191dd tempest-CreateVolumesFromImageTest-463197901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f36d0c64-6ae9-491b-871e-0b206612d911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:20 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fccc43cf-4239-42c2-98ec-acb24d2191dd tempest-CreateVolumesFromImageTest-463197901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f36d0c64-6ae9-491b-871e-0b206612d911) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba528664-970b-4c9b-a9fd-e1c205191cef', 'volume_name': 'volume-ba528664-970b-4c9b-a9fd-e1c205191cef', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:20 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fccc43cf-4239-42c2-98ec-acb24d2191dd tempest-CreateVolumesFromImageTest-463197901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e419dd31-d5ab-4e9e-a75a-02de6f919165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:20 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fccc43cf-4239-42c2-98ec-acb24d2191dd tempest-CreateVolumesFromImageTest-463197901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e419dd31-d5ab-4e9e-a75a-02de6f919165) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:20 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fccc43cf-4239-42c2-98ec-acb24d2191dd tempest-CreateVolumesFromImageTest-463197901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0763c5b-5831-48fa-a6f1-4e6f9285c62a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:20 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-fccc43cf-4239-42c2-98ec-acb24d2191dd tempest-CreateVolumesFromImageTest-463197901 None] Volume ba528664-970b-4c9b-a9fd-e1c205191cef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba528664-970b-4c9b-a9fd-e1c205191cef', 'volume_size': 1} Nov 06 15:41:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-fccc43cf-4239-42c2-98ec-acb24d2191dd tempest-CreateVolumesFromImageTest-463197901 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:41:21 devstack sudo[107509]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a8b997b4-45d0-42e1-8136-8645f8c3c26c tempest-VolumeDependencyTests-83919300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-3a12aff2-b559-4779-a8d4-0de3527dfee1" returned: 0 in 0.314s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:21 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a8b997b4-45d0-42e1-8136-8645f8c3c26c tempest-VolumeDependencyTests-83919300 None] Lock "cinder-quobyte-3a12aff2-b559-4779-a8d4-0de3527dfee1" released by "delete_volume" :: held 1.004s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:41:21 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-a8b997b4-45d0-42e1-8136-8645f8c3c26c tempest-VolumeDependencyTests-83919300 None] Created reservations ['7eb89687-7657-4455-b8b2-ce7fb83e868b', 'f769673f-0e70-4387-8312-46ddb9314e90', '3420fbc6-940d-41ca-871f-5dce6b115a01', '7cb9e59b-7d04-4762-b1d6-3ab92453c0f8'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:41:21 devstack sudo[107502]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-91db0e88-5750-4ddc-88af-ca3270d5e86f tempest-CinderUnicodeTest-485864985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0ca746b7-2657-46c5-842c-b90bc7c46f21 1073741824" returned: 0 in 0.549s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-91db0e88-5750-4ddc-88af-ca3270d5e86f tempest-CinderUnicodeTest-485864985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0ca746b7-2657-46c5-842c-b90bc7c46f21 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a8b997b4-45d0-42e1-8136-8645f8c3c26c tempest-VolumeDependencyTests-83919300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:41:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a8b997b4-45d0-42e1-8136-8645f8c3c26c tempest-VolumeDependencyTests-83919300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:41:21 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-a8b997b4-45d0-42e1-8136-8645f8c3c26c tempest-VolumeDependencyTests-83919300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:41:21 devstack sudo[107516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0ca746b7-2657-46c5-842c-b90bc7c46f21 Nov 06 15:41:21 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-a8b997b4-45d0-42e1-8136-8645f8c3c26c tempest-VolumeDependencyTests-83919300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:41:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a8b997b4-45d0-42e1-8136-8645f8c3c26c tempest-VolumeDependencyTests-83919300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:41:21 devstack sudo[107516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a8b997b4-45d0-42e1-8136-8645f8c3c26c tempest-VolumeDependencyTests-83919300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:21 devstack sudo[107518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:41:21 devstack sudo[107518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:21 devstack sudo[107516]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-91db0e88-5750-4ddc-88af-ca3270d5e86f tempest-CinderUnicodeTest-485864985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0ca746b7-2657-46c5-842c-b90bc7c46f21" returned: 0 in 0.246s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:21 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-91db0e88-5750-4ddc-88af-ca3270d5e86f tempest-CinderUnicodeTest-485864985 None] <== create_volume: return (848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:41:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-91db0e88-5750-4ddc-88af-ca3270d5e86f tempest-CinderUnicodeTest-485864985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.854s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:41:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-232f2906-1ed2-4dc5-8231-b6e793877fef tempest-CreateVolumesFromImageTest-463197901 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.174s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:41:21 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-232f2906-1ed2-4dc5-8231-b6e793877fef tempest-CreateVolumesFromImageTest-463197901 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:41:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1105104746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5227f57-9551-4aea-813f-b0cd0a6b27b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='293de253becd4c3eb05b5355db62af32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:41:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:41:19Z,use_quota=True,user_id='f79dac2101724a7cad74f7796b2e62b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:41:21 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-232f2906-1ed2-4dc5-8231-b6e793877fef tempest-CreateVolumesFromImageTest-463197901 None] Creating volume e5227f57-9551-4aea-813f-b0cd0a6b27b9 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:41:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-232f2906-1ed2-4dc5-8231-b6e793877fef tempest-CreateVolumesFromImageTest-463197901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:41:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-232f2906-1ed2-4dc5-8231-b6e793877fef tempest-CreateVolumesFromImageTest-463197901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:41:21 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-232f2906-1ed2-4dc5-8231-b6e793877fef tempest-CreateVolumesFromImageTest-463197901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:41:21 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-232f2906-1ed2-4dc5-8231-b6e793877fef tempest-CreateVolumesFromImageTest-463197901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:41:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-232f2906-1ed2-4dc5-8231-b6e793877fef tempest-CreateVolumesFromImageTest-463197901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:41:21 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-232f2906-1ed2-4dc5-8231-b6e793877fef tempest-CreateVolumesFromImageTest-463197901 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:41:21 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-232f2906-1ed2-4dc5-8231-b6e793877fef tempest-CreateVolumesFromImageTest-463197901 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:41:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-232f2906-1ed2-4dc5-8231-b6e793877fef tempest-CreateVolumesFromImageTest-463197901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-e5227f57-9551-4aea-813f-b0cd0a6b27b9 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:21 devstack sudo[107518]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a8b997b4-45d0-42e1-8136-8645f8c3c26c tempest-VolumeDependencyTests-83919300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.247s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:21 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-a8b997b4-45d0-42e1-8136-8645f8c3c26c tempest-VolumeDependencyTests-83919300 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:41:21 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-91db0e88-5750-4ddc-88af-ca3270d5e86f tempest-CinderUnicodeTest-485864985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c06986e-6be9-4241-887a-d0c1d92292cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ca746b7-2657-46c5-842c-b90bc7c46f21', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:21 devstack sudo[107522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-e5227f57-9551-4aea-813f-b0cd0a6b27b9 1073741824 Nov 06 15:41:21 devstack sudo[107522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:21 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-91db0e88-5750-4ddc-88af-ca3270d5e86f tempest-CinderUnicodeTest-485864985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b95a16db-0a63-4ce8-953e-4c7ada57e26d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:21 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-a8b997b4-45d0-42e1-8136-8645f8c3c26c tempest-VolumeDependencyTests-83919300 None] Deleted volume successfully. Nov 06 15:41:21 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-91db0e88-5750-4ddc-88af-ca3270d5e86f tempest-CinderUnicodeTest-485864985 None] Volume volume-0ca746b7-2657-46c5-842c-b90bc7c46f21 (0ca746b7-2657-46c5-842c-b90bc7c46f21): created successfully Nov 06 15:41:21 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-91db0e88-5750-4ddc-88af-ca3270d5e86f tempest-CinderUnicodeTest-485864985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b95a16db-0a63-4ce8-953e-4c7ada57e26d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:21 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-91db0e88-5750-4ddc-88af-ca3270d5e86f tempest-CinderUnicodeTest-485864985 None] Flow 'volume_create_manager' (81e811de-e697-401a-a07a-c089455d2ccd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:41:21 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-91db0e88-5750-4ddc-88af-ca3270d5e86f tempest-CinderUnicodeTest-485864985 None] Created volume successfully. Nov 06 15:41:21 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a8b997b4-45d0-42e1-8136-8645f8c3c26c tempest-VolumeDependencyTests-83919300 None] Lock "cinder-3a12aff2-b559-4779-a8d4-0de3527dfee1-delete_volume" released by "delete_volume" :: held 1.502s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:41:21 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-aa10f30d-d0e1-49d8-b069-346cac50783a tempest-CreateVolumesFromSnapshotTest-597264870 None] Acquiring lock "cinder-5894ed60-f8d1-4af2-ad04-c9cf96bcfff9-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:41:21 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-aa10f30d-d0e1-49d8-b069-346cac50783a tempest-CreateVolumesFromSnapshotTest-597264870 None] Lock "cinder-5894ed60-f8d1-4af2-ad04-c9cf96bcfff9-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:41:21 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-aa10f30d-d0e1-49d8-b069-346cac50783a tempest-CreateVolumesFromSnapshotTest-597264870 None] Acquiring lock "cinder-quobyte-5894ed60-f8d1-4af2-ad04-c9cf96bcfff9" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:41:21 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-aa10f30d-d0e1-49d8-b069-346cac50783a tempest-CreateVolumesFromSnapshotTest-597264870 None] Lock "cinder-quobyte-5894ed60-f8d1-4af2-ad04-c9cf96bcfff9" acquired by "delete_volume" :: waited 0.020s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:41:21 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d13e744-bf74-4a04-9a8c-00e783b6bd3c]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:41:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-aa10f30d-d0e1-49d8-b069-346cac50783a tempest-CreateVolumesFromSnapshotTest-597264870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-5894ed60-f8d1-4af2-ad04-c9cf96bcfff9 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:21 devstack sudo[107522]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-232f2906-1ed2-4dc5-8231-b6e793877fef tempest-CreateVolumesFromImageTest-463197901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-e5227f57-9551-4aea-813f-b0cd0a6b27b9 1073741824" returned: 0 in 0.489s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-232f2906-1ed2-4dc5-8231-b6e793877fef tempest-CreateVolumesFromImageTest-463197901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-e5227f57-9551-4aea-813f-b0cd0a6b27b9 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:22 devstack sudo[107528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-5894ed60-f8d1-4af2-ad04-c9cf96bcfff9 Nov 06 15:41:22 devstack sudo[107528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:22 devstack sudo[107529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-e5227f57-9551-4aea-813f-b0cd0a6b27b9 Nov 06 15:41:22 devstack sudo[107529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:22 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-73606b0c-8dff-46b7-beab-99cfee23fc16 tempest-VolumeDependencyTests-83919300 None] Acquiring lock "cinder-fb9985c5-0f9d-4cae-b37d-a40451610be2-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:41:22 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-73606b0c-8dff-46b7-beab-99cfee23fc16 tempest-VolumeDependencyTests-83919300 None] Lock "cinder-fb9985c5-0f9d-4cae-b37d-a40451610be2-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:41:22 devstack sudo[107529]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-232f2906-1ed2-4dc5-8231-b6e793877fef tempest-CreateVolumesFromImageTest-463197901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-e5227f57-9551-4aea-813f-b0cd0a6b27b9" returned: 0 in 0.314s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:22 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-232f2906-1ed2-4dc5-8231-b6e793877fef tempest-CreateVolumesFromImageTest-463197901 None] <== create_volume: return (855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:41:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-232f2906-1ed2-4dc5-8231-b6e793877fef tempest-CreateVolumesFromImageTest-463197901 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.858s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:41:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-59b83a61-c99c-4fba-a238-1ed1ab0a8933 tempest-CreateVolumesFromImageTest-463197901 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.666s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:41:22 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-59b83a61-c99c-4fba-a238-1ed1ab0a8933 tempest-CreateVolumesFromImageTest-463197901 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:41:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1170859864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb1e9c89-7ddd-422d-9c45-9bd29fd2568d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='293de253becd4c3eb05b5355db62af32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:41:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:41:20Z,use_quota=True,user_id='f79dac2101724a7cad74f7796b2e62b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:41:22 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-59b83a61-c99c-4fba-a238-1ed1ab0a8933 tempest-CreateVolumesFromImageTest-463197901 None] Creating volume fb1e9c89-7ddd-422d-9c45-9bd29fd2568d {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:41:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-59b83a61-c99c-4fba-a238-1ed1ab0a8933 tempest-CreateVolumesFromImageTest-463197901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:41:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-59b83a61-c99c-4fba-a238-1ed1ab0a8933 tempest-CreateVolumesFromImageTest-463197901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:41:22 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-59b83a61-c99c-4fba-a238-1ed1ab0a8933 tempest-CreateVolumesFromImageTest-463197901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:41:22 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-59b83a61-c99c-4fba-a238-1ed1ab0a8933 tempest-CreateVolumesFromImageTest-463197901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:41:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-59b83a61-c99c-4fba-a238-1ed1ab0a8933 tempest-CreateVolumesFromImageTest-463197901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:41:22 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-59b83a61-c99c-4fba-a238-1ed1ab0a8933 tempest-CreateVolumesFromImageTest-463197901 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:41:22 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-59b83a61-c99c-4fba-a238-1ed1ab0a8933 tempest-CreateVolumesFromImageTest-463197901 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:41:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-59b83a61-c99c-4fba-a238-1ed1ab0a8933 tempest-CreateVolumesFromImageTest-463197901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-fb1e9c89-7ddd-422d-9c45-9bd29fd2568d 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:22 devstack sudo[107528]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:22 devstack sudo[107538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-fb1e9c89-7ddd-422d-9c45-9bd29fd2568d 1073741824 Nov 06 15:41:22 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-232f2906-1ed2-4dc5-8231-b6e793877fef tempest-CreateVolumesFromImageTest-463197901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cd5dc28-6bed-40b9-ac3f-feece6f13b07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5227f57-9551-4aea-813f-b0cd0a6b27b9', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:22 devstack sudo[107538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:22 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-232f2906-1ed2-4dc5-8231-b6e793877fef tempest-CreateVolumesFromImageTest-463197901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96113aca-d157-4fe1-b6ab-bc8d92fa1605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-aa10f30d-d0e1-49d8-b069-346cac50783a tempest-CreateVolumesFromSnapshotTest-597264870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-5894ed60-f8d1-4af2-ad04-c9cf96bcfff9" returned: 0 in 0.504s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-aa10f30d-d0e1-49d8-b069-346cac50783a tempest-CreateVolumesFromSnapshotTest-597264870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-5894ed60-f8d1-4af2-ad04-c9cf96bcfff9 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:22 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-232f2906-1ed2-4dc5-8231-b6e793877fef tempest-CreateVolumesFromImageTest-463197901 None] Volume volume-e5227f57-9551-4aea-813f-b0cd0a6b27b9 (e5227f57-9551-4aea-813f-b0cd0a6b27b9): created successfully Nov 06 15:41:22 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-232f2906-1ed2-4dc5-8231-b6e793877fef tempest-CreateVolumesFromImageTest-463197901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96113aca-d157-4fe1-b6ab-bc8d92fa1605) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:22 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-232f2906-1ed2-4dc5-8231-b6e793877fef tempest-CreateVolumesFromImageTest-463197901 None] Flow 'volume_create_manager' (db7a309f-655d-401f-9f6d-c4452978fd07) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:41:22 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-73606b0c-8dff-46b7-beab-99cfee23fc16 tempest-VolumeDependencyTests-83919300 None] Acquiring lock "cinder-quobyte-fb9985c5-0f9d-4cae-b37d-a40451610be2" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:41:22 devstack sudo[107540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-5894ed60-f8d1-4af2-ad04-c9cf96bcfff9 Nov 06 15:41:22 devstack sudo[107540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:22 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-232f2906-1ed2-4dc5-8231-b6e793877fef tempest-CreateVolumesFromImageTest-463197901 None] Created volume successfully. Nov 06 15:41:22 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-73606b0c-8dff-46b7-beab-99cfee23fc16 tempest-VolumeDependencyTests-83919300 None] Lock "cinder-quobyte-fb9985c5-0f9d-4cae-b37d-a40451610be2" acquired by "delete_volume" :: waited 0.033s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:41:22 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[017273d7-b0cd-4339-8797-be8f8e0a5cc5]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:41:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-73606b0c-8dff-46b7-beab-99cfee23fc16 tempest-VolumeDependencyTests-83919300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-fb9985c5-0f9d-4cae-b37d-a40451610be2 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:22 devstack sudo[107542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-fb9985c5-0f9d-4cae-b37d-a40451610be2 Nov 06 15:41:22 devstack sudo[107542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:22 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-ecade892-fc22-4fba-8a18-4378df60798d tempest-CinderUnicodeTest-485864985 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:41:22 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ecade892-fc22-4fba-8a18-4378df60798d tempest-CinderUnicodeTest-485864985 None] Flow 'volume_create_manager' (a95e620f-110e-4908-af29-e924b3caa1b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:41:22 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ecade892-fc22-4fba-8a18-4378df60798d tempest-CinderUnicodeTest-485864985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b774b37-7ab3-4cc8-9fcb-92bc815595e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:22 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ecade892-fc22-4fba-8a18-4378df60798d tempest-CinderUnicodeTest-485864985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b774b37-7ab3-4cc8-9fcb-92bc815595e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:41:22Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-839440588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21c68185-d00b-498e-b90b-98ca8c09f468,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cc93baf2a004ec0a4d22d1ec403e886',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:41:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:41:23Z,use_quota=True,user_id='064addf5f3734e1b980c2e32adfd8a1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:22 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ecade892-fc22-4fba-8a18-4378df60798d tempest-CinderUnicodeTest-485864985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c962244d-ef70-44f7-bfda-8fce30f7c73d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:22 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ecade892-fc22-4fba-8a18-4378df60798d tempest-CinderUnicodeTest-485864985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c962244d-ef70-44f7-bfda-8fce30f7c73d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:22 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ecade892-fc22-4fba-8a18-4378df60798d tempest-CinderUnicodeTest-485864985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ddc6af2-44a2-4ae2-9add-b5746ba53109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:22 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ecade892-fc22-4fba-8a18-4378df60798d tempest-CinderUnicodeTest-485864985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ddc6af2-44a2-4ae2-9add-b5746ba53109) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21c68185-d00b-498e-b90b-98ca8c09f468', 'volume_name': 'volume-21c68185-d00b-498e-b90b-98ca8c09f468', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:22 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ecade892-fc22-4fba-8a18-4378df60798d tempest-CinderUnicodeTest-485864985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b90595f-85bf-4d00-98a9-b9ffd7d8c6fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:22 devstack sudo[107540]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:22 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ecade892-fc22-4fba-8a18-4378df60798d tempest-CinderUnicodeTest-485864985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b90595f-85bf-4d00-98a9-b9ffd7d8c6fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:22 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ecade892-fc22-4fba-8a18-4378df60798d tempest-CinderUnicodeTest-485864985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fb41dfb-82bb-437a-ad19-1895ea121d0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:22 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-ecade892-fc22-4fba-8a18-4378df60798d tempest-CinderUnicodeTest-485864985 None] Volume 21c68185-d00b-498e-b90b-98ca8c09f468: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21c68185-d00b-498e-b90b-98ca8c09f468', 'volume_size': 1} Nov 06 15:41:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ecade892-fc22-4fba-8a18-4378df60798d tempest-CinderUnicodeTest-485864985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:41:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-aa10f30d-d0e1-49d8-b069-346cac50783a tempest-CreateVolumesFromSnapshotTest-597264870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-5894ed60-f8d1-4af2-ad04-c9cf96bcfff9" returned: 0 in 0.445s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:22 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-aa10f30d-d0e1-49d8-b069-346cac50783a tempest-CreateVolumesFromSnapshotTest-597264870 None] Lock "cinder-quobyte-5894ed60-f8d1-4af2-ad04-c9cf96bcfff9" released by "delete_volume" :: held 0.997s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:41:22 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-aa10f30d-d0e1-49d8-b069-346cac50783a tempest-CreateVolumesFromSnapshotTest-597264870 None] Created reservations ['048e187f-0f88-4174-82bd-cfb379bb46ae', '97e800d7-115a-4185-a588-1a8ba85ead9b', '6b1b2882-ea23-48ac-b16b-e88e52c23ae3', '7d03f650-80cc-4b68-92cf-a09e41d0de12'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:41:22 devstack sudo[107538]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-59b83a61-c99c-4fba-a238-1ed1ab0a8933 tempest-CreateVolumesFromImageTest-463197901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-fb1e9c89-7ddd-422d-9c45-9bd29fd2568d 1073741824" returned: 0 in 0.624s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-aa10f30d-d0e1-49d8-b069-346cac50783a tempest-CreateVolumesFromSnapshotTest-597264870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:41:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-aa10f30d-d0e1-49d8-b069-346cac50783a tempest-CreateVolumesFromSnapshotTest-597264870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:41:23 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-aa10f30d-d0e1-49d8-b069-346cac50783a tempest-CreateVolumesFromSnapshotTest-597264870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:41:23 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-aa10f30d-d0e1-49d8-b069-346cac50783a tempest-CreateVolumesFromSnapshotTest-597264870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:41:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-aa10f30d-d0e1-49d8-b069-346cac50783a tempest-CreateVolumesFromSnapshotTest-597264870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:41:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-aa10f30d-d0e1-49d8-b069-346cac50783a tempest-CreateVolumesFromSnapshotTest-597264870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:23 devstack sudo[107542]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-59b83a61-c99c-4fba-a238-1ed1ab0a8933 tempest-CreateVolumesFromImageTest-463197901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-fb1e9c89-7ddd-422d-9c45-9bd29fd2568d {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:23 devstack sudo[107552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:41:23 devstack sudo[107552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-73606b0c-8dff-46b7-beab-99cfee23fc16 tempest-VolumeDependencyTests-83919300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-fb9985c5-0f9d-4cae-b37d-a40451610be2" returned: 0 in 0.536s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-73606b0c-8dff-46b7-beab-99cfee23fc16 tempest-VolumeDependencyTests-83919300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-fb9985c5-0f9d-4cae-b37d-a40451610be2 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:23 devstack sudo[107553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-fb1e9c89-7ddd-422d-9c45-9bd29fd2568d Nov 06 15:41:23 devstack sudo[107553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:23 devstack sudo[107555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-fb9985c5-0f9d-4cae-b37d-a40451610be2 Nov 06 15:41:23 devstack sudo[107555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:23 devstack sudo[107552]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-aa10f30d-d0e1-49d8-b069-346cac50783a tempest-CreateVolumesFromSnapshotTest-597264870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.251s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:23 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-aa10f30d-d0e1-49d8-b069-346cac50783a tempest-CreateVolumesFromSnapshotTest-597264870 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:41:23 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-aa10f30d-d0e1-49d8-b069-346cac50783a tempest-CreateVolumesFromSnapshotTest-597264870 None] Deleted volume successfully. Nov 06 15:41:23 devstack sudo[107553]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:23 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-aa10f30d-d0e1-49d8-b069-346cac50783a tempest-CreateVolumesFromSnapshotTest-597264870 None] Lock "cinder-5894ed60-f8d1-4af2-ad04-c9cf96bcfff9-delete_volume" released by "delete_volume" :: held 1.489s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:41:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-59b83a61-c99c-4fba-a238-1ed1ab0a8933 tempest-CreateVolumesFromImageTest-463197901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-fb1e9c89-7ddd-422d-9c45-9bd29fd2568d" returned: 0 in 0.273s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:23 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-59b83a61-c99c-4fba-a238-1ed1ab0a8933 tempest-CreateVolumesFromImageTest-463197901 None] <== create_volume: return (979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:41:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-59b83a61-c99c-4fba-a238-1ed1ab0a8933 tempest-CreateVolumesFromImageTest-463197901 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.985s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:41:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-dc818259-7d34-4d57-ab66-a21bf82f340e tempest-CreateVolumesFromImageTest-463197901 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.296s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:41:23 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-dc818259-7d34-4d57-ab66-a21bf82f340e tempest-CreateVolumesFromImageTest-463197901 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:41:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-926208746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e495e853-dc18-4dfc-9554-813e30e9a720,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='293de253becd4c3eb05b5355db62af32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:41:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:41:20Z,use_quota=True,user_id='f79dac2101724a7cad74f7796b2e62b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:41:23 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-dc818259-7d34-4d57-ab66-a21bf82f340e tempest-CreateVolumesFromImageTest-463197901 None] Creating volume e495e853-dc18-4dfc-9554-813e30e9a720 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:41:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-dc818259-7d34-4d57-ab66-a21bf82f340e tempest-CreateVolumesFromImageTest-463197901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:41:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-dc818259-7d34-4d57-ab66-a21bf82f340e tempest-CreateVolumesFromImageTest-463197901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:41:23 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-dc818259-7d34-4d57-ab66-a21bf82f340e tempest-CreateVolumesFromImageTest-463197901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:41:23 devstack sudo[107555]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:23 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-dc818259-7d34-4d57-ab66-a21bf82f340e tempest-CreateVolumesFromImageTest-463197901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:41:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-dc818259-7d34-4d57-ab66-a21bf82f340e tempest-CreateVolumesFromImageTest-463197901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:41:23 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-dc818259-7d34-4d57-ab66-a21bf82f340e tempest-CreateVolumesFromImageTest-463197901 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:41:23 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-dc818259-7d34-4d57-ab66-a21bf82f340e tempest-CreateVolumesFromImageTest-463197901 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:41:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-dc818259-7d34-4d57-ab66-a21bf82f340e tempest-CreateVolumesFromImageTest-463197901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-e495e853-dc18-4dfc-9554-813e30e9a720 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-73606b0c-8dff-46b7-beab-99cfee23fc16 tempest-VolumeDependencyTests-83919300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-fb9985c5-0f9d-4cae-b37d-a40451610be2" returned: 0 in 0.291s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:23 devstack sudo[107561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-e495e853-dc18-4dfc-9554-813e30e9a720 1073741824 Nov 06 15:41:23 devstack sudo[107561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:23 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-59b83a61-c99c-4fba-a238-1ed1ab0a8933 tempest-CreateVolumesFromImageTest-463197901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae1af6ed-496c-44c5-b861-7d8d747833c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb1e9c89-7ddd-422d-9c45-9bd29fd2568d', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:23 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-59b83a61-c99c-4fba-a238-1ed1ab0a8933 tempest-CreateVolumesFromImageTest-463197901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90041c58-7602-49d6-8ef2-c7d8eff31c73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:23 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-73606b0c-8dff-46b7-beab-99cfee23fc16 tempest-VolumeDependencyTests-83919300 None] Lock "cinder-quobyte-fb9985c5-0f9d-4cae-b37d-a40451610be2" released by "delete_volume" :: held 0.904s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:41:23 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-59b83a61-c99c-4fba-a238-1ed1ab0a8933 tempest-CreateVolumesFromImageTest-463197901 None] Volume volume-fb1e9c89-7ddd-422d-9c45-9bd29fd2568d (fb1e9c89-7ddd-422d-9c45-9bd29fd2568d): created successfully Nov 06 15:41:23 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-59b83a61-c99c-4fba-a238-1ed1ab0a8933 tempest-CreateVolumesFromImageTest-463197901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90041c58-7602-49d6-8ef2-c7d8eff31c73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:23 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-59b83a61-c99c-4fba-a238-1ed1ab0a8933 tempest-CreateVolumesFromImageTest-463197901 None] Flow 'volume_create_manager' (51ae621d-5038-42a8-87d7-a9d400e6d66a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:41:23 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-59b83a61-c99c-4fba-a238-1ed1ab0a8933 tempest-CreateVolumesFromImageTest-463197901 None] Created volume successfully. Nov 06 15:41:23 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-73606b0c-8dff-46b7-beab-99cfee23fc16 tempest-VolumeDependencyTests-83919300 None] Created reservations ['617eb82e-0879-4059-88b9-f2ff55d3d043', '7e7ee0a8-391d-4bdf-a8fc-e471edd43038', '2820c7c8-a894-4404-8724-20f593688439', '87a78f3b-e99b-4908-b597-d46f393dd5b3'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:41:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-73606b0c-8dff-46b7-beab-99cfee23fc16 tempest-VolumeDependencyTests-83919300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:41:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-73606b0c-8dff-46b7-beab-99cfee23fc16 tempest-VolumeDependencyTests-83919300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:41:23 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-73606b0c-8dff-46b7-beab-99cfee23fc16 tempest-VolumeDependencyTests-83919300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:41:23 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-73606b0c-8dff-46b7-beab-99cfee23fc16 tempest-VolumeDependencyTests-83919300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:41:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-73606b0c-8dff-46b7-beab-99cfee23fc16 tempest-VolumeDependencyTests-83919300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:41:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-73606b0c-8dff-46b7-beab-99cfee23fc16 tempest-VolumeDependencyTests-83919300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:23 devstack sudo[107563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:41:23 devstack sudo[107563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:23 devstack sudo[107563]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-73606b0c-8dff-46b7-beab-99cfee23fc16 tempest-VolumeDependencyTests-83919300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.254s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:23 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-73606b0c-8dff-46b7-beab-99cfee23fc16 tempest-VolumeDependencyTests-83919300 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:41:23 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-73606b0c-8dff-46b7-beab-99cfee23fc16 tempest-VolumeDependencyTests-83919300 None] Deleted volume successfully. Nov 06 15:41:23 devstack sudo[107561]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-dc818259-7d34-4d57-ab66-a21bf82f340e tempest-CreateVolumesFromImageTest-463197901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-e495e853-dc18-4dfc-9554-813e30e9a720 1073741824" returned: 0 in 0.462s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:23 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-73606b0c-8dff-46b7-beab-99cfee23fc16 tempest-VolumeDependencyTests-83919300 None] Lock "cinder-fb9985c5-0f9d-4cae-b37d-a40451610be2-delete_volume" released by "delete_volume" :: held 1.515s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:41:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-dc818259-7d34-4d57-ab66-a21bf82f340e tempest-CreateVolumesFromImageTest-463197901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-e495e853-dc18-4dfc-9554-813e30e9a720 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:23 devstack sudo[107569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-e495e853-dc18-4dfc-9554-813e30e9a720 Nov 06 15:41:23 devstack sudo[107569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:24 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-105e23f1-fe76-4756-9e77-d9b50b1bb6cb tempest-CreateVolumesFromSnapshotTest-597264870 None] Acquiring lock "cinder-d0918bd2-734a-419a-a15d-262b6c34503d-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:41:24 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-105e23f1-fe76-4756-9e77-d9b50b1bb6cb tempest-CreateVolumesFromSnapshotTest-597264870 None] Lock "cinder-d0918bd2-734a-419a-a15d-262b6c34503d-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:41:24 devstack sudo[107569]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-dc818259-7d34-4d57-ab66-a21bf82f340e tempest-CreateVolumesFromImageTest-463197901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-e495e853-dc18-4dfc-9554-813e30e9a720" returned: 0 in 0.271s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:24 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-dc818259-7d34-4d57-ab66-a21bf82f340e tempest-CreateVolumesFromImageTest-463197901 None] <== create_volume: return (782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:41:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-dc818259-7d34-4d57-ab66-a21bf82f340e tempest-CreateVolumesFromImageTest-463197901 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.785s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:41:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-d30fc01c-8782-4966-ae4f-7b859e82114d tempest-CreateVolumesFromImageTest-463197901 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.585s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:41:24 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-d30fc01c-8782-4966-ae4f-7b859e82114d tempest-CreateVolumesFromImageTest-463197901 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:41:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1014546828',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed3c210a-3524-43ec-9838-e296b5c9642d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='293de253becd4c3eb05b5355db62af32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:41:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:41:20Z,use_quota=True,user_id='f79dac2101724a7cad74f7796b2e62b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:41:24 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-d30fc01c-8782-4966-ae4f-7b859e82114d tempest-CreateVolumesFromImageTest-463197901 None] Creating volume ed3c210a-3524-43ec-9838-e296b5c9642d {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:41:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-d30fc01c-8782-4966-ae4f-7b859e82114d tempest-CreateVolumesFromImageTest-463197901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:41:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-d30fc01c-8782-4966-ae4f-7b859e82114d tempest-CreateVolumesFromImageTest-463197901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:41:24 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-d30fc01c-8782-4966-ae4f-7b859e82114d tempest-CreateVolumesFromImageTest-463197901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:41:24 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-d30fc01c-8782-4966-ae4f-7b859e82114d tempest-CreateVolumesFromImageTest-463197901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:41:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-d30fc01c-8782-4966-ae4f-7b859e82114d tempest-CreateVolumesFromImageTest-463197901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:41:24 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-d30fc01c-8782-4966-ae4f-7b859e82114d tempest-CreateVolumesFromImageTest-463197901 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:41:24 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-d30fc01c-8782-4966-ae4f-7b859e82114d tempest-CreateVolumesFromImageTest-463197901 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:41:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d30fc01c-8782-4966-ae4f-7b859e82114d tempest-CreateVolumesFromImageTest-463197901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ed3c210a-3524-43ec-9838-e296b5c9642d 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:24 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-105e23f1-fe76-4756-9e77-d9b50b1bb6cb tempest-CreateVolumesFromSnapshotTest-597264870 None] Acquiring lock "cinder-quobyte-d0918bd2-734a-419a-a15d-262b6c34503d" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:41:24 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-dc818259-7d34-4d57-ab66-a21bf82f340e tempest-CreateVolumesFromImageTest-463197901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (060773d9-aa85-4ca9-9dc0-b2f109fef990) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e495e853-dc18-4dfc-9554-813e30e9a720', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:24 devstack sudo[107572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ed3c210a-3524-43ec-9838-e296b5c9642d 1073741824 Nov 06 15:41:24 devstack sudo[107572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:24 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-dc818259-7d34-4d57-ab66-a21bf82f340e tempest-CreateVolumesFromImageTest-463197901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15b34ad7-3cd7-403a-be49-beb3e0413f7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:24 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-105e23f1-fe76-4756-9e77-d9b50b1bb6cb tempest-CreateVolumesFromSnapshotTest-597264870 None] Lock "cinder-quobyte-d0918bd2-734a-419a-a15d-262b6c34503d" acquired by "delete_volume" :: waited 0.029s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:41:24 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-dc818259-7d34-4d57-ab66-a21bf82f340e tempest-CreateVolumesFromImageTest-463197901 None] Volume volume-e495e853-dc18-4dfc-9554-813e30e9a720 (e495e853-dc18-4dfc-9554-813e30e9a720): created successfully Nov 06 15:41:24 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-dc818259-7d34-4d57-ab66-a21bf82f340e tempest-CreateVolumesFromImageTest-463197901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15b34ad7-3cd7-403a-be49-beb3e0413f7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:24 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-dc818259-7d34-4d57-ab66-a21bf82f340e tempest-CreateVolumesFromImageTest-463197901 None] Flow 'volume_create_manager' (f89b948b-3ea2-4dc7-930d-2a0f9bd22cb1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:41:24 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcf398c8-d22a-4e04-86eb-6ede8bc86d0e]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:41:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-105e23f1-fe76-4756-9e77-d9b50b1bb6cb tempest-CreateVolumesFromSnapshotTest-597264870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d0918bd2-734a-419a-a15d-262b6c34503d {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:24 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-dc818259-7d34-4d57-ab66-a21bf82f340e tempest-CreateVolumesFromImageTest-463197901 None] Created volume successfully. Nov 06 15:41:24 devstack sudo[107574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d0918bd2-734a-419a-a15d-262b6c34503d Nov 06 15:41:24 devstack sudo[107574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:24 devstack sudo[107574]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:24 devstack sudo[107572]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-105e23f1-fe76-4756-9e77-d9b50b1bb6cb tempest-CreateVolumesFromSnapshotTest-597264870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d0918bd2-734a-419a-a15d-262b6c34503d" returned: 0 in 0.396s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-105e23f1-fe76-4756-9e77-d9b50b1bb6cb tempest-CreateVolumesFromSnapshotTest-597264870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d0918bd2-734a-419a-a15d-262b6c34503d {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d30fc01c-8782-4966-ae4f-7b859e82114d tempest-CreateVolumesFromImageTest-463197901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ed3c210a-3524-43ec-9838-e296b5c9642d 1073741824" returned: 0 in 0.491s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:24 devstack sudo[107583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d0918bd2-734a-419a-a15d-262b6c34503d Nov 06 15:41:24 devstack sudo[107583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d30fc01c-8782-4966-ae4f-7b859e82114d tempest-CreateVolumesFromImageTest-463197901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ed3c210a-3524-43ec-9838-e296b5c9642d {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:24 devstack sudo[107585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ed3c210a-3524-43ec-9838-e296b5c9642d Nov 06 15:41:24 devstack sudo[107585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:24 devstack sudo[107583]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-105e23f1-fe76-4756-9e77-d9b50b1bb6cb tempest-CreateVolumesFromSnapshotTest-597264870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d0918bd2-734a-419a-a15d-262b6c34503d" returned: 0 in 0.305s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:24 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-105e23f1-fe76-4756-9e77-d9b50b1bb6cb tempest-CreateVolumesFromSnapshotTest-597264870 None] Lock "cinder-quobyte-d0918bd2-734a-419a-a15d-262b6c34503d" released by "delete_volume" :: held 0.753s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:41:24 devstack sudo[107585]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d30fc01c-8782-4966-ae4f-7b859e82114d tempest-CreateVolumesFromImageTest-463197901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ed3c210a-3524-43ec-9838-e296b5c9642d" returned: 0 in 0.277s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:24 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-d30fc01c-8782-4966-ae4f-7b859e82114d tempest-CreateVolumesFromImageTest-463197901 None] <== create_volume: return (817ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:41:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-d30fc01c-8782-4966-ae4f-7b859e82114d tempest-CreateVolumesFromImageTest-463197901 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.820s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:41:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-fccc43cf-4239-42c2-98ec-acb24d2191dd tempest-CreateVolumesFromImageTest-463197901 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.052s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:41:24 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-fccc43cf-4239-42c2-98ec-acb24d2191dd tempest-CreateVolumesFromImageTest-463197901 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:41:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-281191428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba528664-970b-4c9b-a9fd-e1c205191cef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='293de253becd4c3eb05b5355db62af32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:41:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:41:21Z,use_quota=True,user_id='f79dac2101724a7cad74f7796b2e62b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:41:24 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-fccc43cf-4239-42c2-98ec-acb24d2191dd tempest-CreateVolumesFromImageTest-463197901 None] Creating volume ba528664-970b-4c9b-a9fd-e1c205191cef {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:41:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-fccc43cf-4239-42c2-98ec-acb24d2191dd tempest-CreateVolumesFromImageTest-463197901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:41:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-fccc43cf-4239-42c2-98ec-acb24d2191dd tempest-CreateVolumesFromImageTest-463197901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:41:24 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-fccc43cf-4239-42c2-98ec-acb24d2191dd tempest-CreateVolumesFromImageTest-463197901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:41:24 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-fccc43cf-4239-42c2-98ec-acb24d2191dd tempest-CreateVolumesFromImageTest-463197901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:41:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-fccc43cf-4239-42c2-98ec-acb24d2191dd tempest-CreateVolumesFromImageTest-463197901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:41:24 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-fccc43cf-4239-42c2-98ec-acb24d2191dd tempest-CreateVolumesFromImageTest-463197901 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:41:24 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-fccc43cf-4239-42c2-98ec-acb24d2191dd tempest-CreateVolumesFromImageTest-463197901 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:41:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-fccc43cf-4239-42c2-98ec-acb24d2191dd tempest-CreateVolumesFromImageTest-463197901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ba528664-970b-4c9b-a9fd-e1c205191cef 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:24 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d30fc01c-8782-4966-ae4f-7b859e82114d tempest-CreateVolumesFromImageTest-463197901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efa0d74b-8255-4550-9307-4d11084636cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed3c210a-3524-43ec-9838-e296b5c9642d', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:24 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d30fc01c-8782-4966-ae4f-7b859e82114d tempest-CreateVolumesFromImageTest-463197901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d07f3f9-d8f2-4812-803a-3aef69e723da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:24 devstack sudo[107589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ba528664-970b-4c9b-a9fd-e1c205191cef 1073741824 Nov 06 15:41:25 devstack sudo[107589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:25 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-d30fc01c-8782-4966-ae4f-7b859e82114d tempest-CreateVolumesFromImageTest-463197901 None] Volume volume-ed3c210a-3524-43ec-9838-e296b5c9642d (ed3c210a-3524-43ec-9838-e296b5c9642d): created successfully Nov 06 15:41:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d30fc01c-8782-4966-ae4f-7b859e82114d tempest-CreateVolumesFromImageTest-463197901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d07f3f9-d8f2-4812-803a-3aef69e723da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d30fc01c-8782-4966-ae4f-7b859e82114d tempest-CreateVolumesFromImageTest-463197901 None] Flow 'volume_create_manager' (9f4d589e-0acd-4095-954c-2364b0f654e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:41:25 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-d30fc01c-8782-4966-ae4f-7b859e82114d tempest-CreateVolumesFromImageTest-463197901 None] Created volume successfully. Nov 06 15:41:25 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-105e23f1-fe76-4756-9e77-d9b50b1bb6cb tempest-CreateVolumesFromSnapshotTest-597264870 None] Created reservations ['b9d7c53e-e997-47b7-8827-cfa9782f6733', '10745720-2a2a-443b-ba15-11a3f6bef473', 'eefeed31-0985-4fd3-8334-5dbbae2cc566', '541718f2-9ba8-4f68-a72c-e7eca972935b'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:41:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-105e23f1-fe76-4756-9e77-d9b50b1bb6cb tempest-CreateVolumesFromSnapshotTest-597264870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:41:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-105e23f1-fe76-4756-9e77-d9b50b1bb6cb tempest-CreateVolumesFromSnapshotTest-597264870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:41:25 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-105e23f1-fe76-4756-9e77-d9b50b1bb6cb tempest-CreateVolumesFromSnapshotTest-597264870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:41:25 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-105e23f1-fe76-4756-9e77-d9b50b1bb6cb tempest-CreateVolumesFromSnapshotTest-597264870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:41:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-105e23f1-fe76-4756-9e77-d9b50b1bb6cb tempest-CreateVolumesFromSnapshotTest-597264870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:41:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-105e23f1-fe76-4756-9e77-d9b50b1bb6cb tempest-CreateVolumesFromSnapshotTest-597264870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:25 devstack sudo[107591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:41:25 devstack sudo[107591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:25 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e7ba5ff8-b17d-455c-93fc-59fc67b264ed tempest-CreateVolumesFromSnapshotTest-597264870 None] Acquiring lock "cinder-e1926635-b302-4c66-bd42-9b1cbaafe041-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:41:25 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e7ba5ff8-b17d-455c-93fc-59fc67b264ed tempest-CreateVolumesFromSnapshotTest-597264870 None] Lock "cinder-e1926635-b302-4c66-bd42-9b1cbaafe041-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:41:25 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e7ba5ff8-b17d-455c-93fc-59fc67b264ed tempest-CreateVolumesFromSnapshotTest-597264870 None] Acquiring lock "cinder-quobyte-e1926635-b302-4c66-bd42-9b1cbaafe041" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:41:25 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e7ba5ff8-b17d-455c-93fc-59fc67b264ed tempest-CreateVolumesFromSnapshotTest-597264870 None] Lock "cinder-quobyte-e1926635-b302-4c66-bd42-9b1cbaafe041" acquired by "delete_volume" :: waited 0.023s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:41:25 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[403a722a-807f-4d43-ad1a-95b2b9069b40]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:41:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e7ba5ff8-b17d-455c-93fc-59fc67b264ed tempest-CreateVolumesFromSnapshotTest-597264870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-e1926635-b302-4c66-bd42-9b1cbaafe041 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:25 devstack sudo[107591]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-105e23f1-fe76-4756-9e77-d9b50b1bb6cb tempest-CreateVolumesFromSnapshotTest-597264870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.349s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:25 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-105e23f1-fe76-4756-9e77-d9b50b1bb6cb tempest-CreateVolumesFromSnapshotTest-597264870 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:41:25 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-105e23f1-fe76-4756-9e77-d9b50b1bb6cb tempest-CreateVolumesFromSnapshotTest-597264870 None] Deleted volume successfully. Nov 06 15:41:25 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-105e23f1-fe76-4756-9e77-d9b50b1bb6cb tempest-CreateVolumesFromSnapshotTest-597264870 None] Lock "cinder-d0918bd2-734a-419a-a15d-262b6c34503d-delete_volume" released by "delete_volume" :: held 1.490s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:41:25 devstack sudo[107589]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-fccc43cf-4239-42c2-98ec-acb24d2191dd tempest-CreateVolumesFromImageTest-463197901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ba528664-970b-4c9b-a9fd-e1c205191cef 1073741824" returned: 0 in 0.626s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:25 devstack sudo[107597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-e1926635-b302-4c66-bd42-9b1cbaafe041 Nov 06 15:41:25 devstack sudo[107597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-fccc43cf-4239-42c2-98ec-acb24d2191dd tempest-CreateVolumesFromImageTest-463197901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ba528664-970b-4c9b-a9fd-e1c205191cef {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:25 devstack sudo[107600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ba528664-970b-4c9b-a9fd-e1c205191cef Nov 06 15:41:25 devstack sudo[107600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:25 devstack sudo[107597]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e7ba5ff8-b17d-455c-93fc-59fc67b264ed tempest-CreateVolumesFromSnapshotTest-597264870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-e1926635-b302-4c66-bd42-9b1cbaafe041" returned: 0 in 0.467s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e7ba5ff8-b17d-455c-93fc-59fc67b264ed tempest-CreateVolumesFromSnapshotTest-597264870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-e1926635-b302-4c66-bd42-9b1cbaafe041 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:25 devstack sudo[107600]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-fccc43cf-4239-42c2-98ec-acb24d2191dd tempest-CreateVolumesFromImageTest-463197901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ba528664-970b-4c9b-a9fd-e1c205191cef" returned: 0 in 0.304s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:25 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-fccc43cf-4239-42c2-98ec-acb24d2191dd tempest-CreateVolumesFromImageTest-463197901 None] <== create_volume: return (975ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:41:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-fccc43cf-4239-42c2-98ec-acb24d2191dd tempest-CreateVolumesFromImageTest-463197901 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.979s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:41:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ecade892-fc22-4fba-8a18-4378df60798d tempest-CinderUnicodeTest-485864985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.068s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:41:25 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-ecade892-fc22-4fba-8a18-4378df60798d tempest-CinderUnicodeTest-485864985 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:41:22Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-839440588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21c68185-d00b-498e-b90b-98ca8c09f468,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cc93baf2a004ec0a4d22d1ec403e886',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:41:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:41:23Z,use_quota=True,user_id='064addf5f3734e1b980c2e32adfd8a1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:41:25 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-ecade892-fc22-4fba-8a18-4378df60798d tempest-CinderUnicodeTest-485864985 None] Creating volume 21c68185-d00b-498e-b90b-98ca8c09f468 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:41:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ecade892-fc22-4fba-8a18-4378df60798d tempest-CinderUnicodeTest-485864985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:41:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ecade892-fc22-4fba-8a18-4378df60798d tempest-CinderUnicodeTest-485864985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:41:25 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-ecade892-fc22-4fba-8a18-4378df60798d tempest-CinderUnicodeTest-485864985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:41:25 devstack sudo[107607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-e1926635-b302-4c66-bd42-9b1cbaafe041 Nov 06 15:41:25 devstack sudo[107607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:25 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-ecade892-fc22-4fba-8a18-4378df60798d tempest-CinderUnicodeTest-485864985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:41:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ecade892-fc22-4fba-8a18-4378df60798d tempest-CinderUnicodeTest-485864985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:41:25 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-ecade892-fc22-4fba-8a18-4378df60798d tempest-CinderUnicodeTest-485864985 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:41:25 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-ecade892-fc22-4fba-8a18-4378df60798d tempest-CinderUnicodeTest-485864985 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:41:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ecade892-fc22-4fba-8a18-4378df60798d tempest-CinderUnicodeTest-485864985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-21c68185-d00b-498e-b90b-98ca8c09f468 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fccc43cf-4239-42c2-98ec-acb24d2191dd tempest-CreateVolumesFromImageTest-463197901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0763c5b-5831-48fa-a6f1-4e6f9285c62a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba528664-970b-4c9b-a9fd-e1c205191cef', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fccc43cf-4239-42c2-98ec-acb24d2191dd tempest-CreateVolumesFromImageTest-463197901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (045d403c-eab3-4b5b-91d1-92dbf19cb10b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:25 devstack sudo[107609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-21c68185-d00b-498e-b90b-98ca8c09f468 1073741824 Nov 06 15:41:25 devstack sudo[107609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:26 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-fccc43cf-4239-42c2-98ec-acb24d2191dd tempest-CreateVolumesFromImageTest-463197901 None] Volume volume-ba528664-970b-4c9b-a9fd-e1c205191cef (ba528664-970b-4c9b-a9fd-e1c205191cef): created successfully Nov 06 15:41:26 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fccc43cf-4239-42c2-98ec-acb24d2191dd tempest-CreateVolumesFromImageTest-463197901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (045d403c-eab3-4b5b-91d1-92dbf19cb10b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:26 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fccc43cf-4239-42c2-98ec-acb24d2191dd tempest-CreateVolumesFromImageTest-463197901 None] Flow 'volume_create_manager' (7c5daefa-2336-45bd-b449-e388f8c45f4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:41:26 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-fccc43cf-4239-42c2-98ec-acb24d2191dd tempest-CreateVolumesFromImageTest-463197901 None] Created volume successfully. Nov 06 15:41:26 devstack sudo[107607]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e7ba5ff8-b17d-455c-93fc-59fc67b264ed tempest-CreateVolumesFromSnapshotTest-597264870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-e1926635-b302-4c66-bd42-9b1cbaafe041" returned: 0 in 0.292s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:26 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e7ba5ff8-b17d-455c-93fc-59fc67b264ed tempest-CreateVolumesFromSnapshotTest-597264870 None] Lock "cinder-quobyte-e1926635-b302-4c66-bd42-9b1cbaafe041" released by "delete_volume" :: held 0.815s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:41:26 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-e7ba5ff8-b17d-455c-93fc-59fc67b264ed tempest-CreateVolumesFromSnapshotTest-597264870 None] Created reservations ['730b5741-98d1-48b8-9323-a1ccaf87f0c4', 'e10be60f-dba8-47c7-ba04-b6f9bd575b3d', '47274254-81f0-45cf-8451-8df3308a0866', '118429f2-06f9-425b-80f1-568c760833a1'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:41:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e7ba5ff8-b17d-455c-93fc-59fc67b264ed tempest-CreateVolumesFromSnapshotTest-597264870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:41:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e7ba5ff8-b17d-455c-93fc-59fc67b264ed tempest-CreateVolumesFromSnapshotTest-597264870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:41:26 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e7ba5ff8-b17d-455c-93fc-59fc67b264ed tempest-CreateVolumesFromSnapshotTest-597264870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:41:26 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e7ba5ff8-b17d-455c-93fc-59fc67b264ed tempest-CreateVolumesFromSnapshotTest-597264870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:41:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e7ba5ff8-b17d-455c-93fc-59fc67b264ed tempest-CreateVolumesFromSnapshotTest-597264870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:41:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e7ba5ff8-b17d-455c-93fc-59fc67b264ed tempest-CreateVolumesFromSnapshotTest-597264870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:26 devstack sudo[107616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:41:26 devstack sudo[107616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:26 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-83c1bd40-a94b-4eb9-a757-4384e10ef185 tempest-CreateVolumesFromSnapshotTest-597264870 None] Acquiring lock "cinder-31a9eed7-eb24-4406-9bfd-3f203ef984c1-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:41:26 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-bfc97faf-fd0e-4b86-99a3-a298631961d5 tempest-CreateVolumesFromImageTest-463197901 None] Acquiring lock "cinder-ba528664-970b-4c9b-a9fd-e1c205191cef-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:41:26 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-83c1bd40-a94b-4eb9-a757-4384e10ef185 tempest-CreateVolumesFromSnapshotTest-597264870 None] Lock "cinder-31a9eed7-eb24-4406-9bfd-3f203ef984c1-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:41:26 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-bfc97faf-fd0e-4b86-99a3-a298631961d5 tempest-CreateVolumesFromImageTest-463197901 None] Lock "cinder-ba528664-970b-4c9b-a9fd-e1c205191cef-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:41:26 devstack sudo[107609]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ecade892-fc22-4fba-8a18-4378df60798d tempest-CinderUnicodeTest-485864985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-21c68185-d00b-498e-b90b-98ca8c09f468 1073741824" returned: 0 in 0.619s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:26 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-bfc97faf-fd0e-4b86-99a3-a298631961d5 tempest-CreateVolumesFromImageTest-463197901 None] Acquiring lock "cinder-quobyte-ba528664-970b-4c9b-a9fd-e1c205191cef" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:41:26 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-83c1bd40-a94b-4eb9-a757-4384e10ef185 tempest-CreateVolumesFromSnapshotTest-597264870 None] Acquiring lock "cinder-quobyte-31a9eed7-eb24-4406-9bfd-3f203ef984c1" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:41:26 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-bfc97faf-fd0e-4b86-99a3-a298631961d5 tempest-CreateVolumesFromImageTest-463197901 None] Lock "cinder-quobyte-ba528664-970b-4c9b-a9fd-e1c205191cef" acquired by "delete_volume" :: waited 0.056s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:41:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ecade892-fc22-4fba-8a18-4378df60798d tempest-CinderUnicodeTest-485864985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-21c68185-d00b-498e-b90b-98ca8c09f468 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:26 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-83c1bd40-a94b-4eb9-a757-4384e10ef185 tempest-CreateVolumesFromSnapshotTest-597264870 None] Lock "cinder-quobyte-31a9eed7-eb24-4406-9bfd-3f203ef984c1" acquired by "delete_volume" :: waited 0.070s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:41:26 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc0519ab-2234-44a5-b066-30eaf6e0d3c8]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:41:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bfc97faf-fd0e-4b86-99a3-a298631961d5 tempest-CreateVolumesFromImageTest-463197901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ba528664-970b-4c9b-a9fd-e1c205191cef {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:26 devstack sudo[107618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-21c68185-d00b-498e-b90b-98ca8c09f468 Nov 06 15:41:26 devstack sudo[107618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:26 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[28495234-2da1-4fd6-ab12-f315e8023dcd]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:41:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-83c1bd40-a94b-4eb9-a757-4384e10ef185 tempest-CreateVolumesFromSnapshotTest-597264870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-31a9eed7-eb24-4406-9bfd-3f203ef984c1 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:26 devstack sudo[107616]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e7ba5ff8-b17d-455c-93fc-59fc67b264ed tempest-CreateVolumesFromSnapshotTest-597264870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.479s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:26 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-e7ba5ff8-b17d-455c-93fc-59fc67b264ed tempest-CreateVolumesFromSnapshotTest-597264870 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:41:26 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-e7ba5ff8-b17d-455c-93fc-59fc67b264ed tempest-CreateVolumesFromSnapshotTest-597264870 None] Deleted volume successfully. Nov 06 15:41:26 devstack sudo[107620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ba528664-970b-4c9b-a9fd-e1c205191cef Nov 06 15:41:26 devstack sudo[107620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:26 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e7ba5ff8-b17d-455c-93fc-59fc67b264ed tempest-CreateVolumesFromSnapshotTest-597264870 None] Lock "cinder-e1926635-b302-4c66-bd42-9b1cbaafe041-delete_volume" released by "delete_volume" :: held 1.587s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:41:26 devstack sudo[107621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-31a9eed7-eb24-4406-9bfd-3f203ef984c1 Nov 06 15:41:26 devstack sudo[107621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:27 devstack sudo[107618]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ecade892-fc22-4fba-8a18-4378df60798d tempest-CinderUnicodeTest-485864985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-21c68185-d00b-498e-b90b-98ca8c09f468" returned: 0 in 0.378s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:27 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-ecade892-fc22-4fba-8a18-4378df60798d tempest-CinderUnicodeTest-485864985 None] <== create_volume: return (1121ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:41:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ecade892-fc22-4fba-8a18-4378df60798d tempest-CinderUnicodeTest-485864985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.125s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:41:27 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ecade892-fc22-4fba-8a18-4378df60798d tempest-CinderUnicodeTest-485864985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fb41dfb-82bb-437a-ad19-1895ea121d0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21c68185-d00b-498e-b90b-98ca8c09f468', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:27 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ecade892-fc22-4fba-8a18-4378df60798d tempest-CinderUnicodeTest-485864985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (695128b2-6585-4482-8582-7dd01ba4086a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:27 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-ecade892-fc22-4fba-8a18-4378df60798d tempest-CinderUnicodeTest-485864985 None] Volume volume-21c68185-d00b-498e-b90b-98ca8c09f468 (21c68185-d00b-498e-b90b-98ca8c09f468): created successfully Nov 06 15:41:27 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ecade892-fc22-4fba-8a18-4378df60798d tempest-CinderUnicodeTest-485864985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (695128b2-6585-4482-8582-7dd01ba4086a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:27 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ecade892-fc22-4fba-8a18-4378df60798d tempest-CinderUnicodeTest-485864985 None] Flow 'volume_create_manager' (a95e620f-110e-4908-af29-e924b3caa1b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:41:27 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-ecade892-fc22-4fba-8a18-4378df60798d tempest-CinderUnicodeTest-485864985 None] Created volume successfully. Nov 06 15:41:27 devstack sudo[107620]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bfc97faf-fd0e-4b86-99a3-a298631961d5 tempest-CreateVolumesFromImageTest-463197901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ba528664-970b-4c9b-a9fd-e1c205191cef" returned: 0 in 0.477s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bfc97faf-fd0e-4b86-99a3-a298631961d5 tempest-CreateVolumesFromImageTest-463197901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ba528664-970b-4c9b-a9fd-e1c205191cef {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:27 devstack sudo[107621]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-83c1bd40-a94b-4eb9-a757-4384e10ef185 tempest-CreateVolumesFromSnapshotTest-597264870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-31a9eed7-eb24-4406-9bfd-3f203ef984c1" returned: 0 in 0.487s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-83c1bd40-a94b-4eb9-a757-4384e10ef185 tempest-CreateVolumesFromSnapshotTest-597264870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-31a9eed7-eb24-4406-9bfd-3f203ef984c1 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:27 devstack sudo[107632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ba528664-970b-4c9b-a9fd-e1c205191cef Nov 06 15:41:27 devstack sudo[107632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:27 devstack sudo[107634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-31a9eed7-eb24-4406-9bfd-3f203ef984c1 Nov 06 15:41:27 devstack sudo[107634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:27 devstack sudo[107632]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bfc97faf-fd0e-4b86-99a3-a298631961d5 tempest-CreateVolumesFromImageTest-463197901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ba528664-970b-4c9b-a9fd-e1c205191cef" returned: 0 in 0.272s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:27 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-bfc97faf-fd0e-4b86-99a3-a298631961d5 tempest-CreateVolumesFromImageTest-463197901 None] Lock "cinder-quobyte-ba528664-970b-4c9b-a9fd-e1c205191cef" released by "delete_volume" :: held 0.838s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:41:27 devstack sudo[107634]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-83c1bd40-a94b-4eb9-a757-4384e10ef185 tempest-CreateVolumesFromSnapshotTest-597264870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-31a9eed7-eb24-4406-9bfd-3f203ef984c1" returned: 0 in 0.278s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:27 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-83c1bd40-a94b-4eb9-a757-4384e10ef185 tempest-CreateVolumesFromSnapshotTest-597264870 None] Lock "cinder-quobyte-31a9eed7-eb24-4406-9bfd-3f203ef984c1" released by "delete_volume" :: held 0.823s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:41:27 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-bfc97faf-fd0e-4b86-99a3-a298631961d5 tempest-CreateVolumesFromImageTest-463197901 None] Created reservations ['37288195-2f55-40f1-90cf-dfef9f3bcd2d', '38df5760-0be6-487b-a1a7-1c02ebda083e', 'b8a962c3-6559-46f4-946f-ddf85af5ab38', 'f7b09342-ef4b-46c2-b533-994f2200f66a'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:41:27 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-83c1bd40-a94b-4eb9-a757-4384e10ef185 tempest-CreateVolumesFromSnapshotTest-597264870 None] Created reservations ['09642084-9561-4bfa-b77d-983c8b0664d5', '6bf596cb-919b-4721-b693-209c017e7f24', '712858c9-ef5f-49d1-a45b-4277ff8ff1b1', '0431ff00-8102-42bb-bdb4-c223d1cb40b3'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:41:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-bfc97faf-fd0e-4b86-99a3-a298631961d5 tempest-CreateVolumesFromImageTest-463197901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:41:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-bfc97faf-fd0e-4b86-99a3-a298631961d5 tempest-CreateVolumesFromImageTest-463197901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:41:27 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-bfc97faf-fd0e-4b86-99a3-a298631961d5 tempest-CreateVolumesFromImageTest-463197901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:41:27 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-bfc97faf-fd0e-4b86-99a3-a298631961d5 tempest-CreateVolumesFromImageTest-463197901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:41:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-bfc97faf-fd0e-4b86-99a3-a298631961d5 tempest-CreateVolumesFromImageTest-463197901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:41:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bfc97faf-fd0e-4b86-99a3-a298631961d5 tempest-CreateVolumesFromImageTest-463197901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:27 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c48f2606-e72d-4af0-9f43-45eedc418b0b tempest-CreateVolumesFromSnapshotTest-597264870 None] Acquiring lock "cinder-5843b160-6efd-4d5d-81e2-718ae1fb0e7d-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:41:27 devstack sudo[107638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:41:27 devstack sudo[107638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:27 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-70985b8e-9d6d-443d-9401-023cec302bb1 tempest-CreateVolumesFromImageTest-463197901 None] Acquiring lock "cinder-ed3c210a-3524-43ec-9838-e296b5c9642d-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:41:27 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c48f2606-e72d-4af0-9f43-45eedc418b0b tempest-CreateVolumesFromSnapshotTest-597264870 None] Lock "cinder-5843b160-6efd-4d5d-81e2-718ae1fb0e7d-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:41:27 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-70985b8e-9d6d-443d-9401-023cec302bb1 tempest-CreateVolumesFromImageTest-463197901 None] Lock "cinder-ed3c210a-3524-43ec-9838-e296b5c9642d-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:41:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-83c1bd40-a94b-4eb9-a757-4384e10ef185 tempest-CreateVolumesFromSnapshotTest-597264870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:41:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-83c1bd40-a94b-4eb9-a757-4384e10ef185 tempest-CreateVolumesFromSnapshotTest-597264870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:41:27 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-83c1bd40-a94b-4eb9-a757-4384e10ef185 tempest-CreateVolumesFromSnapshotTest-597264870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:41:27 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-83c1bd40-a94b-4eb9-a757-4384e10ef185 tempest-CreateVolumesFromSnapshotTest-597264870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:41:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-83c1bd40-a94b-4eb9-a757-4384e10ef185 tempest-CreateVolumesFromSnapshotTest-597264870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:41:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-83c1bd40-a94b-4eb9-a757-4384e10ef185 tempest-CreateVolumesFromSnapshotTest-597264870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:27 devstack sudo[107640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:41:27 devstack sudo[107640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:27 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c48f2606-e72d-4af0-9f43-45eedc418b0b tempest-CreateVolumesFromSnapshotTest-597264870 None] Acquiring lock "cinder-quobyte-5843b160-6efd-4d5d-81e2-718ae1fb0e7d" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:41:27 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c48f2606-e72d-4af0-9f43-45eedc418b0b tempest-CreateVolumesFromSnapshotTest-597264870 None] Lock "cinder-quobyte-5843b160-6efd-4d5d-81e2-718ae1fb0e7d" acquired by "delete_volume" :: waited 0.027s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:41:27 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-70985b8e-9d6d-443d-9401-023cec302bb1 tempest-CreateVolumesFromImageTest-463197901 None] Acquiring lock "cinder-quobyte-ed3c210a-3524-43ec-9838-e296b5c9642d" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:41:28 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[28770b3a-499f-449b-aaa4-97f112d7a14c]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:41:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c48f2606-e72d-4af0-9f43-45eedc418b0b tempest-CreateVolumesFromSnapshotTest-597264870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-5843b160-6efd-4d5d-81e2-718ae1fb0e7d {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:28 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-70985b8e-9d6d-443d-9401-023cec302bb1 tempest-CreateVolumesFromImageTest-463197901 None] Lock "cinder-quobyte-ed3c210a-3524-43ec-9838-e296b5c9642d" acquired by "delete_volume" :: waited 0.053s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:41:28 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[056eb709-bd2a-4d7a-8c1a-936bdac7f30c]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:41:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-70985b8e-9d6d-443d-9401-023cec302bb1 tempest-CreateVolumesFromImageTest-463197901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ed3c210a-3524-43ec-9838-e296b5c9642d {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:28 devstack sudo[107638]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bfc97faf-fd0e-4b86-99a3-a298631961d5 tempest-CreateVolumesFromImageTest-463197901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.435s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:28 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-bfc97faf-fd0e-4b86-99a3-a298631961d5 tempest-CreateVolumesFromImageTest-463197901 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:41:28 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-bfc97faf-fd0e-4b86-99a3-a298631961d5 tempest-CreateVolumesFromImageTest-463197901 None] Deleted volume successfully. Nov 06 15:41:28 devstack sudo[107642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-5843b160-6efd-4d5d-81e2-718ae1fb0e7d Nov 06 15:41:28 devstack sudo[107642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:28 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-bfc97faf-fd0e-4b86-99a3-a298631961d5 tempest-CreateVolumesFromImageTest-463197901 None] Lock "cinder-ba528664-970b-4c9b-a9fd-e1c205191cef-delete_volume" released by "delete_volume" :: held 1.666s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:41:28 devstack sudo[107640]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-83c1bd40-a94b-4eb9-a757-4384e10ef185 tempest-CreateVolumesFromSnapshotTest-597264870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.386s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:28 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-83c1bd40-a94b-4eb9-a757-4384e10ef185 tempest-CreateVolumesFromSnapshotTest-597264870 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:41:28 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-83c1bd40-a94b-4eb9-a757-4384e10ef185 tempest-CreateVolumesFromSnapshotTest-597264870 None] Deleted volume successfully. Nov 06 15:41:28 devstack sudo[107644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ed3c210a-3524-43ec-9838-e296b5c9642d Nov 06 15:41:28 devstack sudo[107644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:28 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-83c1bd40-a94b-4eb9-a757-4384e10ef185 tempest-CreateVolumesFromSnapshotTest-597264870 None] Lock "cinder-31a9eed7-eb24-4406-9bfd-3f203ef984c1-delete_volume" released by "delete_volume" :: held 1.759s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:41:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-268e94a9-6db5-4524-984c-8819a2c54b2f tempest-CinderUnicodeTest-485864985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:41:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-268e94a9-6db5-4524-984c-8819a2c54b2f tempest-CinderUnicodeTest-485864985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:41:28 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-268e94a9-6db5-4524-984c-8819a2c54b2f tempest-CinderUnicodeTest-485864985 None] Creating offline snapshot 25cb58f2-3e3a-41dd-a6ce-3dd95d01f370 of volume 21c68185-d00b-498e-b90b-98ca8c09f468 {{(pid=87132) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 15:41:28 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2bc5852-3b93-4180-b524-d50fbe62097b]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:41:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-268e94a9-6db5-4524-984c-8819a2c54b2f tempest-CinderUnicodeTest-485864985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-21c68185-d00b-498e-b90b-98ca8c09f468 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:28 devstack sudo[107642]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c48f2606-e72d-4af0-9f43-45eedc418b0b tempest-CreateVolumesFromSnapshotTest-597264870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-5843b160-6efd-4d5d-81e2-718ae1fb0e7d" returned: 0 in 0.552s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c48f2606-e72d-4af0-9f43-45eedc418b0b tempest-CreateVolumesFromSnapshotTest-597264870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-5843b160-6efd-4d5d-81e2-718ae1fb0e7d {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:28 devstack sudo[107657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-5843b160-6efd-4d5d-81e2-718ae1fb0e7d Nov 06 15:41:28 devstack sudo[107657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:28 devstack sudo[107644]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-70985b8e-9d6d-443d-9401-023cec302bb1 tempest-CreateVolumesFromImageTest-463197901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ed3c210a-3524-43ec-9838-e296b5c9642d" returned: 0 in 0.547s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-70985b8e-9d6d-443d-9401-023cec302bb1 tempest-CreateVolumesFromImageTest-463197901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ed3c210a-3524-43ec-9838-e296b5c9642d {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:28 devstack sudo[107659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ed3c210a-3524-43ec-9838-e296b5c9642d Nov 06 15:41:28 devstack sudo[107659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:28 devstack sudo[107653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-21c68185-d00b-498e-b90b-98ca8c09f468 Nov 06 15:41:28 devstack sudo[107653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:28 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9a918eb5-f3a8-4b35-945d-4fdd76aba118 tempest-ProjectAdminTests-584618879 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.3763389587402, 'free_capacity_gb': 1773.3763389587402, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87132) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 06 15:41:28 devstack sudo[107657]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c48f2606-e72d-4af0-9f43-45eedc418b0b tempest-CreateVolumesFromSnapshotTest-597264870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-5843b160-6efd-4d5d-81e2-718ae1fb0e7d" returned: 0 in 0.347s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:28 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c48f2606-e72d-4af0-9f43-45eedc418b0b tempest-CreateVolumesFromSnapshotTest-597264870 None] Lock "cinder-quobyte-5843b160-6efd-4d5d-81e2-718ae1fb0e7d" released by "delete_volume" :: held 1.004s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:41:28 devstack sudo[107659]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-70985b8e-9d6d-443d-9401-023cec302bb1 tempest-CreateVolumesFromImageTest-463197901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ed3c210a-3524-43ec-9838-e296b5c9642d" returned: 0 in 0.334s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:28 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-70985b8e-9d6d-443d-9401-023cec302bb1 tempest-CreateVolumesFromImageTest-463197901 None] Lock "cinder-quobyte-ed3c210a-3524-43ec-9838-e296b5c9642d" released by "delete_volume" :: held 0.941s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:41:29 devstack sudo[107653]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-268e94a9-6db5-4524-984c-8819a2c54b2f tempest-CinderUnicodeTest-485864985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-21c68185-d00b-498e-b90b-98ca8c09f468" returned: 0 in 0.530s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-268e94a9-6db5-4524-984c-8819a2c54b2f tempest-CinderUnicodeTest-485864985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-21c68185-d00b-498e-b90b-98ca8c09f468,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-21c68185-d00b-498e-b90b-98ca8c09f468.25cb58f2-3e3a-41dd-a6ce-3dd95d01f370 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:29 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-c48f2606-e72d-4af0-9f43-45eedc418b0b tempest-CreateVolumesFromSnapshotTest-597264870 None] Created reservations ['4cc2f57b-b538-43a4-9d41-c99e4f33c001', '85274ec2-14a9-4bbe-ba9b-893475f3e6c1', '2ab03ced-148c-4463-a754-46c1e17e590b', 'f8947069-4255-46b0-be1b-65bacb8da808'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:41:29 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-70985b8e-9d6d-443d-9401-023cec302bb1 tempest-CreateVolumesFromImageTest-463197901 None] Created reservations ['6a4bc185-38af-4df3-b2b2-e194ffd81d0e', '9bbceeb7-44b1-4248-a99b-8650c8d85ba8', 'd6a0c619-4689-4aaf-a386-e58517e7d4c8', '0089d96a-47af-4d9b-9c7f-9e85c092ad2d'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:41:29 devstack sudo[107667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-21c68185-d00b-498e-b90b-98ca8c09f468,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-21c68185-d00b-498e-b90b-98ca8c09f468.25cb58f2-3e3a-41dd-a6ce-3dd95d01f370 1G Nov 06 15:41:29 devstack sudo[107667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c48f2606-e72d-4af0-9f43-45eedc418b0b tempest-CreateVolumesFromSnapshotTest-597264870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:41:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c48f2606-e72d-4af0-9f43-45eedc418b0b tempest-CreateVolumesFromSnapshotTest-597264870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:41:29 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c48f2606-e72d-4af0-9f43-45eedc418b0b tempest-CreateVolumesFromSnapshotTest-597264870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:41:29 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c48f2606-e72d-4af0-9f43-45eedc418b0b tempest-CreateVolumesFromSnapshotTest-597264870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:41:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c48f2606-e72d-4af0-9f43-45eedc418b0b tempest-CreateVolumesFromSnapshotTest-597264870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:41:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c48f2606-e72d-4af0-9f43-45eedc418b0b tempest-CreateVolumesFromSnapshotTest-597264870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:29 devstack sudo[107669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:41:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-70985b8e-9d6d-443d-9401-023cec302bb1 tempest-CreateVolumesFromImageTest-463197901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:41:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-70985b8e-9d6d-443d-9401-023cec302bb1 tempest-CreateVolumesFromImageTest-463197901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:41:29 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-70985b8e-9d6d-443d-9401-023cec302bb1 tempest-CreateVolumesFromImageTest-463197901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:41:29 devstack sudo[107669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:29 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-70985b8e-9d6d-443d-9401-023cec302bb1 tempest-CreateVolumesFromImageTest-463197901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:41:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-70985b8e-9d6d-443d-9401-023cec302bb1 tempest-CreateVolumesFromImageTest-463197901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:41:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-70985b8e-9d6d-443d-9401-023cec302bb1 tempest-CreateVolumesFromImageTest-463197901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:29 devstack sudo[107671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:41:29 devstack sudo[107671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:29 devstack sudo[107669]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c48f2606-e72d-4af0-9f43-45eedc418b0b tempest-CreateVolumesFromSnapshotTest-597264870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.324s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:29 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-c48f2606-e72d-4af0-9f43-45eedc418b0b tempest-CreateVolumesFromSnapshotTest-597264870 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:41:29 devstack sudo[107667]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:29 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-c48f2606-e72d-4af0-9f43-45eedc418b0b tempest-CreateVolumesFromSnapshotTest-597264870 None] Deleted volume successfully. Nov 06 15:41:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-268e94a9-6db5-4524-984c-8819a2c54b2f tempest-CinderUnicodeTest-485864985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-21c68185-d00b-498e-b90b-98ca8c09f468,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-21c68185-d00b-498e-b90b-98ca8c09f468.25cb58f2-3e3a-41dd-a6ce-3dd95d01f370 1G" returned: 0 in 0.455s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-268e94a9-6db5-4524-984c-8819a2c54b2f tempest-CinderUnicodeTest-485864985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21c68185-d00b-498e-b90b-98ca8c09f468 -F qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-21c68185-d00b-498e-b90b-98ca8c09f468.25cb58f2-3e3a-41dd-a6ce-3dd95d01f370 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:29 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c48f2606-e72d-4af0-9f43-45eedc418b0b tempest-CreateVolumesFromSnapshotTest-597264870 None] Lock "cinder-5843b160-6efd-4d5d-81e2-718ae1fb0e7d-delete_volume" released by "delete_volume" :: held 1.735s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:41:29 devstack sudo[107680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21c68185-d00b-498e-b90b-98ca8c09f468 -F qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-21c68185-d00b-498e-b90b-98ca8c09f468.25cb58f2-3e3a-41dd-a6ce-3dd95d01f370 Nov 06 15:41:29 devstack sudo[107680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:29 devstack sudo[107671]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-70985b8e-9d6d-443d-9401-023cec302bb1 tempest-CreateVolumesFromImageTest-463197901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.339s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:29 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-70985b8e-9d6d-443d-9401-023cec302bb1 tempest-CreateVolumesFromImageTest-463197901 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:41:29 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-70985b8e-9d6d-443d-9401-023cec302bb1 tempest-CreateVolumesFromImageTest-463197901 None] Deleted volume successfully. Nov 06 15:41:29 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-70985b8e-9d6d-443d-9401-023cec302bb1 tempest-CreateVolumesFromImageTest-463197901 None] Lock "cinder-ed3c210a-3524-43ec-9838-e296b5c9642d-delete_volume" released by "delete_volume" :: held 1.763s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:41:29 devstack sudo[107680]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-268e94a9-6db5-4524-984c-8819a2c54b2f tempest-CinderUnicodeTest-485864985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21c68185-d00b-498e-b90b-98ca8c09f468 -F qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-21c68185-d00b-498e-b90b-98ca8c09f468.25cb58f2-3e3a-41dd-a6ce-3dd95d01f370" returned: 0 in 0.311s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:29 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-268e94a9-6db5-4524-984c-8819a2c54b2f tempest-CinderUnicodeTest-485864985 None] /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-21c68185-d00b-498e-b90b-98ca8c09f468.25cb58f2-3e3a-41dd-a6ce-3dd95d01f370 is being set with open permissions: ugo+rw Nov 06 15:41:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-268e94a9-6db5-4524-984c-8819a2c54b2f tempest-CinderUnicodeTest-485864985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-21c68185-d00b-498e-b90b-98ca8c09f468.25cb58f2-3e3a-41dd-a6ce-3dd95d01f370 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:29 devstack sudo[107685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-21c68185-d00b-498e-b90b-98ca8c09f468.25cb58f2-3e3a-41dd-a6ce-3dd95d01f370 Nov 06 15:41:29 devstack sudo[107685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:30 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-1e1b5cdf-e8d3-4b53-b14a-5f079f3f668c tempest-CreateVolumesFromSnapshotTest-597264870 None] Acquiring lock "cinder-b262df46-516c-4a3b-b1d7-26a097a26e42-delete_snapshot" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:41:30 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-1e1b5cdf-e8d3-4b53-b14a-5f079f3f668c tempest-CreateVolumesFromSnapshotTest-597264870 None] Lock "cinder-b262df46-516c-4a3b-b1d7-26a097a26e42-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:41:30 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-1e1b5cdf-e8d3-4b53-b14a-5f079f3f668c tempest-CreateVolumesFromSnapshotTest-597264870 None] Acquiring lock "cinder-quobyte-4aa4c9ca-068b-4ce6-b155-59c0e6df9dd7" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:41:30 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-1e1b5cdf-e8d3-4b53-b14a-5f079f3f668c tempest-CreateVolumesFromSnapshotTest-597264870 None] Lock "cinder-quobyte-4aa4c9ca-068b-4ce6-b155-59c0e6df9dd7" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:41:30 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-1e1b5cdf-e8d3-4b53-b14a-5f079f3f668c tempest-CreateVolumesFromSnapshotTest-597264870 None] Acquiring lock "cinder-quobyte-b262df46-516c-4a3b-b1d7-26a097a26e42" by "_delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:41:30 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e8da8cd2-01c2-4bc3-be71-d87b8425f4c6 tempest-CreateVolumesFromImageTest-463197901 None] Acquiring lock "cinder-e495e853-dc18-4dfc-9554-813e30e9a720-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:41:30 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-1e1b5cdf-e8d3-4b53-b14a-5f079f3f668c tempest-CreateVolumesFromSnapshotTest-597264870 None] Lock "cinder-quobyte-b262df46-516c-4a3b-b1d7-26a097a26e42" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:41:30 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-1e1b5cdf-e8d3-4b53-b14a-5f079f3f668c tempest-CreateVolumesFromSnapshotTest-597264870 None] Deleting offline snapshot b262df46-516c-4a3b-b1d7-26a097a26e42 of volume 4aa4c9ca-068b-4ce6-b155-59c0e6df9dd7 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 15:41:30 devstack sudo[107685]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:30 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-1e1b5cdf-e8d3-4b53-b14a-5f079f3f668c tempest-CreateVolumesFromSnapshotTest-597264870 None] snapshot_file for this snap is: volume-4aa4c9ca-068b-4ce6-b155-59c0e6df9dd7.b262df46-516c-4a3b-b1d7-26a097a26e42 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 15:41:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-268e94a9-6db5-4524-984c-8819a2c54b2f tempest-CinderUnicodeTest-485864985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-21c68185-d00b-498e-b90b-98ca8c09f468.25cb58f2-3e3a-41dd-a6ce-3dd95d01f370" returned: 0 in 0.376s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:30 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0a1ef1d-00d1-48df-8ed9-86dfc150e8df]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:41:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1e1b5cdf-e8d3-4b53-b14a-5f079f3f668c tempest-CreateVolumesFromSnapshotTest-597264870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-4aa4c9ca-068b-4ce6-b155-59c0e6df9dd7.b262df46-516c-4a3b-b1d7-26a097a26e42 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:30 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e8da8cd2-01c2-4bc3-be71-d87b8425f4c6 tempest-CreateVolumesFromImageTest-463197901 None] Lock "cinder-e495e853-dc18-4dfc-9554-813e30e9a720-delete_volume" acquired by "delete_volume" :: waited 0.091s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:41:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-268e94a9-6db5-4524-984c-8819a2c54b2f tempest-CinderUnicodeTest-485864985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-21c68185-d00b-498e-b90b-98ca8c09f468.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:30 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e8da8cd2-01c2-4bc3-be71-d87b8425f4c6 tempest-CreateVolumesFromImageTest-463197901 None] Acquiring lock "cinder-quobyte-e495e853-dc18-4dfc-9554-813e30e9a720" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:41:30 devstack sudo[107689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-21c68185-d00b-498e-b90b-98ca8c09f468.info Nov 06 15:41:30 devstack sudo[107689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:30 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e8da8cd2-01c2-4bc3-be71-d87b8425f4c6 tempest-CreateVolumesFromImageTest-463197901 None] Lock "cinder-quobyte-e495e853-dc18-4dfc-9554-813e30e9a720" acquired by "delete_volume" :: waited 0.025s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:41:30 devstack sudo[107688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-4aa4c9ca-068b-4ce6-b155-59c0e6df9dd7.b262df46-516c-4a3b-b1d7-26a097a26e42 Nov 06 15:41:30 devstack sudo[107688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:30 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[efce399e-fb02-424a-a4e4-a87591be8456]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:41:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e8da8cd2-01c2-4bc3-be71-d87b8425f4c6 tempest-CreateVolumesFromImageTest-463197901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-e495e853-dc18-4dfc-9554-813e30e9a720 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:30 devstack sudo[107692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-e495e853-dc18-4dfc-9554-813e30e9a720 Nov 06 15:41:30 devstack sudo[107692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:30 devstack sudo[107689]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-268e94a9-6db5-4524-984c-8819a2c54b2f tempest-CinderUnicodeTest-485864985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-21c68185-d00b-498e-b90b-98ca8c09f468.info" returned: 0 in 0.346s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:30 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-268e94a9-6db5-4524-984c-8819a2c54b2f tempest-CinderUnicodeTest-485864985 None] /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-21c68185-d00b-498e-b90b-98ca8c09f468.info is being set with open permissions: ugo+rw Nov 06 15:41:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-268e94a9-6db5-4524-984c-8819a2c54b2f tempest-CinderUnicodeTest-485864985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-21c68185-d00b-498e-b90b-98ca8c09f468.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:30 devstack sudo[107688]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1e1b5cdf-e8d3-4b53-b14a-5f079f3f668c tempest-CreateVolumesFromSnapshotTest-597264870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-4aa4c9ca-068b-4ce6-b155-59c0e6df9dd7.b262df46-516c-4a3b-b1d7-26a097a26e42" returned: 0 in 0.445s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:30 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-1e1b5cdf-e8d3-4b53-b14a-5f079f3f668c tempest-CreateVolumesFromSnapshotTest-597264870 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4aa4c9ca-068b-4ce6-b155-59c0e6df9dd7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 15:41:30 devstack sudo[107698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-21c68185-d00b-498e-b90b-98ca8c09f468.info Nov 06 15:41:30 devstack sudo[107698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:30 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[f041f08e-1b7b-4601-a16f-589bed47dbdb]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:41:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1e1b5cdf-e8d3-4b53-b14a-5f079f3f668c tempest-CreateVolumesFromSnapshotTest-597264870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-4aa4c9ca-068b-4ce6-b155-59c0e6df9dd7 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:30 devstack sudo[107700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-4aa4c9ca-068b-4ce6-b155-59c0e6df9dd7 Nov 06 15:41:30 devstack sudo[107700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:30 devstack sudo[107692]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e8da8cd2-01c2-4bc3-be71-d87b8425f4c6 tempest-CreateVolumesFromImageTest-463197901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-e495e853-dc18-4dfc-9554-813e30e9a720" returned: 0 in 0.527s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e8da8cd2-01c2-4bc3-be71-d87b8425f4c6 tempest-CreateVolumesFromImageTest-463197901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-e495e853-dc18-4dfc-9554-813e30e9a720 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:30 devstack sudo[107706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-e495e853-dc18-4dfc-9554-813e30e9a720 Nov 06 15:41:30 devstack sudo[107706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:30 devstack sudo[107698]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-268e94a9-6db5-4524-984c-8819a2c54b2f tempest-CinderUnicodeTest-485864985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-21c68185-d00b-498e-b90b-98ca8c09f468.info" returned: 0 in 0.306s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-268e94a9-6db5-4524-984c-8819a2c54b2f tempest-CinderUnicodeTest-485864985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.465s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:41:30 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-268e94a9-6db5-4524-984c-8819a2c54b2f tempest-CinderUnicodeTest-485864985 None] Create snapshot completed successfully Nov 06 15:41:31 devstack sudo[107706]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e8da8cd2-01c2-4bc3-be71-d87b8425f4c6 tempest-CreateVolumesFromImageTest-463197901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-e495e853-dc18-4dfc-9554-813e30e9a720" returned: 0 in 0.288s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:31 devstack sudo[107700]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1e1b5cdf-e8d3-4b53-b14a-5f079f3f668c tempest-CreateVolumesFromSnapshotTest-597264870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-4aa4c9ca-068b-4ce6-b155-59c0e6df9dd7" returned: 0 in 0.485s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1e1b5cdf-e8d3-4b53-b14a-5f079f3f668c tempest-CreateVolumesFromSnapshotTest-597264870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-4aa4c9ca-068b-4ce6-b155-59c0e6df9dd7.b262df46-516c-4a3b-b1d7-26a097a26e42 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:31 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e8da8cd2-01c2-4bc3-be71-d87b8425f4c6 tempest-CreateVolumesFromImageTest-463197901 None] Lock "cinder-quobyte-e495e853-dc18-4dfc-9554-813e30e9a720" released by "delete_volume" :: held 0.875s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:41:31 devstack sudo[107712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-4aa4c9ca-068b-4ce6-b155-59c0e6df9dd7.b262df46-516c-4a3b-b1d7-26a097a26e42 Nov 06 15:41:31 devstack sudo[107712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:31 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-e8da8cd2-01c2-4bc3-be71-d87b8425f4c6 tempest-CreateVolumesFromImageTest-463197901 None] Created reservations ['8a53900e-1e0a-4390-9332-60d9b89f7212', '3a0532c2-59f3-4c51-aa3b-8e43aad416b2', '1115a0bc-6dbd-4c39-b71d-3631a76693cc', '05264fbc-a5db-4e1c-8aef-cb5ce0ca187c'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:41:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e8da8cd2-01c2-4bc3-be71-d87b8425f4c6 tempest-CreateVolumesFromImageTest-463197901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:41:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e8da8cd2-01c2-4bc3-be71-d87b8425f4c6 tempest-CreateVolumesFromImageTest-463197901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:41:31 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e8da8cd2-01c2-4bc3-be71-d87b8425f4c6 tempest-CreateVolumesFromImageTest-463197901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:41:31 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e8da8cd2-01c2-4bc3-be71-d87b8425f4c6 tempest-CreateVolumesFromImageTest-463197901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:41:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e8da8cd2-01c2-4bc3-be71-d87b8425f4c6 tempest-CreateVolumesFromImageTest-463197901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:41:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e8da8cd2-01c2-4bc3-be71-d87b8425f4c6 tempest-CreateVolumesFromImageTest-463197901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:31 devstack sudo[107714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:41:31 devstack sudo[107714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:31 devstack sudo[107712]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1e1b5cdf-e8d3-4b53-b14a-5f079f3f668c tempest-CreateVolumesFromSnapshotTest-597264870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-4aa4c9ca-068b-4ce6-b155-59c0e6df9dd7.b262df46-516c-4a3b-b1d7-26a097a26e42" returned: 0 in 0.398s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1e1b5cdf-e8d3-4b53-b14a-5f079f3f668c tempest-CreateVolumesFromSnapshotTest-597264870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-4aa4c9ca-068b-4ce6-b155-59c0e6df9dd7.b262df46-516c-4a3b-b1d7-26a097a26e42 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:31 devstack sudo[107714]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e8da8cd2-01c2-4bc3-be71-d87b8425f4c6 tempest-CreateVolumesFromImageTest-463197901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.269s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:31 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-e8da8cd2-01c2-4bc3-be71-d87b8425f4c6 tempest-CreateVolumesFromImageTest-463197901 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:41:31 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-e8da8cd2-01c2-4bc3-be71-d87b8425f4c6 tempest-CreateVolumesFromImageTest-463197901 None] Deleted volume successfully. Nov 06 15:41:31 devstack sudo[107721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-4aa4c9ca-068b-4ce6-b155-59c0e6df9dd7.b262df46-516c-4a3b-b1d7-26a097a26e42 Nov 06 15:41:31 devstack sudo[107721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:31 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e8da8cd2-01c2-4bc3-be71-d87b8425f4c6 tempest-CreateVolumesFromImageTest-463197901 None] Lock "cinder-e495e853-dc18-4dfc-9554-813e30e9a720-delete_volume" released by "delete_volume" :: held 1.431s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:41:31 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-8b26d1c0-0656-4e6e-b83a-f6a5b704ead0 tempest-CinderUnicodeTest-485864985 None] Acquiring lock "cinder-25cb58f2-3e3a-41dd-a6ce-3dd95d01f370-delete_snapshot" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:41:31 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-8b26d1c0-0656-4e6e-b83a-f6a5b704ead0 tempest-CinderUnicodeTest-485864985 None] Lock "cinder-25cb58f2-3e3a-41dd-a6ce-3dd95d01f370-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:41:31 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-8b26d1c0-0656-4e6e-b83a-f6a5b704ead0 tempest-CinderUnicodeTest-485864985 None] Acquiring lock "cinder-quobyte-21c68185-d00b-498e-b90b-98ca8c09f468" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:41:31 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-8b26d1c0-0656-4e6e-b83a-f6a5b704ead0 tempest-CinderUnicodeTest-485864985 None] Lock "cinder-quobyte-21c68185-d00b-498e-b90b-98ca8c09f468" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:41:31 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-8b26d1c0-0656-4e6e-b83a-f6a5b704ead0 tempest-CinderUnicodeTest-485864985 None] Acquiring lock "cinder-quobyte-25cb58f2-3e3a-41dd-a6ce-3dd95d01f370" by "_delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:41:31 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-8b26d1c0-0656-4e6e-b83a-f6a5b704ead0 tempest-CinderUnicodeTest-485864985 None] Lock "cinder-quobyte-25cb58f2-3e3a-41dd-a6ce-3dd95d01f370" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:41:31 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-8b26d1c0-0656-4e6e-b83a-f6a5b704ead0 tempest-CinderUnicodeTest-485864985 None] Deleting offline snapshot 25cb58f2-3e3a-41dd-a6ce-3dd95d01f370 of volume 21c68185-d00b-498e-b90b-98ca8c09f468 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 15:41:31 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-8b26d1c0-0656-4e6e-b83a-f6a5b704ead0 tempest-CinderUnicodeTest-485864985 None] snapshot_file for this snap is: volume-21c68185-d00b-498e-b90b-98ca8c09f468.25cb58f2-3e3a-41dd-a6ce-3dd95d01f370 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 15:41:31 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcf2b504-6142-46ff-954a-7e0c8f54caa2]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:41:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8b26d1c0-0656-4e6e-b83a-f6a5b704ead0 tempest-CinderUnicodeTest-485864985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-21c68185-d00b-498e-b90b-98ca8c09f468.25cb58f2-3e3a-41dd-a6ce-3dd95d01f370 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:31 devstack sudo[107721]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1e1b5cdf-e8d3-4b53-b14a-5f079f3f668c tempest-CreateVolumesFromSnapshotTest-597264870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-4aa4c9ca-068b-4ce6-b155-59c0e6df9dd7.b262df46-516c-4a3b-b1d7-26a097a26e42" returned: 0 in 0.325s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:31 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-1e1b5cdf-e8d3-4b53-b14a-5f079f3f668c tempest-CreateVolumesFromSnapshotTest-597264870 None] Lock "cinder-quobyte-b262df46-516c-4a3b-b1d7-26a097a26e42" released by "_delete_snapshot" :: held 1.814s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:41:31 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-1e1b5cdf-e8d3-4b53-b14a-5f079f3f668c tempest-CreateVolumesFromSnapshotTest-597264870 None] Lock "cinder-quobyte-4aa4c9ca-068b-4ce6-b155-59c0e6df9dd7" released by "delete_snapshot" :: held 1.851s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:41:31 devstack sudo[107724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-21c68185-d00b-498e-b90b-98ca8c09f468.25cb58f2-3e3a-41dd-a6ce-3dd95d01f370 Nov 06 15:41:31 devstack sudo[107724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:32 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-1e1b5cdf-e8d3-4b53-b14a-5f079f3f668c tempest-CreateVolumesFromSnapshotTest-597264870 None] Created reservations ['925b5545-eacf-4435-ba45-fe425aabc369', 'e504cb5c-17a0-4639-863f-ef3a9f7b7fdf', '4f135965-1fa0-414d-914a-1d61b18bd856', '57881d71-7067-4bd9-a258-2594909c3407'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:41:32 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-1e1b5cdf-e8d3-4b53-b14a-5f079f3f668c tempest-CreateVolumesFromSnapshotTest-597264870 None] Delete snapshot completed successfully. Nov 06 15:41:32 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-1e1b5cdf-e8d3-4b53-b14a-5f079f3f668c tempest-CreateVolumesFromSnapshotTest-597264870 None] Lock "cinder-b262df46-516c-4a3b-b1d7-26a097a26e42-delete_snapshot" released by "delete_snapshot" :: held 2.012s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:41:32 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-65edbebb-c6c0-41c3-9733-5dd6d7008569 tempest-CreateVolumesFromSnapshotTest-597264870 None] Acquiring lock "cinder-4aa4c9ca-068b-4ce6-b155-59c0e6df9dd7-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:41:32 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-65edbebb-c6c0-41c3-9733-5dd6d7008569 tempest-CreateVolumesFromSnapshotTest-597264870 None] Lock "cinder-4aa4c9ca-068b-4ce6-b155-59c0e6df9dd7-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:41:32 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-65edbebb-c6c0-41c3-9733-5dd6d7008569 tempest-CreateVolumesFromSnapshotTest-597264870 None] Acquiring lock "cinder-quobyte-4aa4c9ca-068b-4ce6-b155-59c0e6df9dd7" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:41:32 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-65edbebb-c6c0-41c3-9733-5dd6d7008569 tempest-CreateVolumesFromSnapshotTest-597264870 None] Lock "cinder-quobyte-4aa4c9ca-068b-4ce6-b155-59c0e6df9dd7" acquired by "delete_volume" :: waited 0.015s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:41:32 devstack sudo[107724]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8b26d1c0-0656-4e6e-b83a-f6a5b704ead0 tempest-CinderUnicodeTest-485864985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-21c68185-d00b-498e-b90b-98ca8c09f468.25cb58f2-3e3a-41dd-a6ce-3dd95d01f370" returned: 0 in 0.486s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:32 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-8b26d1c0-0656-4e6e-b83a-f6a5b704ead0 tempest-CinderUnicodeTest-485864985 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-21c68185-d00b-498e-b90b-98ca8c09f468(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 15:41:32 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d601aad-cb12-437b-ac02-d97a8ea93c1b]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:41:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-65edbebb-c6c0-41c3-9733-5dd6d7008569 tempest-CreateVolumesFromSnapshotTest-597264870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-4aa4c9ca-068b-4ce6-b155-59c0e6df9dd7 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:32 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[88e1ae46-fac9-4d0a-a179-6f714c927210]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:41:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8b26d1c0-0656-4e6e-b83a-f6a5b704ead0 tempest-CinderUnicodeTest-485864985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-21c68185-d00b-498e-b90b-98ca8c09f468 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:32 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-8f733e9a-0951-4c48-b031-ac4edf7cc6db tempest-CreateVolumesFromImageTest-463197901 None] Acquiring lock "cinder-fb1e9c89-7ddd-422d-9c45-9bd29fd2568d-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:41:32 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-8f733e9a-0951-4c48-b031-ac4edf7cc6db tempest-CreateVolumesFromImageTest-463197901 None] Lock "cinder-fb1e9c89-7ddd-422d-9c45-9bd29fd2568d-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:41:32 devstack sudo[107729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-4aa4c9ca-068b-4ce6-b155-59c0e6df9dd7 Nov 06 15:41:32 devstack sudo[107729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:32 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-8f733e9a-0951-4c48-b031-ac4edf7cc6db tempest-CreateVolumesFromImageTest-463197901 None] Acquiring lock "cinder-quobyte-fb1e9c89-7ddd-422d-9c45-9bd29fd2568d" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:41:32 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-8f733e9a-0951-4c48-b031-ac4edf7cc6db tempest-CreateVolumesFromImageTest-463197901 None] Lock "cinder-quobyte-fb1e9c89-7ddd-422d-9c45-9bd29fd2568d" acquired by "delete_volume" :: waited 0.014s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:41:32 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[a951510c-7abf-4f86-b34d-194879ff6e5e]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:41:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8f733e9a-0951-4c48-b031-ac4edf7cc6db tempest-CreateVolumesFromImageTest-463197901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-fb1e9c89-7ddd-422d-9c45-9bd29fd2568d {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:32 devstack sudo[107730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-21c68185-d00b-498e-b90b-98ca8c09f468 Nov 06 15:41:32 devstack sudo[107730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:32 devstack sudo[107732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-fb1e9c89-7ddd-422d-9c45-9bd29fd2568d Nov 06 15:41:32 devstack sudo[107732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:32 devstack sudo[107729]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-65edbebb-c6c0-41c3-9733-5dd6d7008569 tempest-CreateVolumesFromSnapshotTest-597264870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-4aa4c9ca-068b-4ce6-b155-59c0e6df9dd7" returned: 0 in 0.462s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-65edbebb-c6c0-41c3-9733-5dd6d7008569 tempest-CreateVolumesFromSnapshotTest-597264870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-4aa4c9ca-068b-4ce6-b155-59c0e6df9dd7 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:32 devstack sudo[107738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-4aa4c9ca-068b-4ce6-b155-59c0e6df9dd7 Nov 06 15:41:32 devstack sudo[107738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:32 devstack sudo[107730]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8b26d1c0-0656-4e6e-b83a-f6a5b704ead0 tempest-CinderUnicodeTest-485864985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-21c68185-d00b-498e-b90b-98ca8c09f468" returned: 0 in 0.553s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8b26d1c0-0656-4e6e-b83a-f6a5b704ead0 tempest-CinderUnicodeTest-485864985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-21c68185-d00b-498e-b90b-98ca8c09f468.25cb58f2-3e3a-41dd-a6ce-3dd95d01f370 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:32 devstack sudo[107744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-21c68185-d00b-498e-b90b-98ca8c09f468.25cb58f2-3e3a-41dd-a6ce-3dd95d01f370 Nov 06 15:41:32 devstack sudo[107744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:33 devstack sudo[107732]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8f733e9a-0951-4c48-b031-ac4edf7cc6db tempest-CreateVolumesFromImageTest-463197901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-fb1e9c89-7ddd-422d-9c45-9bd29fd2568d" returned: 0 in 0.475s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8f733e9a-0951-4c48-b031-ac4edf7cc6db tempest-CreateVolumesFromImageTest-463197901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-fb1e9c89-7ddd-422d-9c45-9bd29fd2568d {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:33 devstack sudo[107749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-fb1e9c89-7ddd-422d-9c45-9bd29fd2568d Nov 06 15:41:33 devstack sudo[107749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:33 devstack sudo[107738]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-65edbebb-c6c0-41c3-9733-5dd6d7008569 tempest-CreateVolumesFromSnapshotTest-597264870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-4aa4c9ca-068b-4ce6-b155-59c0e6df9dd7" returned: 0 in 0.291s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:33 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-65edbebb-c6c0-41c3-9733-5dd6d7008569 tempest-CreateVolumesFromSnapshotTest-597264870 None] Lock "cinder-quobyte-4aa4c9ca-068b-4ce6-b155-59c0e6df9dd7" released by "delete_volume" :: held 0.848s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:41:33 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-65edbebb-c6c0-41c3-9733-5dd6d7008569 tempest-CreateVolumesFromSnapshotTest-597264870 None] Created reservations ['6f6b66ee-4fc0-44ad-9b63-02ff2c517659', 'dcfbdd14-660f-4c6f-a3d1-3dd65a927f97', '36ba74cc-e665-463c-a5af-75e1a07a965c', 'e62ae0ff-32b8-4c9a-a944-2222ec5738f0'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:41:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-65edbebb-c6c0-41c3-9733-5dd6d7008569 tempest-CreateVolumesFromSnapshotTest-597264870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:41:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-65edbebb-c6c0-41c3-9733-5dd6d7008569 tempest-CreateVolumesFromSnapshotTest-597264870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:41:33 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-65edbebb-c6c0-41c3-9733-5dd6d7008569 tempest-CreateVolumesFromSnapshotTest-597264870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:41:33 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-65edbebb-c6c0-41c3-9733-5dd6d7008569 tempest-CreateVolumesFromSnapshotTest-597264870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:41:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-65edbebb-c6c0-41c3-9733-5dd6d7008569 tempest-CreateVolumesFromSnapshotTest-597264870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:41:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-65edbebb-c6c0-41c3-9733-5dd6d7008569 tempest-CreateVolumesFromSnapshotTest-597264870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:33 devstack sudo[107749]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8f733e9a-0951-4c48-b031-ac4edf7cc6db tempest-CreateVolumesFromImageTest-463197901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-fb1e9c89-7ddd-422d-9c45-9bd29fd2568d" returned: 0 in 0.309s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:33 devstack sudo[107744]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:33 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-8f733e9a-0951-4c48-b031-ac4edf7cc6db tempest-CreateVolumesFromImageTest-463197901 None] Lock "cinder-quobyte-fb1e9c89-7ddd-422d-9c45-9bd29fd2568d" released by "delete_volume" :: held 0.847s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:41:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8b26d1c0-0656-4e6e-b83a-f6a5b704ead0 tempest-CinderUnicodeTest-485864985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-21c68185-d00b-498e-b90b-98ca8c09f468.25cb58f2-3e3a-41dd-a6ce-3dd95d01f370" returned: 0 in 0.444s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8b26d1c0-0656-4e6e-b83a-f6a5b704ead0 tempest-CinderUnicodeTest-485864985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-21c68185-d00b-498e-b90b-98ca8c09f468.25cb58f2-3e3a-41dd-a6ce-3dd95d01f370 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:33 devstack sudo[107757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:41:33 devstack sudo[107757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:33 devstack sudo[107759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-21c68185-d00b-498e-b90b-98ca8c09f468.25cb58f2-3e3a-41dd-a6ce-3dd95d01f370 Nov 06 15:41:33 devstack sudo[107759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:33 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-8f733e9a-0951-4c48-b031-ac4edf7cc6db tempest-CreateVolumesFromImageTest-463197901 None] Created reservations ['9a430a7c-4a55-4beb-87d7-c1fe7ccbfac4', '5204574d-b674-4e87-9192-7642d3d14a58', '08d8d5f2-2897-4ece-901d-bacf008f1591', 'ee62e36a-5b26-4b68-8ebb-dbd4a1e871a3'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:41:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8f733e9a-0951-4c48-b031-ac4edf7cc6db tempest-CreateVolumesFromImageTest-463197901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:41:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8f733e9a-0951-4c48-b031-ac4edf7cc6db tempest-CreateVolumesFromImageTest-463197901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:41:33 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-8f733e9a-0951-4c48-b031-ac4edf7cc6db tempest-CreateVolumesFromImageTest-463197901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:41:33 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-8f733e9a-0951-4c48-b031-ac4edf7cc6db tempest-CreateVolumesFromImageTest-463197901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:41:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8f733e9a-0951-4c48-b031-ac4edf7cc6db tempest-CreateVolumesFromImageTest-463197901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:41:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8f733e9a-0951-4c48-b031-ac4edf7cc6db tempest-CreateVolumesFromImageTest-463197901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:33 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-38613e19-d5a8-4368-bb64-b73deff30e04 tempest-ProjectReaderTests-90568800 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:41:33 devstack sudo[107761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:41:33 devstack sudo[107761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:33 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-38613e19-d5a8-4368-bb64-b73deff30e04 tempest-ProjectReaderTests-90568800 None] Flow 'volume_create_manager' (5fe0c5c6-e217-43e4-bb46-39f16e11ed6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:41:33 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-38613e19-d5a8-4368-bb64-b73deff30e04 tempest-ProjectReaderTests-90568800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74f6d9d5-bc75-4dba-b193-c9fd418b2abb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:33 devstack sudo[107757]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-65edbebb-c6c0-41c3-9733-5dd6d7008569 tempest-CreateVolumesFromSnapshotTest-597264870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.431s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:33 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-65edbebb-c6c0-41c3-9733-5dd6d7008569 tempest-CreateVolumesFromSnapshotTest-597264870 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:41:33 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-38613e19-d5a8-4368-bb64-b73deff30e04 tempest-ProjectReaderTests-90568800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74f6d9d5-bc75-4dba-b193-c9fd418b2abb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:41:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1470539349',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0a2e61e-e471-48a9-bd64-80c4184a89e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa0e5fb1579d44329b27513f0572ba4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:41:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:41:34Z,use_quota=True,user_id='8f151b147eaa443a8d1a0ac4f9b0c7fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:33 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-38613e19-d5a8-4368-bb64-b73deff30e04 tempest-ProjectReaderTests-90568800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41571499-c630-4d33-a128-f168d04a4e85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:33 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-38613e19-d5a8-4368-bb64-b73deff30e04 tempest-ProjectReaderTests-90568800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41571499-c630-4d33-a128-f168d04a4e85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:33 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-38613e19-d5a8-4368-bb64-b73deff30e04 tempest-ProjectReaderTests-90568800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68fe5f16-3f1d-4705-9bda-61ac48d520e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:33 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-38613e19-d5a8-4368-bb64-b73deff30e04 tempest-ProjectReaderTests-90568800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68fe5f16-3f1d-4705-9bda-61ac48d520e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0a2e61e-e471-48a9-bd64-80c4184a89e1', 'volume_name': 'volume-d0a2e61e-e471-48a9-bd64-80c4184a89e1', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:33 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-38613e19-d5a8-4368-bb64-b73deff30e04 tempest-ProjectReaderTests-90568800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69722872-a4a7-4179-99e1-f308fa7b9338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:33 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-38613e19-d5a8-4368-bb64-b73deff30e04 tempest-ProjectReaderTests-90568800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69722872-a4a7-4179-99e1-f308fa7b9338) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:33 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-38613e19-d5a8-4368-bb64-b73deff30e04 tempest-ProjectReaderTests-90568800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5f5713d-9a44-4c54-87a6-b0c5a9e42ef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:33 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-38613e19-d5a8-4368-bb64-b73deff30e04 tempest-ProjectReaderTests-90568800 None] Volume d0a2e61e-e471-48a9-bd64-80c4184a89e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0a2e61e-e471-48a9-bd64-80c4184a89e1', 'volume_size': 1} Nov 06 15:41:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-38613e19-d5a8-4368-bb64-b73deff30e04 tempest-ProjectReaderTests-90568800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:41:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-38613e19-d5a8-4368-bb64-b73deff30e04 tempest-ProjectReaderTests-90568800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:41:33 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-38613e19-d5a8-4368-bb64-b73deff30e04 tempest-ProjectReaderTests-90568800 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:41:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1470539349',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0a2e61e-e471-48a9-bd64-80c4184a89e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa0e5fb1579d44329b27513f0572ba4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:41:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:41:34Z,use_quota=True,user_id='8f151b147eaa443a8d1a0ac4f9b0c7fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:41:33 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-38613e19-d5a8-4368-bb64-b73deff30e04 tempest-ProjectReaderTests-90568800 None] Creating volume d0a2e61e-e471-48a9-bd64-80c4184a89e1 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:41:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-38613e19-d5a8-4368-bb64-b73deff30e04 tempest-ProjectReaderTests-90568800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:41:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-38613e19-d5a8-4368-bb64-b73deff30e04 tempest-ProjectReaderTests-90568800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:41:33 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-38613e19-d5a8-4368-bb64-b73deff30e04 tempest-ProjectReaderTests-90568800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:41:33 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-38613e19-d5a8-4368-bb64-b73deff30e04 tempest-ProjectReaderTests-90568800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:41:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-38613e19-d5a8-4368-bb64-b73deff30e04 tempest-ProjectReaderTests-90568800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:41:33 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-38613e19-d5a8-4368-bb64-b73deff30e04 tempest-ProjectReaderTests-90568800 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:41:33 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-38613e19-d5a8-4368-bb64-b73deff30e04 tempest-ProjectReaderTests-90568800 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:41:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-38613e19-d5a8-4368-bb64-b73deff30e04 tempest-ProjectReaderTests-90568800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d0a2e61e-e471-48a9-bd64-80c4184a89e1 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:33 devstack sudo[107759]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:33 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-65edbebb-c6c0-41c3-9733-5dd6d7008569 tempest-CreateVolumesFromSnapshotTest-597264870 None] Deleted volume successfully. Nov 06 15:41:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8b26d1c0-0656-4e6e-b83a-f6a5b704ead0 tempest-CinderUnicodeTest-485864985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-21c68185-d00b-498e-b90b-98ca8c09f468.25cb58f2-3e3a-41dd-a6ce-3dd95d01f370" returned: 0 in 0.491s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:33 devstack sudo[107765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d0a2e61e-e471-48a9-bd64-80c4184a89e1 1073741824 Nov 06 15:41:33 devstack sudo[107765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:33 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-8b26d1c0-0656-4e6e-b83a-f6a5b704ead0 tempest-CinderUnicodeTest-485864985 None] Lock "cinder-quobyte-25cb58f2-3e3a-41dd-a6ce-3dd95d01f370" released by "_delete_snapshot" :: held 2.120s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:41:33 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-65edbebb-c6c0-41c3-9733-5dd6d7008569 tempest-CreateVolumesFromSnapshotTest-597264870 None] Lock "cinder-4aa4c9ca-068b-4ce6-b155-59c0e6df9dd7-delete_volume" released by "delete_volume" :: held 1.689s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:41:33 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-8b26d1c0-0656-4e6e-b83a-f6a5b704ead0 tempest-CinderUnicodeTest-485864985 None] Lock "cinder-quobyte-21c68185-d00b-498e-b90b-98ca8c09f468" released by "delete_snapshot" :: held 2.156s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:41:33 devstack sudo[107761]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8f733e9a-0951-4c48-b031-ac4edf7cc6db tempest-CreateVolumesFromImageTest-463197901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.321s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:33 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-8f733e9a-0951-4c48-b031-ac4edf7cc6db tempest-CreateVolumesFromImageTest-463197901 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:41:33 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-8f733e9a-0951-4c48-b031-ac4edf7cc6db tempest-CreateVolumesFromImageTest-463197901 None] Deleted volume successfully. Nov 06 15:41:34 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-8f733e9a-0951-4c48-b031-ac4edf7cc6db tempest-CreateVolumesFromImageTest-463197901 None] Lock "cinder-fb1e9c89-7ddd-422d-9c45-9bd29fd2568d-delete_volume" released by "delete_volume" :: held 1.585s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:41:34 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-8b26d1c0-0656-4e6e-b83a-f6a5b704ead0 tempest-CinderUnicodeTest-485864985 None] Created reservations ['cc191b0d-89ff-45c8-a6f2-97ab130f9812', '7d755254-e17a-4728-8c09-2e683bd75d98', '4c6500f2-f534-43c6-9f03-6e96b50473ec', '4615f06a-2e7e-4a89-81da-79164a70e12b'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:41:34 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-8b26d1c0-0656-4e6e-b83a-f6a5b704ead0 tempest-CinderUnicodeTest-485864985 None] Delete snapshot completed successfully. Nov 06 15:41:34 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-8b26d1c0-0656-4e6e-b83a-f6a5b704ead0 tempest-CinderUnicodeTest-485864985 None] Lock "cinder-25cb58f2-3e3a-41dd-a6ce-3dd95d01f370-delete_snapshot" released by "delete_snapshot" :: held 2.352s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:41:34 devstack sudo[107765]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-38613e19-d5a8-4368-bb64-b73deff30e04 tempest-ProjectReaderTests-90568800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d0a2e61e-e471-48a9-bd64-80c4184a89e1 1073741824" returned: 0 in 0.546s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-38613e19-d5a8-4368-bb64-b73deff30e04 tempest-ProjectReaderTests-90568800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d0a2e61e-e471-48a9-bd64-80c4184a89e1 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:34 devstack sudo[107772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d0a2e61e-e471-48a9-bd64-80c4184a89e1 Nov 06 15:41:34 devstack sudo[107772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:34 devstack sudo[107772]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-38613e19-d5a8-4368-bb64-b73deff30e04 tempest-ProjectReaderTests-90568800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d0a2e61e-e471-48a9-bd64-80c4184a89e1" returned: 0 in 0.262s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:34 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-38613e19-d5a8-4368-bb64-b73deff30e04 tempest-ProjectReaderTests-90568800 None] <== create_volume: return (852ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:41:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-38613e19-d5a8-4368-bb64-b73deff30e04 tempest-ProjectReaderTests-90568800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.859s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:41:34 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-38613e19-d5a8-4368-bb64-b73deff30e04 tempest-ProjectReaderTests-90568800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5f5713d-9a44-4c54-87a6-b0c5a9e42ef2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0a2e61e-e471-48a9-bd64-80c4184a89e1', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:34 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-38613e19-d5a8-4368-bb64-b73deff30e04 tempest-ProjectReaderTests-90568800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59621ed2-5b3f-40b4-b83d-c5b5faffe44f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:34 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-38613e19-d5a8-4368-bb64-b73deff30e04 tempest-ProjectReaderTests-90568800 None] Volume volume-d0a2e61e-e471-48a9-bd64-80c4184a89e1 (d0a2e61e-e471-48a9-bd64-80c4184a89e1): created successfully Nov 06 15:41:34 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-38613e19-d5a8-4368-bb64-b73deff30e04 tempest-ProjectReaderTests-90568800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59621ed2-5b3f-40b4-b83d-c5b5faffe44f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:34 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-38613e19-d5a8-4368-bb64-b73deff30e04 tempest-ProjectReaderTests-90568800 None] Flow 'volume_create_manager' (5fe0c5c6-e217-43e4-bb46-39f16e11ed6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:41:34 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-eb73140b-6837-4fcc-ac24-af44c55bb53e tempest-CreateVolumesFromImageTest-463197901 None] Acquiring lock "cinder-e5227f57-9551-4aea-813f-b0cd0a6b27b9-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:41:34 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-38613e19-d5a8-4368-bb64-b73deff30e04 tempest-ProjectReaderTests-90568800 None] Created volume successfully. Nov 06 15:41:34 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-eb73140b-6837-4fcc-ac24-af44c55bb53e tempest-CreateVolumesFromImageTest-463197901 None] Lock "cinder-e5227f57-9551-4aea-813f-b0cd0a6b27b9-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:41:34 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-eb73140b-6837-4fcc-ac24-af44c55bb53e tempest-CreateVolumesFromImageTest-463197901 None] Acquiring lock "cinder-quobyte-e5227f57-9551-4aea-813f-b0cd0a6b27b9" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:41:34 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-eb73140b-6837-4fcc-ac24-af44c55bb53e tempest-CreateVolumesFromImageTest-463197901 None] Lock "cinder-quobyte-e5227f57-9551-4aea-813f-b0cd0a6b27b9" acquired by "delete_volume" :: waited 0.027s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:41:34 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea1e52e5-49fa-4e44-8b92-f88452da5694]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:41:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-eb73140b-6837-4fcc-ac24-af44c55bb53e tempest-CreateVolumesFromImageTest-463197901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-e5227f57-9551-4aea-813f-b0cd0a6b27b9 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:34 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-621f6085-62a5-47ed-99ad-455455606fad tempest-CinderUnicodeTest-485864985 None] Acquiring lock "cinder-21c68185-d00b-498e-b90b-98ca8c09f468-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:41:34 devstack sudo[107775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-e5227f57-9551-4aea-813f-b0cd0a6b27b9 Nov 06 15:41:35 devstack sudo[107775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:35 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-621f6085-62a5-47ed-99ad-455455606fad tempest-CinderUnicodeTest-485864985 None] Lock "cinder-21c68185-d00b-498e-b90b-98ca8c09f468-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:41:35 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-621f6085-62a5-47ed-99ad-455455606fad tempest-CinderUnicodeTest-485864985 None] Acquiring lock "cinder-quobyte-21c68185-d00b-498e-b90b-98ca8c09f468" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:41:35 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-621f6085-62a5-47ed-99ad-455455606fad tempest-CinderUnicodeTest-485864985 None] Lock "cinder-quobyte-21c68185-d00b-498e-b90b-98ca8c09f468" acquired by "delete_volume" :: waited 0.020s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:41:35 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1d4720d-13ce-4709-8243-8284bc1c8c8d]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:41:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-621f6085-62a5-47ed-99ad-455455606fad tempest-CinderUnicodeTest-485864985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-21c68185-d00b-498e-b90b-98ca8c09f468 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:35 devstack sudo[107777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-21c68185-d00b-498e-b90b-98ca8c09f468 Nov 06 15:41:35 devstack sudo[107777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:35 devstack sudo[107775]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-eb73140b-6837-4fcc-ac24-af44c55bb53e tempest-CreateVolumesFromImageTest-463197901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-e5227f57-9551-4aea-813f-b0cd0a6b27b9" returned: 0 in 0.413s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-eb73140b-6837-4fcc-ac24-af44c55bb53e tempest-CreateVolumesFromImageTest-463197901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-e5227f57-9551-4aea-813f-b0cd0a6b27b9 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:35 devstack sudo[107782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-e5227f57-9551-4aea-813f-b0cd0a6b27b9 Nov 06 15:41:35 devstack sudo[107782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:35 devstack sudo[107777]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-621f6085-62a5-47ed-99ad-455455606fad tempest-CinderUnicodeTest-485864985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-21c68185-d00b-498e-b90b-98ca8c09f468" returned: 0 in 0.393s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-621f6085-62a5-47ed-99ad-455455606fad tempest-CinderUnicodeTest-485864985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-21c68185-d00b-498e-b90b-98ca8c09f468 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:35 devstack sudo[107782]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:35 devstack sudo[107788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-21c68185-d00b-498e-b90b-98ca8c09f468 Nov 06 15:41:35 devstack sudo[107788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-eb73140b-6837-4fcc-ac24-af44c55bb53e tempest-CreateVolumesFromImageTest-463197901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-e5227f57-9551-4aea-813f-b0cd0a6b27b9" returned: 0 in 0.261s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:35 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-eb73140b-6837-4fcc-ac24-af44c55bb53e tempest-CreateVolumesFromImageTest-463197901 None] Lock "cinder-quobyte-e5227f57-9551-4aea-813f-b0cd0a6b27b9" released by "delete_volume" :: held 0.732s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:41:35 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-eb73140b-6837-4fcc-ac24-af44c55bb53e tempest-CreateVolumesFromImageTest-463197901 None] Created reservations ['0d120d90-1e88-4f9c-b47a-eae0d306c199', 'c0415187-26c9-46fa-96a7-87b012977c29', '8b520e68-7d6c-46bb-8a3e-9a38aefee5f2', '3669f6d6-279f-410c-96f4-7835cd0bd7b4'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:41:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-eb73140b-6837-4fcc-ac24-af44c55bb53e tempest-CreateVolumesFromImageTest-463197901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:41:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-eb73140b-6837-4fcc-ac24-af44c55bb53e tempest-CreateVolumesFromImageTest-463197901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:41:35 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-eb73140b-6837-4fcc-ac24-af44c55bb53e tempest-CreateVolumesFromImageTest-463197901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:41:35 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-eb73140b-6837-4fcc-ac24-af44c55bb53e tempest-CreateVolumesFromImageTest-463197901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:41:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-eb73140b-6837-4fcc-ac24-af44c55bb53e tempest-CreateVolumesFromImageTest-463197901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:41:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-eb73140b-6837-4fcc-ac24-af44c55bb53e tempest-CreateVolumesFromImageTest-463197901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:35 devstack sudo[107790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:41:35 devstack sudo[107790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:35 devstack sudo[107788]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-621f6085-62a5-47ed-99ad-455455606fad tempest-CinderUnicodeTest-485864985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-21c68185-d00b-498e-b90b-98ca8c09f468" returned: 0 in 0.398s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:35 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-621f6085-62a5-47ed-99ad-455455606fad tempest-CinderUnicodeTest-485864985 None] Lock "cinder-quobyte-21c68185-d00b-498e-b90b-98ca8c09f468" released by "delete_volume" :: held 0.904s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:41:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-eb78d36f-2260-47a6-baa7-f24c7bb9392c tempest-ProjectReaderTests-90568800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:41:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-eb78d36f-2260-47a6-baa7-f24c7bb9392c tempest-ProjectReaderTests-90568800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:41:36 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-eb78d36f-2260-47a6-baa7-f24c7bb9392c tempest-ProjectReaderTests-90568800 None] Creating offline snapshot 16ef52f9-3398-4e5d-ac59-ad373adc5587 of volume d0a2e61e-e471-48a9-bd64-80c4184a89e1 {{(pid=87132) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 15:41:36 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c551a56-a69d-4fd0-a342-8e3e129a4ea0]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:41:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-eb78d36f-2260-47a6-baa7-f24c7bb9392c tempest-ProjectReaderTests-90568800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d0a2e61e-e471-48a9-bd64-80c4184a89e1 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:36 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-621f6085-62a5-47ed-99ad-455455606fad tempest-CinderUnicodeTest-485864985 None] Created reservations ['bef364c0-3d3a-448c-801b-5b71df852ff9', '41f12354-fa5b-485e-a5ef-b63d089d7ea4', 'd2f9e9ee-2212-4483-b2de-748dabd3e619', 'cfa13d9d-2573-4550-af99-86a35be78ed3'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:41:36 devstack sudo[107790]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-eb73140b-6837-4fcc-ac24-af44c55bb53e tempest-CreateVolumesFromImageTest-463197901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.431s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:36 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-eb73140b-6837-4fcc-ac24-af44c55bb53e tempest-CreateVolumesFromImageTest-463197901 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:41:36 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-eb73140b-6837-4fcc-ac24-af44c55bb53e tempest-CreateVolumesFromImageTest-463197901 None] Deleted volume successfully. Nov 06 15:41:36 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-eb73140b-6837-4fcc-ac24-af44c55bb53e tempest-CreateVolumesFromImageTest-463197901 None] Lock "cinder-e5227f57-9551-4aea-813f-b0cd0a6b27b9-delete_volume" released by "delete_volume" :: held 1.450s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:41:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-621f6085-62a5-47ed-99ad-455455606fad tempest-CinderUnicodeTest-485864985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:41:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-621f6085-62a5-47ed-99ad-455455606fad tempest-CinderUnicodeTest-485864985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:41:36 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-621f6085-62a5-47ed-99ad-455455606fad tempest-CinderUnicodeTest-485864985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:41:36 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-621f6085-62a5-47ed-99ad-455455606fad tempest-CinderUnicodeTest-485864985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:41:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-621f6085-62a5-47ed-99ad-455455606fad tempest-CinderUnicodeTest-485864985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:41:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-621f6085-62a5-47ed-99ad-455455606fad tempest-CinderUnicodeTest-485864985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:36 devstack sudo[107795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d0a2e61e-e471-48a9-bd64-80c4184a89e1 Nov 06 15:41:36 devstack sudo[107795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:36 devstack sudo[107796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:41:36 devstack sudo[107796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:36 devstack sudo[107796]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-621f6085-62a5-47ed-99ad-455455606fad tempest-CinderUnicodeTest-485864985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.311s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:36 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-621f6085-62a5-47ed-99ad-455455606fad tempest-CinderUnicodeTest-485864985 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:41:36 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-621f6085-62a5-47ed-99ad-455455606fad tempest-CinderUnicodeTest-485864985 None] Deleted volume successfully. Nov 06 15:41:36 devstack sudo[107795]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-eb78d36f-2260-47a6-baa7-f24c7bb9392c tempest-ProjectReaderTests-90568800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d0a2e61e-e471-48a9-bd64-80c4184a89e1" returned: 0 in 0.501s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-eb78d36f-2260-47a6-baa7-f24c7bb9392c tempest-ProjectReaderTests-90568800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d0a2e61e-e471-48a9-bd64-80c4184a89e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d0a2e61e-e471-48a9-bd64-80c4184a89e1.16ef52f9-3398-4e5d-ac59-ad373adc5587 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:36 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-621f6085-62a5-47ed-99ad-455455606fad tempest-CinderUnicodeTest-485864985 None] Lock "cinder-21c68185-d00b-498e-b90b-98ca8c09f468-delete_volume" released by "delete_volume" :: held 1.602s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:41:36 devstack sudo[107803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d0a2e61e-e471-48a9-bd64-80c4184a89e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d0a2e61e-e471-48a9-bd64-80c4184a89e1.16ef52f9-3398-4e5d-ac59-ad373adc5587 1G Nov 06 15:41:36 devstack sudo[107803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:37 devstack sudo[107803]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-eb78d36f-2260-47a6-baa7-f24c7bb9392c tempest-ProjectReaderTests-90568800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d0a2e61e-e471-48a9-bd64-80c4184a89e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d0a2e61e-e471-48a9-bd64-80c4184a89e1.16ef52f9-3398-4e5d-ac59-ad373adc5587 1G" returned: 0 in 0.504s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-eb78d36f-2260-47a6-baa7-f24c7bb9392c tempest-ProjectReaderTests-90568800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0a2e61e-e471-48a9-bd64-80c4184a89e1 -F qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d0a2e61e-e471-48a9-bd64-80c4184a89e1.16ef52f9-3398-4e5d-ac59-ad373adc5587 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:37 devstack sudo[107809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0a2e61e-e471-48a9-bd64-80c4184a89e1 -F qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d0a2e61e-e471-48a9-bd64-80c4184a89e1.16ef52f9-3398-4e5d-ac59-ad373adc5587 Nov 06 15:41:37 devstack sudo[107809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:37 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d531d770-9230-4061-b901-669d1b0209ca tempest-CinderUnicodeTest-485864985 None] Acquiring lock "cinder-0ca746b7-2657-46c5-842c-b90bc7c46f21-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:41:37 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d531d770-9230-4061-b901-669d1b0209ca tempest-CinderUnicodeTest-485864985 None] Lock "cinder-0ca746b7-2657-46c5-842c-b90bc7c46f21-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:41:37 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d531d770-9230-4061-b901-669d1b0209ca tempest-CinderUnicodeTest-485864985 None] Acquiring lock "cinder-quobyte-0ca746b7-2657-46c5-842c-b90bc7c46f21" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:41:37 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d531d770-9230-4061-b901-669d1b0209ca tempest-CinderUnicodeTest-485864985 None] Lock "cinder-quobyte-0ca746b7-2657-46c5-842c-b90bc7c46f21" acquired by "delete_volume" :: waited 0.015s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:41:37 devstack sudo[107809]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-eb78d36f-2260-47a6-baa7-f24c7bb9392c tempest-ProjectReaderTests-90568800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0a2e61e-e471-48a9-bd64-80c4184a89e1 -F qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d0a2e61e-e471-48a9-bd64-80c4184a89e1.16ef52f9-3398-4e5d-ac59-ad373adc5587" returned: 0 in 0.396s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:37 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-eb78d36f-2260-47a6-baa7-f24c7bb9392c tempest-ProjectReaderTests-90568800 None] /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d0a2e61e-e471-48a9-bd64-80c4184a89e1.16ef52f9-3398-4e5d-ac59-ad373adc5587 is being set with open permissions: ugo+rw Nov 06 15:41:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-eb78d36f-2260-47a6-baa7-f24c7bb9392c tempest-ProjectReaderTests-90568800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d0a2e61e-e471-48a9-bd64-80c4184a89e1.16ef52f9-3398-4e5d-ac59-ad373adc5587 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:37 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b8f8acd-7e71-4969-ba2b-0ff2e2c7102f]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:41:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d531d770-9230-4061-b901-669d1b0209ca tempest-CinderUnicodeTest-485864985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0ca746b7-2657-46c5-842c-b90bc7c46f21 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:37 devstack sudo[107814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d0a2e61e-e471-48a9-bd64-80c4184a89e1.16ef52f9-3398-4e5d-ac59-ad373adc5587 Nov 06 15:41:37 devstack sudo[107814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:37 devstack sudo[107815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0ca746b7-2657-46c5-842c-b90bc7c46f21 Nov 06 15:41:37 devstack sudo[107815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:37 devstack sudo[107814]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-eb78d36f-2260-47a6-baa7-f24c7bb9392c tempest-ProjectReaderTests-90568800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d0a2e61e-e471-48a9-bd64-80c4184a89e1.16ef52f9-3398-4e5d-ac59-ad373adc5587" returned: 0 in 0.336s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-eb78d36f-2260-47a6-baa7-f24c7bb9392c tempest-ProjectReaderTests-90568800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d0a2e61e-e471-48a9-bd64-80c4184a89e1.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:37 devstack sudo[107819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d0a2e61e-e471-48a9-bd64-80c4184a89e1.info Nov 06 15:41:37 devstack sudo[107819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:37 devstack sudo[107815]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d531d770-9230-4061-b901-669d1b0209ca tempest-CinderUnicodeTest-485864985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0ca746b7-2657-46c5-842c-b90bc7c46f21" returned: 0 in 0.488s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d531d770-9230-4061-b901-669d1b0209ca tempest-CinderUnicodeTest-485864985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0ca746b7-2657-46c5-842c-b90bc7c46f21 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:38 devstack sudo[107824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0ca746b7-2657-46c5-842c-b90bc7c46f21 Nov 06 15:41:38 devstack sudo[107824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:38 devstack sudo[107819]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-eb78d36f-2260-47a6-baa7-f24c7bb9392c tempest-ProjectReaderTests-90568800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d0a2e61e-e471-48a9-bd64-80c4184a89e1.info" returned: 0 in 0.322s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:38 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-eb78d36f-2260-47a6-baa7-f24c7bb9392c tempest-ProjectReaderTests-90568800 None] /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d0a2e61e-e471-48a9-bd64-80c4184a89e1.info is being set with open permissions: ugo+rw Nov 06 15:41:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-eb78d36f-2260-47a6-baa7-f24c7bb9392c tempest-ProjectReaderTests-90568800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d0a2e61e-e471-48a9-bd64-80c4184a89e1.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:38 devstack sudo[107827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d0a2e61e-e471-48a9-bd64-80c4184a89e1.info Nov 06 15:41:38 devstack sudo[107827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:38 devstack sudo[107824]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d531d770-9230-4061-b901-669d1b0209ca tempest-CinderUnicodeTest-485864985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0ca746b7-2657-46c5-842c-b90bc7c46f21" returned: 0 in 0.295s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:38 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d531d770-9230-4061-b901-669d1b0209ca tempest-CinderUnicodeTest-485864985 None] Lock "cinder-quobyte-0ca746b7-2657-46c5-842c-b90bc7c46f21" released by "delete_volume" :: held 0.853s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:41:38 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-d531d770-9230-4061-b901-669d1b0209ca tempest-CinderUnicodeTest-485864985 None] Created reservations ['8c989f65-cbca-4eec-a139-45dc9fd9999a', 'eb99c794-34a2-4776-851c-7d9ae9e6c596', 'dacd7671-c445-4bfd-91c7-cfa5599ee3e9', 'dae9677a-ea42-42cf-8418-71969335db87'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:41:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-d531d770-9230-4061-b901-669d1b0209ca tempest-CinderUnicodeTest-485864985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:41:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-d531d770-9230-4061-b901-669d1b0209ca tempest-CinderUnicodeTest-485864985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:41:38 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-d531d770-9230-4061-b901-669d1b0209ca tempest-CinderUnicodeTest-485864985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:41:38 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-d531d770-9230-4061-b901-669d1b0209ca tempest-CinderUnicodeTest-485864985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:41:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-d531d770-9230-4061-b901-669d1b0209ca tempest-CinderUnicodeTest-485864985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:41:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d531d770-9230-4061-b901-669d1b0209ca tempest-CinderUnicodeTest-485864985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:38 devstack sudo[107827]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-eb78d36f-2260-47a6-baa7-f24c7bb9392c tempest-ProjectReaderTests-90568800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d0a2e61e-e471-48a9-bd64-80c4184a89e1.info" returned: 0 in 0.315s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:38 devstack sudo[107831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:41:38 devstack sudo[107831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-eb78d36f-2260-47a6-baa7-f24c7bb9392c tempest-ProjectReaderTests-90568800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.505s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:41:38 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-eb78d36f-2260-47a6-baa7-f24c7bb9392c tempest-ProjectReaderTests-90568800 None] Create snapshot completed successfully Nov 06 15:41:38 devstack sudo[107831]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d531d770-9230-4061-b901-669d1b0209ca tempest-CinderUnicodeTest-485864985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.300s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:38 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-d531d770-9230-4061-b901-669d1b0209ca tempest-CinderUnicodeTest-485864985 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:41:38 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-d531d770-9230-4061-b901-669d1b0209ca tempest-CinderUnicodeTest-485864985 None] Deleted volume successfully. Nov 06 15:41:38 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d531d770-9230-4061-b901-669d1b0209ca tempest-CinderUnicodeTest-485864985 None] Lock "cinder-0ca746b7-2657-46c5-842c-b90bc7c46f21-delete_volume" released by "delete_volume" :: held 1.442s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:41:39 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-ea5d9752-0de2-46ec-8efe-d47db1200a68 tempest-ProjectReaderTests-90568800 None] Acquiring lock "cinder-16ef52f9-3398-4e5d-ac59-ad373adc5587-delete_snapshot" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:41:39 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-ea5d9752-0de2-46ec-8efe-d47db1200a68 tempest-ProjectReaderTests-90568800 None] Lock "cinder-16ef52f9-3398-4e5d-ac59-ad373adc5587-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:41:39 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-ea5d9752-0de2-46ec-8efe-d47db1200a68 tempest-ProjectReaderTests-90568800 None] Acquiring lock "cinder-quobyte-d0a2e61e-e471-48a9-bd64-80c4184a89e1" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:41:39 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-ea5d9752-0de2-46ec-8efe-d47db1200a68 tempest-ProjectReaderTests-90568800 None] Lock "cinder-quobyte-d0a2e61e-e471-48a9-bd64-80c4184a89e1" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:41:39 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-ea5d9752-0de2-46ec-8efe-d47db1200a68 tempest-ProjectReaderTests-90568800 None] Acquiring lock "cinder-quobyte-16ef52f9-3398-4e5d-ac59-ad373adc5587" by "_delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:41:39 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-ea5d9752-0de2-46ec-8efe-d47db1200a68 tempest-ProjectReaderTests-90568800 None] Lock "cinder-quobyte-16ef52f9-3398-4e5d-ac59-ad373adc5587" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:41:39 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-ea5d9752-0de2-46ec-8efe-d47db1200a68 tempest-ProjectReaderTests-90568800 None] Deleting offline snapshot 16ef52f9-3398-4e5d-ac59-ad373adc5587 of volume d0a2e61e-e471-48a9-bd64-80c4184a89e1 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 15:41:39 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-ea5d9752-0de2-46ec-8efe-d47db1200a68 tempest-ProjectReaderTests-90568800 None] snapshot_file for this snap is: volume-d0a2e61e-e471-48a9-bd64-80c4184a89e1.16ef52f9-3398-4e5d-ac59-ad373adc5587 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 15:41:39 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[79ffdd0d-f16e-4355-b9df-ab662f8c7147]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:41:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ea5d9752-0de2-46ec-8efe-d47db1200a68 tempest-ProjectReaderTests-90568800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d0a2e61e-e471-48a9-bd64-80c4184a89e1.16ef52f9-3398-4e5d-ac59-ad373adc5587 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:39 devstack sudo[107834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d0a2e61e-e471-48a9-bd64-80c4184a89e1.16ef52f9-3398-4e5d-ac59-ad373adc5587 Nov 06 15:41:39 devstack sudo[107834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:40 devstack sudo[107834]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ea5d9752-0de2-46ec-8efe-d47db1200a68 tempest-ProjectReaderTests-90568800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d0a2e61e-e471-48a9-bd64-80c4184a89e1.16ef52f9-3398-4e5d-ac59-ad373adc5587" returned: 0 in 0.476s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:40 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-ea5d9752-0de2-46ec-8efe-d47db1200a68 tempest-ProjectReaderTests-90568800 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d0a2e61e-e471-48a9-bd64-80c4184a89e1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 15:41:40 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[858d9984-646e-4b03-a321-e0f1006fafa9]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:41:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ea5d9752-0de2-46ec-8efe-d47db1200a68 tempest-ProjectReaderTests-90568800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d0a2e61e-e471-48a9-bd64-80c4184a89e1 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:40 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ef8ba7d-533c-43ab-abf0-0e345372a418 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:41:40 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9ef8ba7d-533c-43ab-abf0-0e345372a418 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Flow 'volume_create_manager' (3a7e632d-2a94-43ba-946e-26de0840bea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:41:40 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9ef8ba7d-533c-43ab-abf0-0e345372a418 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25ba8fa5-9e98-4e9d-afb7-dd08b83b60a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:40 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9ef8ba7d-533c-43ab-abf0-0e345372a418 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25ba8fa5-9e98-4e9d-afb7-dd08b83b60a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:41:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-846688967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49a193ee-de72-48b1-bd5f-e9eb478f9006,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a587835d01e74f8d8028b1e7f34a9d24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:41:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:41:40Z,use_quota=True,user_id='e212f1db05e541fa97ad1852a9378f25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:40 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9ef8ba7d-533c-43ab-abf0-0e345372a418 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f71de78-074e-4107-ac7d-c12681db0a3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:40 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9ef8ba7d-533c-43ab-abf0-0e345372a418 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f71de78-074e-4107-ac7d-c12681db0a3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:40 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9ef8ba7d-533c-43ab-abf0-0e345372a418 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1746e2bb-3a8d-4401-ac12-e79a9168902d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:40 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9ef8ba7d-533c-43ab-abf0-0e345372a418 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1746e2bb-3a8d-4401-ac12-e79a9168902d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49a193ee-de72-48b1-bd5f-e9eb478f9006', 'volume_name': 'volume-49a193ee-de72-48b1-bd5f-e9eb478f9006', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:40 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9ef8ba7d-533c-43ab-abf0-0e345372a418 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f28f035-50fa-44ac-bd60-88132e4110e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:40 devstack sudo[107839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d0a2e61e-e471-48a9-bd64-80c4184a89e1 Nov 06 15:41:40 devstack sudo[107839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:40 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9ef8ba7d-533c-43ab-abf0-0e345372a418 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f28f035-50fa-44ac-bd60-88132e4110e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:40 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9ef8ba7d-533c-43ab-abf0-0e345372a418 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d733f8f1-9f5b-48e8-987e-ecf383818c94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:40 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-9ef8ba7d-533c-43ab-abf0-0e345372a418 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Volume 49a193ee-de72-48b1-bd5f-e9eb478f9006: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49a193ee-de72-48b1-bd5f-e9eb478f9006', 'volume_size': 1} Nov 06 15:41:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9ef8ba7d-533c-43ab-abf0-0e345372a418 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:41:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9ef8ba7d-533c-43ab-abf0-0e345372a418 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:41:40 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-9ef8ba7d-533c-43ab-abf0-0e345372a418 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:41:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-846688967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49a193ee-de72-48b1-bd5f-e9eb478f9006,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a587835d01e74f8d8028b1e7f34a9d24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:41:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:41:40Z,use_quota=True,user_id='e212f1db05e541fa97ad1852a9378f25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:41:40 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-9ef8ba7d-533c-43ab-abf0-0e345372a418 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Creating volume 49a193ee-de72-48b1-bd5f-e9eb478f9006 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:41:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9ef8ba7d-533c-43ab-abf0-0e345372a418 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:41:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9ef8ba7d-533c-43ab-abf0-0e345372a418 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:41:40 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-9ef8ba7d-533c-43ab-abf0-0e345372a418 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:41:40 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-9ef8ba7d-533c-43ab-abf0-0e345372a418 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:41:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9ef8ba7d-533c-43ab-abf0-0e345372a418 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:41:40 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-9ef8ba7d-533c-43ab-abf0-0e345372a418 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:41:40 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-9ef8ba7d-533c-43ab-abf0-0e345372a418 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:41:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9ef8ba7d-533c-43ab-abf0-0e345372a418 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-49a193ee-de72-48b1-bd5f-e9eb478f9006 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:40 devstack sudo[107841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-49a193ee-de72-48b1-bd5f-e9eb478f9006 1073741824 Nov 06 15:41:40 devstack sudo[107841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:40 devstack sudo[107839]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ea5d9752-0de2-46ec-8efe-d47db1200a68 tempest-ProjectReaderTests-90568800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d0a2e61e-e471-48a9-bd64-80c4184a89e1" returned: 0 in 0.521s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ea5d9752-0de2-46ec-8efe-d47db1200a68 tempest-ProjectReaderTests-90568800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d0a2e61e-e471-48a9-bd64-80c4184a89e1.16ef52f9-3398-4e5d-ac59-ad373adc5587 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:40 devstack sudo[107851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d0a2e61e-e471-48a9-bd64-80c4184a89e1.16ef52f9-3398-4e5d-ac59-ad373adc5587 Nov 06 15:41:40 devstack sudo[107851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:40 devstack sudo[107841]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9ef8ba7d-533c-43ab-abf0-0e345372a418 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-49a193ee-de72-48b1-bd5f-e9eb478f9006 1073741824" returned: 0 in 0.584s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9ef8ba7d-533c-43ab-abf0-0e345372a418 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-49a193ee-de72-48b1-bd5f-e9eb478f9006 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:41 devstack sudo[107854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-49a193ee-de72-48b1-bd5f-e9eb478f9006 Nov 06 15:41:41 devstack sudo[107854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:41 devstack sudo[107851]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ea5d9752-0de2-46ec-8efe-d47db1200a68 tempest-ProjectReaderTests-90568800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d0a2e61e-e471-48a9-bd64-80c4184a89e1.16ef52f9-3398-4e5d-ac59-ad373adc5587" returned: 0 in 0.461s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ea5d9752-0de2-46ec-8efe-d47db1200a68 tempest-ProjectReaderTests-90568800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d0a2e61e-e471-48a9-bd64-80c4184a89e1.16ef52f9-3398-4e5d-ac59-ad373adc5587 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:41 devstack sudo[107858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d0a2e61e-e471-48a9-bd64-80c4184a89e1.16ef52f9-3398-4e5d-ac59-ad373adc5587 Nov 06 15:41:41 devstack sudo[107858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:41 devstack sudo[107854]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9ef8ba7d-533c-43ab-abf0-0e345372a418 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-49a193ee-de72-48b1-bd5f-e9eb478f9006" returned: 0 in 0.353s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:41 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-9ef8ba7d-533c-43ab-abf0-0e345372a418 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] <== create_volume: return (988ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:41:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9ef8ba7d-533c-43ab-abf0-0e345372a418 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.993s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:41:41 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9ef8ba7d-533c-43ab-abf0-0e345372a418 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d733f8f1-9f5b-48e8-987e-ecf383818c94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49a193ee-de72-48b1-bd5f-e9eb478f9006', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:41 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9ef8ba7d-533c-43ab-abf0-0e345372a418 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7004a6c7-47bc-4f72-98f3-b20696163faa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:41 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-9ef8ba7d-533c-43ab-abf0-0e345372a418 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Volume volume-49a193ee-de72-48b1-bd5f-e9eb478f9006 (49a193ee-de72-48b1-bd5f-e9eb478f9006): created successfully Nov 06 15:41:41 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9ef8ba7d-533c-43ab-abf0-0e345372a418 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7004a6c7-47bc-4f72-98f3-b20696163faa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:41 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9ef8ba7d-533c-43ab-abf0-0e345372a418 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Flow 'volume_create_manager' (3a7e632d-2a94-43ba-946e-26de0840bea4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:41:41 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-9ef8ba7d-533c-43ab-abf0-0e345372a418 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Created volume successfully. Nov 06 15:41:41 devstack sudo[107858]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ea5d9752-0de2-46ec-8efe-d47db1200a68 tempest-ProjectReaderTests-90568800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d0a2e61e-e471-48a9-bd64-80c4184a89e1.16ef52f9-3398-4e5d-ac59-ad373adc5587" returned: 0 in 0.306s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:41 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-ea5d9752-0de2-46ec-8efe-d47db1200a68 tempest-ProjectReaderTests-90568800 None] Lock "cinder-quobyte-16ef52f9-3398-4e5d-ac59-ad373adc5587" released by "_delete_snapshot" :: held 1.933s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:41:41 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-ea5d9752-0de2-46ec-8efe-d47db1200a68 tempest-ProjectReaderTests-90568800 None] Lock "cinder-quobyte-d0a2e61e-e471-48a9-bd64-80c4184a89e1" released by "delete_snapshot" :: held 1.965s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:41:41 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-ea5d9752-0de2-46ec-8efe-d47db1200a68 tempest-ProjectReaderTests-90568800 None] Created reservations ['95ea4e23-2b5e-4795-8d02-59939579e827', '35e0f13d-4abe-4e3c-9f52-db893cf7149f', '64408439-bc02-4cbe-82b1-3a96567af5b0', '0cc5e3a2-93d9-4858-b9a6-1650601b829f'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:41:41 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-ea5d9752-0de2-46ec-8efe-d47db1200a68 tempest-ProjectReaderTests-90568800 None] Delete snapshot completed successfully. Nov 06 15:41:41 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-ea5d9752-0de2-46ec-8efe-d47db1200a68 tempest-ProjectReaderTests-90568800 None] Lock "cinder-16ef52f9-3398-4e5d-ac59-ad373adc5587-delete_snapshot" released by "delete_snapshot" :: held 2.149s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:41:42 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-c448cbd5-7c86-4d68-93a1-ee4652916a34 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:41:42 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c448cbd5-7c86-4d68-93a1-ee4652916a34 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Flow 'volume_create_manager' (a6cdcf7e-6d7d-4649-a032-d37c100e6a10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:41:42 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c448cbd5-7c86-4d68-93a1-ee4652916a34 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (075c520d-19a0-401e-8b51-5f57ac9f31d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:42 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c448cbd5-7c86-4d68-93a1-ee4652916a34 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (075c520d-19a0-401e-8b51-5f57ac9f31d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:41:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1937890490',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f95e19ec-6f28-49f7-8497-415dee766160,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a587835d01e74f8d8028b1e7f34a9d24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:41:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:41:43Z,use_quota=True,user_id='e212f1db05e541fa97ad1852a9378f25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:42 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c448cbd5-7c86-4d68-93a1-ee4652916a34 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2aad051d-76de-4bc3-8e32-11f210217dc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:42 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c448cbd5-7c86-4d68-93a1-ee4652916a34 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2aad051d-76de-4bc3-8e32-11f210217dc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:42 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c448cbd5-7c86-4d68-93a1-ee4652916a34 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25637757-090a-411d-b18d-92f0465f27ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:42 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c448cbd5-7c86-4d68-93a1-ee4652916a34 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25637757-090a-411d-b18d-92f0465f27ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f95e19ec-6f28-49f7-8497-415dee766160', 'volume_name': 'volume-f95e19ec-6f28-49f7-8497-415dee766160', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:42 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c448cbd5-7c86-4d68-93a1-ee4652916a34 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81ea055e-2c04-4eaa-a896-5ac532ea5da6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:42 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c448cbd5-7c86-4d68-93a1-ee4652916a34 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81ea055e-2c04-4eaa-a896-5ac532ea5da6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:42 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c448cbd5-7c86-4d68-93a1-ee4652916a34 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9cfc4e0-b680-4e2b-be66-856689c50866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:42 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-c448cbd5-7c86-4d68-93a1-ee4652916a34 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Volume f95e19ec-6f28-49f7-8497-415dee766160: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f95e19ec-6f28-49f7-8497-415dee766160', 'volume_size': 1} Nov 06 15:41:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c448cbd5-7c86-4d68-93a1-ee4652916a34 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:41:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c448cbd5-7c86-4d68-93a1-ee4652916a34 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:41:42 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c448cbd5-7c86-4d68-93a1-ee4652916a34 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:41:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1937890490',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f95e19ec-6f28-49f7-8497-415dee766160,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a587835d01e74f8d8028b1e7f34a9d24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:41:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:41:43Z,use_quota=True,user_id='e212f1db05e541fa97ad1852a9378f25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:41:42 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-c448cbd5-7c86-4d68-93a1-ee4652916a34 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Creating volume f95e19ec-6f28-49f7-8497-415dee766160 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:41:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c448cbd5-7c86-4d68-93a1-ee4652916a34 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:41:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c448cbd5-7c86-4d68-93a1-ee4652916a34 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:41:42 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c448cbd5-7c86-4d68-93a1-ee4652916a34 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:41:42 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c448cbd5-7c86-4d68-93a1-ee4652916a34 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:41:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c448cbd5-7c86-4d68-93a1-ee4652916a34 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:41:42 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c448cbd5-7c86-4d68-93a1-ee4652916a34 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:41:42 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-c448cbd5-7c86-4d68-93a1-ee4652916a34 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:41:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c448cbd5-7c86-4d68-93a1-ee4652916a34 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f95e19ec-6f28-49f7-8497-415dee766160 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:42 devstack sudo[107862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f95e19ec-6f28-49f7-8497-415dee766160 1073741824 Nov 06 15:41:42 devstack sudo[107862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:43 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-b93d023c-5573-4fba-ab05-bb2123abb75c tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:41:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b93d023c-5573-4fba-ab05-bb2123abb75c tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Flow 'volume_create_manager' (83ab01e8-2560-466a-875c-1e6f674066b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:41:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b93d023c-5573-4fba-ab05-bb2123abb75c tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54b862d6-8b97-46a7-aac6-9d0f83a7ef3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b93d023c-5573-4fba-ab05-bb2123abb75c tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54b862d6-8b97-46a7-aac6-9d0f83a7ef3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:41:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2080132636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=805018a4-417a-4dce-a7b2-15628a29a8a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a587835d01e74f8d8028b1e7f34a9d24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:41:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:41:43Z,use_quota=True,user_id='e212f1db05e541fa97ad1852a9378f25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b93d023c-5573-4fba-ab05-bb2123abb75c tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e96a2e09-be40-409a-bf02-bda7b6e89287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b93d023c-5573-4fba-ab05-bb2123abb75c tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e96a2e09-be40-409a-bf02-bda7b6e89287) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b93d023c-5573-4fba-ab05-bb2123abb75c tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88a505a5-289b-478b-bc1a-d65aa8bb5ff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b93d023c-5573-4fba-ab05-bb2123abb75c tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88a505a5-289b-478b-bc1a-d65aa8bb5ff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '805018a4-417a-4dce-a7b2-15628a29a8a8', 'volume_name': 'volume-805018a4-417a-4dce-a7b2-15628a29a8a8', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b93d023c-5573-4fba-ab05-bb2123abb75c tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f6d4176-cca8-4922-acb3-7a24df78e602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b93d023c-5573-4fba-ab05-bb2123abb75c tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f6d4176-cca8-4922-acb3-7a24df78e602) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b93d023c-5573-4fba-ab05-bb2123abb75c tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (509791d7-c9ee-43a4-b635-48e774656816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:43 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-b93d023c-5573-4fba-ab05-bb2123abb75c tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Volume 805018a4-417a-4dce-a7b2-15628a29a8a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-805018a4-417a-4dce-a7b2-15628a29a8a8', 'volume_size': 1} Nov 06 15:41:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b93d023c-5573-4fba-ab05-bb2123abb75c tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:41:43 devstack sudo[107862]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c448cbd5-7c86-4d68-93a1-ee4652916a34 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f95e19ec-6f28-49f7-8497-415dee766160 1073741824" returned: 0 in 0.551s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c448cbd5-7c86-4d68-93a1-ee4652916a34 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f95e19ec-6f28-49f7-8497-415dee766160 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:43 devstack sudo[107868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f95e19ec-6f28-49f7-8497-415dee766160 Nov 06 15:41:43 devstack sudo[107868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:43 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-800fce04-3820-49d5-a505-f4324d850411 tempest-ProjectReaderTests-90568800 None] Acquiring lock "cinder-d0a2e61e-e471-48a9-bd64-80c4184a89e1-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:41:43 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-800fce04-3820-49d5-a505-f4324d850411 tempest-ProjectReaderTests-90568800 None] Lock "cinder-d0a2e61e-e471-48a9-bd64-80c4184a89e1-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:41:43 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-800fce04-3820-49d5-a505-f4324d850411 tempest-ProjectReaderTests-90568800 None] Acquiring lock "cinder-quobyte-d0a2e61e-e471-48a9-bd64-80c4184a89e1" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:41:43 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-800fce04-3820-49d5-a505-f4324d850411 tempest-ProjectReaderTests-90568800 None] Lock "cinder-quobyte-d0a2e61e-e471-48a9-bd64-80c4184a89e1" acquired by "delete_volume" :: waited 0.019s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:41:43 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbd27866-093c-432b-adcb-fe895f24f2d5]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:41:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-800fce04-3820-49d5-a505-f4324d850411 tempest-ProjectReaderTests-90568800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d0a2e61e-e471-48a9-bd64-80c4184a89e1 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:43 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-5cabdbf3-fc68-4817-910b-0d9d79ddaa0f tempest-ProjectMemberTests-2050864699 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:41:44 devstack sudo[107868]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:44 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5cabdbf3-fc68-4817-910b-0d9d79ddaa0f tempest-ProjectMemberTests-2050864699 None] Flow 'volume_create_manager' (519f8d64-aef4-4063-a38f-077766224fa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:41:44 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5cabdbf3-fc68-4817-910b-0d9d79ddaa0f tempest-ProjectMemberTests-2050864699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10e11519-7e10-40c1-a20f-63da3ab769e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c448cbd5-7c86-4d68-93a1-ee4652916a34 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f95e19ec-6f28-49f7-8497-415dee766160" returned: 0 in 0.550s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:44 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c448cbd5-7c86-4d68-93a1-ee4652916a34 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] <== create_volume: return (1156ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:41:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c448cbd5-7c86-4d68-93a1-ee4652916a34 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.159s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:41:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b93d023c-5573-4fba-ab05-bb2123abb75c tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.688s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:41:44 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-b93d023c-5573-4fba-ab05-bb2123abb75c tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:41:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2080132636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=805018a4-417a-4dce-a7b2-15628a29a8a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a587835d01e74f8d8028b1e7f34a9d24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:41:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:41:43Z,use_quota=True,user_id='e212f1db05e541fa97ad1852a9378f25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:41:44 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-b93d023c-5573-4fba-ab05-bb2123abb75c tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Creating volume 805018a4-417a-4dce-a7b2-15628a29a8a8 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:41:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b93d023c-5573-4fba-ab05-bb2123abb75c tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:41:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b93d023c-5573-4fba-ab05-bb2123abb75c tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:41:44 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-b93d023c-5573-4fba-ab05-bb2123abb75c tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:41:44 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-b93d023c-5573-4fba-ab05-bb2123abb75c tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:41:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b93d023c-5573-4fba-ab05-bb2123abb75c tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:41:44 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-b93d023c-5573-4fba-ab05-bb2123abb75c tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:41:44 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-b93d023c-5573-4fba-ab05-bb2123abb75c tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:41:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b93d023c-5573-4fba-ab05-bb2123abb75c tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-805018a4-417a-4dce-a7b2-15628a29a8a8 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:44 devstack sudo[107871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d0a2e61e-e471-48a9-bd64-80c4184a89e1 Nov 06 15:41:44 devstack sudo[107871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:44 devstack sudo[107873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-805018a4-417a-4dce-a7b2-15628a29a8a8 1073741824 Nov 06 15:41:44 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5cabdbf3-fc68-4817-910b-0d9d79ddaa0f tempest-ProjectMemberTests-2050864699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10e11519-7e10-40c1-a20f-63da3ab769e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:41:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1999741980',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee946548-f107-4f74-a205-ecb3f6c716b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='631b1acb2fe74ff38bf682df0fb94c26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:41:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:41:44Z,use_quota=True,user_id='c2ab5a7c9b61494492f0f3bd6193ebdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:44 devstack sudo[107873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:44 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5cabdbf3-fc68-4817-910b-0d9d79ddaa0f tempest-ProjectMemberTests-2050864699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ffb563d-c9d2-4c50-90ef-39d6dba89289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:44 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5cabdbf3-fc68-4817-910b-0d9d79ddaa0f tempest-ProjectMemberTests-2050864699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ffb563d-c9d2-4c50-90ef-39d6dba89289) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:44 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5cabdbf3-fc68-4817-910b-0d9d79ddaa0f tempest-ProjectMemberTests-2050864699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9d3d208-da48-4f12-98f7-bb44f456be35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:44 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5cabdbf3-fc68-4817-910b-0d9d79ddaa0f tempest-ProjectMemberTests-2050864699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9d3d208-da48-4f12-98f7-bb44f456be35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee946548-f107-4f74-a205-ecb3f6c716b2', 'volume_name': 'volume-ee946548-f107-4f74-a205-ecb3f6c716b2', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:44 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5cabdbf3-fc68-4817-910b-0d9d79ddaa0f tempest-ProjectMemberTests-2050864699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (293029b0-a5ca-43cb-8c9d-4412f6fd70bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:44 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5cabdbf3-fc68-4817-910b-0d9d79ddaa0f tempest-ProjectMemberTests-2050864699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (293029b0-a5ca-43cb-8c9d-4412f6fd70bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:44 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5cabdbf3-fc68-4817-910b-0d9d79ddaa0f tempest-ProjectMemberTests-2050864699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f500e90-f008-4168-8c10-a8f29716874a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:44 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-5cabdbf3-fc68-4817-910b-0d9d79ddaa0f tempest-ProjectMemberTests-2050864699 None] Volume ee946548-f107-4f74-a205-ecb3f6c716b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee946548-f107-4f74-a205-ecb3f6c716b2', 'volume_size': 1} Nov 06 15:41:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5cabdbf3-fc68-4817-910b-0d9d79ddaa0f tempest-ProjectMemberTests-2050864699 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:41:44 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c448cbd5-7c86-4d68-93a1-ee4652916a34 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9cfc4e0-b680-4e2b-be66-856689c50866) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f95e19ec-6f28-49f7-8497-415dee766160', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:44 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c448cbd5-7c86-4d68-93a1-ee4652916a34 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2116e0ee-5186-4bbd-9bf0-c3b112462afa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:44 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-c448cbd5-7c86-4d68-93a1-ee4652916a34 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Volume volume-f95e19ec-6f28-49f7-8497-415dee766160 (f95e19ec-6f28-49f7-8497-415dee766160): created successfully Nov 06 15:41:44 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c448cbd5-7c86-4d68-93a1-ee4652916a34 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2116e0ee-5186-4bbd-9bf0-c3b112462afa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:44 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c448cbd5-7c86-4d68-93a1-ee4652916a34 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Flow 'volume_create_manager' (a6cdcf7e-6d7d-4649-a032-d37c100e6a10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:41:44 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-0fafb719-1e60-43c1-a7f7-ad915b8b4cb9 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:41:44 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0fafb719-1e60-43c1-a7f7-ad915b8b4cb9 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Flow 'volume_create_manager' (02523863-0e0a-4e6c-b597-9497c8db5ec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:41:44 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0fafb719-1e60-43c1-a7f7-ad915b8b4cb9 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed4fa1af-5a73-4c04-b40a-f6c12ca9c2fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:44 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-c448cbd5-7c86-4d68-93a1-ee4652916a34 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Created volume successfully. Nov 06 15:41:44 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0fafb719-1e60-43c1-a7f7-ad915b8b4cb9 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed4fa1af-5a73-4c04-b40a-f6c12ca9c2fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:41:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2092657563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a83c848a-d6b9-4ff1-8e43-41a6b093a614,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a587835d01e74f8d8028b1e7f34a9d24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:41:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:41:44Z,use_quota=True,user_id='e212f1db05e541fa97ad1852a9378f25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:44 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0fafb719-1e60-43c1-a7f7-ad915b8b4cb9 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50f25354-97e4-45bd-94e4-4bcd38d005a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:44 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0fafb719-1e60-43c1-a7f7-ad915b8b4cb9 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50f25354-97e4-45bd-94e4-4bcd38d005a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:44 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0fafb719-1e60-43c1-a7f7-ad915b8b4cb9 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e3eef02-5df1-47cb-9784-130eeb96d39f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:44 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0fafb719-1e60-43c1-a7f7-ad915b8b4cb9 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e3eef02-5df1-47cb-9784-130eeb96d39f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a83c848a-d6b9-4ff1-8e43-41a6b093a614', 'volume_name': 'volume-a83c848a-d6b9-4ff1-8e43-41a6b093a614', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:44 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0fafb719-1e60-43c1-a7f7-ad915b8b4cb9 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84528abc-4880-45bd-89ed-f988c1967acd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:44 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0fafb719-1e60-43c1-a7f7-ad915b8b4cb9 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84528abc-4880-45bd-89ed-f988c1967acd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:44 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0fafb719-1e60-43c1-a7f7-ad915b8b4cb9 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49579f22-497f-4f58-b434-a60eb26a42b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:44 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-0fafb719-1e60-43c1-a7f7-ad915b8b4cb9 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Volume a83c848a-d6b9-4ff1-8e43-41a6b093a614: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a83c848a-d6b9-4ff1-8e43-41a6b093a614', 'volume_size': 1} Nov 06 15:41:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0fafb719-1e60-43c1-a7f7-ad915b8b4cb9 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:41:44 devstack sudo[107871]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-800fce04-3820-49d5-a505-f4324d850411 tempest-ProjectReaderTests-90568800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d0a2e61e-e471-48a9-bd64-80c4184a89e1" returned: 0 in 0.582s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-800fce04-3820-49d5-a505-f4324d850411 tempest-ProjectReaderTests-90568800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d0a2e61e-e471-48a9-bd64-80c4184a89e1 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:44 devstack sudo[107881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d0a2e61e-e471-48a9-bd64-80c4184a89e1 Nov 06 15:41:44 devstack sudo[107881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:44 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-a72b45ac-2d76-4de8-8c2f-3fac6eb38f2c tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:41:44 devstack sudo[107873]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:44 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a72b45ac-2d76-4de8-8c2f-3fac6eb38f2c tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Flow 'volume_create_manager' (0f98cb4c-df5e-45ac-aafc-8e4830a17f03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:41:44 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a72b45ac-2d76-4de8-8c2f-3fac6eb38f2c tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a4b5a3e-be49-47c9-931b-8fe00b85c5bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b93d023c-5573-4fba-ab05-bb2123abb75c tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-805018a4-417a-4dce-a7b2-15628a29a8a8 1073741824" returned: 0 in 0.720s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:44 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a72b45ac-2d76-4de8-8c2f-3fac6eb38f2c tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a4b5a3e-be49-47c9-931b-8fe00b85c5bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:41:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2024884261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8131c3b-3b42-4ff3-81f0-d6f7176c4a32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a587835d01e74f8d8028b1e7f34a9d24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:41:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:41:45Z,use_quota=True,user_id='e212f1db05e541fa97ad1852a9378f25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:44 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a72b45ac-2d76-4de8-8c2f-3fac6eb38f2c tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88c80139-951f-4de9-974a-27d225a44fab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:44 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a72b45ac-2d76-4de8-8c2f-3fac6eb38f2c tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88c80139-951f-4de9-974a-27d225a44fab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:44 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a72b45ac-2d76-4de8-8c2f-3fac6eb38f2c tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a67629d-8770-40c0-86b5-648f2b2c07f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:44 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a72b45ac-2d76-4de8-8c2f-3fac6eb38f2c tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a67629d-8770-40c0-86b5-648f2b2c07f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8131c3b-3b42-4ff3-81f0-d6f7176c4a32', 'volume_name': 'volume-d8131c3b-3b42-4ff3-81f0-d6f7176c4a32', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:44 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a72b45ac-2d76-4de8-8c2f-3fac6eb38f2c tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ce8ba04-fef6-4f60-afa5-d91a9c0c76d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:44 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a72b45ac-2d76-4de8-8c2f-3fac6eb38f2c tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ce8ba04-fef6-4f60-afa5-d91a9c0c76d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:44 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a72b45ac-2d76-4de8-8c2f-3fac6eb38f2c tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52b7c53f-6584-4ef7-9082-8eaa289930b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:44 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-a72b45ac-2d76-4de8-8c2f-3fac6eb38f2c tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Volume d8131c3b-3b42-4ff3-81f0-d6f7176c4a32: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8131c3b-3b42-4ff3-81f0-d6f7176c4a32', 'volume_size': 1} Nov 06 15:41:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a72b45ac-2d76-4de8-8c2f-3fac6eb38f2c tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:41:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b93d023c-5573-4fba-ab05-bb2123abb75c tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-805018a4-417a-4dce-a7b2-15628a29a8a8 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:44 devstack sudo[107881]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-800fce04-3820-49d5-a505-f4324d850411 tempest-ProjectReaderTests-90568800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d0a2e61e-e471-48a9-bd64-80c4184a89e1" returned: 0 in 0.418s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:44 devstack sudo[107885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-805018a4-417a-4dce-a7b2-15628a29a8a8 Nov 06 15:41:44 devstack sudo[107885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:45 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-800fce04-3820-49d5-a505-f4324d850411 tempest-ProjectReaderTests-90568800 None] Lock "cinder-quobyte-d0a2e61e-e471-48a9-bd64-80c4184a89e1" released by "delete_volume" :: held 1.140s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:41:45 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-800fce04-3820-49d5-a505-f4324d850411 tempest-ProjectReaderTests-90568800 None] Created reservations ['12a96792-7d45-412d-99f5-4efaa666b0e8', '0693a5ef-c75d-40ad-b2cc-b0ec757a285e', 'b9f3e21b-0a5d-4f0d-bcd4-334bd6c73196', 'def0846a-d658-4ea7-a185-2bb9ca37b678'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:41:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-800fce04-3820-49d5-a505-f4324d850411 tempest-ProjectReaderTests-90568800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:41:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-800fce04-3820-49d5-a505-f4324d850411 tempest-ProjectReaderTests-90568800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:41:45 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-800fce04-3820-49d5-a505-f4324d850411 tempest-ProjectReaderTests-90568800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:41:45 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-800fce04-3820-49d5-a505-f4324d850411 tempest-ProjectReaderTests-90568800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:41:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-800fce04-3820-49d5-a505-f4324d850411 tempest-ProjectReaderTests-90568800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:41:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-800fce04-3820-49d5-a505-f4324d850411 tempest-ProjectReaderTests-90568800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:45 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-29c6169a-101f-4b41-ae78-5dc7e9511c38 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:41:45 devstack sudo[107885]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:45 devstack sudo[107888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:41:45 devstack sudo[107888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:45 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-29c6169a-101f-4b41-ae78-5dc7e9511c38 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Flow 'volume_create_manager' (895ecca6-b076-43ef-815b-1c9094112855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:41:45 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-29c6169a-101f-4b41-ae78-5dc7e9511c38 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (240c8486-f59f-41c2-af10-2c6b96f45c13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b93d023c-5573-4fba-ab05-bb2123abb75c tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-805018a4-417a-4dce-a7b2-15628a29a8a8" returned: 0 in 0.347s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:45 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-b93d023c-5573-4fba-ab05-bb2123abb75c tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] <== create_volume: return (1187ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:41:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b93d023c-5573-4fba-ab05-bb2123abb75c tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.191s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:41:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5cabdbf3-fc68-4817-910b-0d9d79ddaa0f tempest-ProjectMemberTests-2050864699 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.032s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:41:45 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-5cabdbf3-fc68-4817-910b-0d9d79ddaa0f tempest-ProjectMemberTests-2050864699 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:41:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1999741980',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee946548-f107-4f74-a205-ecb3f6c716b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='631b1acb2fe74ff38bf682df0fb94c26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:41:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:41:44Z,use_quota=True,user_id='c2ab5a7c9b61494492f0f3bd6193ebdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:41:45 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-5cabdbf3-fc68-4817-910b-0d9d79ddaa0f tempest-ProjectMemberTests-2050864699 None] Creating volume ee946548-f107-4f74-a205-ecb3f6c716b2 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:41:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5cabdbf3-fc68-4817-910b-0d9d79ddaa0f tempest-ProjectMemberTests-2050864699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:41:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5cabdbf3-fc68-4817-910b-0d9d79ddaa0f tempest-ProjectMemberTests-2050864699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:41:45 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-5cabdbf3-fc68-4817-910b-0d9d79ddaa0f tempest-ProjectMemberTests-2050864699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:41:45 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-5cabdbf3-fc68-4817-910b-0d9d79ddaa0f tempest-ProjectMemberTests-2050864699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:41:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5cabdbf3-fc68-4817-910b-0d9d79ddaa0f tempest-ProjectMemberTests-2050864699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:41:45 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-5cabdbf3-fc68-4817-910b-0d9d79ddaa0f tempest-ProjectMemberTests-2050864699 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:41:45 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-5cabdbf3-fc68-4817-910b-0d9d79ddaa0f tempest-ProjectMemberTests-2050864699 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:41:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5cabdbf3-fc68-4817-910b-0d9d79ddaa0f tempest-ProjectMemberTests-2050864699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ee946548-f107-4f74-a205-ecb3f6c716b2 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:45 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b93d023c-5573-4fba-ab05-bb2123abb75c tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (509791d7-c9ee-43a4-b635-48e774656816) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-805018a4-417a-4dce-a7b2-15628a29a8a8', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:45 devstack sudo[107890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ee946548-f107-4f74-a205-ecb3f6c716b2 1073741824 Nov 06 15:41:45 devstack sudo[107890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:45 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b93d023c-5573-4fba-ab05-bb2123abb75c tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24f3ad04-2d99-4019-85ce-ea46274b7741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:45 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-29c6169a-101f-4b41-ae78-5dc7e9511c38 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (240c8486-f59f-41c2-af10-2c6b96f45c13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:41:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-186931152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e441185-ada6-4a70-bb1a-687622fdefb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a587835d01e74f8d8028b1e7f34a9d24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:41:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:41:45Z,use_quota=True,user_id='e212f1db05e541fa97ad1852a9378f25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:45 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-29c6169a-101f-4b41-ae78-5dc7e9511c38 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a311cd43-e431-490d-b719-7e433df5fb7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:45 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-29c6169a-101f-4b41-ae78-5dc7e9511c38 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a311cd43-e431-490d-b719-7e433df5fb7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:45 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-29c6169a-101f-4b41-ae78-5dc7e9511c38 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0632c970-0c36-4209-b326-5a2d0cc81c7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:45 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-29c6169a-101f-4b41-ae78-5dc7e9511c38 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0632c970-0c36-4209-b326-5a2d0cc81c7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e441185-ada6-4a70-bb1a-687622fdefb1', 'volume_name': 'volume-0e441185-ada6-4a70-bb1a-687622fdefb1', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:45 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-29c6169a-101f-4b41-ae78-5dc7e9511c38 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1726c430-553d-4a2c-8144-93cbe45ba9b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:45 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-29c6169a-101f-4b41-ae78-5dc7e9511c38 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1726c430-553d-4a2c-8144-93cbe45ba9b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:45 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-29c6169a-101f-4b41-ae78-5dc7e9511c38 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ccdc909-fb9a-4d0a-b010-97d4e70a69a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:45 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-29c6169a-101f-4b41-ae78-5dc7e9511c38 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Volume 0e441185-ada6-4a70-bb1a-687622fdefb1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e441185-ada6-4a70-bb1a-687622fdefb1', 'volume_size': 1} Nov 06 15:41:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-29c6169a-101f-4b41-ae78-5dc7e9511c38 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:41:45 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-b93d023c-5573-4fba-ab05-bb2123abb75c tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Volume volume-805018a4-417a-4dce-a7b2-15628a29a8a8 (805018a4-417a-4dce-a7b2-15628a29a8a8): created successfully Nov 06 15:41:45 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b93d023c-5573-4fba-ab05-bb2123abb75c tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24f3ad04-2d99-4019-85ce-ea46274b7741) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:45 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b93d023c-5573-4fba-ab05-bb2123abb75c tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Flow 'volume_create_manager' (83ab01e8-2560-466a-875c-1e6f674066b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:41:45 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-b93d023c-5573-4fba-ab05-bb2123abb75c tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Created volume successfully. Nov 06 15:41:45 devstack sudo[107888]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-800fce04-3820-49d5-a505-f4324d850411 tempest-ProjectReaderTests-90568800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.282s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:45 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-800fce04-3820-49d5-a505-f4324d850411 tempest-ProjectReaderTests-90568800 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:41:45 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-800fce04-3820-49d5-a505-f4324d850411 tempest-ProjectReaderTests-90568800 None] Deleted volume successfully. Nov 06 15:41:45 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-800fce04-3820-49d5-a505-f4324d850411 tempest-ProjectReaderTests-90568800 None] Lock "cinder-d0a2e61e-e471-48a9-bd64-80c4184a89e1-delete_volume" released by "delete_volume" :: held 1.740s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:41:45 devstack sudo[107890]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5cabdbf3-fc68-4817-910b-0d9d79ddaa0f tempest-ProjectMemberTests-2050864699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ee946548-f107-4f74-a205-ecb3f6c716b2 1073741824" returned: 0 in 0.484s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5cabdbf3-fc68-4817-910b-0d9d79ddaa0f tempest-ProjectMemberTests-2050864699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ee946548-f107-4f74-a205-ecb3f6c716b2 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:45 devstack sudo[107898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ee946548-f107-4f74-a205-ecb3f6c716b2 Nov 06 15:41:45 devstack sudo[107898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:46 devstack sudo[107898]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5cabdbf3-fc68-4817-910b-0d9d79ddaa0f tempest-ProjectMemberTests-2050864699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ee946548-f107-4f74-a205-ecb3f6c716b2" returned: 0 in 0.258s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:46 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-5cabdbf3-fc68-4817-910b-0d9d79ddaa0f tempest-ProjectMemberTests-2050864699 None] <== create_volume: return (790ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:41:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5cabdbf3-fc68-4817-910b-0d9d79ddaa0f tempest-ProjectMemberTests-2050864699 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.793s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:41:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0fafb719-1e60-43c1-a7f7-ad915b8b4cb9 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.616s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:41:46 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0fafb719-1e60-43c1-a7f7-ad915b8b4cb9 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:41:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2092657563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a83c848a-d6b9-4ff1-8e43-41a6b093a614,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a587835d01e74f8d8028b1e7f34a9d24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:41:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:41:44Z,use_quota=True,user_id='e212f1db05e541fa97ad1852a9378f25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:41:46 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-0fafb719-1e60-43c1-a7f7-ad915b8b4cb9 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Creating volume a83c848a-d6b9-4ff1-8e43-41a6b093a614 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:41:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0fafb719-1e60-43c1-a7f7-ad915b8b4cb9 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:41:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0fafb719-1e60-43c1-a7f7-ad915b8b4cb9 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:41:46 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0fafb719-1e60-43c1-a7f7-ad915b8b4cb9 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:41:46 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0fafb719-1e60-43c1-a7f7-ad915b8b4cb9 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:41:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0fafb719-1e60-43c1-a7f7-ad915b8b4cb9 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:41:46 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0fafb719-1e60-43c1-a7f7-ad915b8b4cb9 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:41:46 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-0fafb719-1e60-43c1-a7f7-ad915b8b4cb9 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:41:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0fafb719-1e60-43c1-a7f7-ad915b8b4cb9 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a83c848a-d6b9-4ff1-8e43-41a6b093a614 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:46 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5cabdbf3-fc68-4817-910b-0d9d79ddaa0f tempest-ProjectMemberTests-2050864699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f500e90-f008-4168-8c10-a8f29716874a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee946548-f107-4f74-a205-ecb3f6c716b2', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:46 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5cabdbf3-fc68-4817-910b-0d9d79ddaa0f tempest-ProjectMemberTests-2050864699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2d28c69-752b-4477-8292-76fcba606afe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:46 devstack sudo[107901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a83c848a-d6b9-4ff1-8e43-41a6b093a614 1073741824 Nov 06 15:41:46 devstack sudo[107901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:46 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-5cabdbf3-fc68-4817-910b-0d9d79ddaa0f tempest-ProjectMemberTests-2050864699 None] Volume volume-ee946548-f107-4f74-a205-ecb3f6c716b2 (ee946548-f107-4f74-a205-ecb3f6c716b2): created successfully Nov 06 15:41:46 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5cabdbf3-fc68-4817-910b-0d9d79ddaa0f tempest-ProjectMemberTests-2050864699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2d28c69-752b-4477-8292-76fcba606afe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:46 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5cabdbf3-fc68-4817-910b-0d9d79ddaa0f tempest-ProjectMemberTests-2050864699 None] Flow 'volume_create_manager' (519f8d64-aef4-4063-a38f-077766224fa4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:41:46 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-5cabdbf3-fc68-4817-910b-0d9d79ddaa0f tempest-ProjectMemberTests-2050864699 None] Created volume successfully. Nov 06 15:41:46 devstack sudo[107901]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0fafb719-1e60-43c1-a7f7-ad915b8b4cb9 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a83c848a-d6b9-4ff1-8e43-41a6b093a614 1073741824" returned: 0 in 0.491s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0fafb719-1e60-43c1-a7f7-ad915b8b4cb9 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a83c848a-d6b9-4ff1-8e43-41a6b093a614 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:46 devstack sudo[107906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a83c848a-d6b9-4ff1-8e43-41a6b093a614 Nov 06 15:41:46 devstack sudo[107906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:46 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-02fde0c1-62a3-41e0-a6b3-423c917823f4 tempest-ProjectReaderTests-90568800 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:41:46 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-02fde0c1-62a3-41e0-a6b3-423c917823f4 tempest-ProjectReaderTests-90568800 None] Flow 'volume_create_manager' (221f8faa-7c75-4f86-8c9e-853796469b28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:41:46 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-02fde0c1-62a3-41e0-a6b3-423c917823f4 tempest-ProjectReaderTests-90568800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b777738b-395a-46b6-a8a0-ff95a1c539bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:46 devstack sudo[107906]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:46 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-02fde0c1-62a3-41e0-a6b3-423c917823f4 tempest-ProjectReaderTests-90568800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b777738b-395a-46b6-a8a0-ff95a1c539bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:41:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1522785542',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=920b5ec5-5878-48a2-8623-a9de2745c9d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa0e5fb1579d44329b27513f0572ba4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:41:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:41:47Z,use_quota=True,user_id='8f151b147eaa443a8d1a0ac4f9b0c7fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:46 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-02fde0c1-62a3-41e0-a6b3-423c917823f4 tempest-ProjectReaderTests-90568800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f962efc-a0bd-4a83-9908-cbec322624b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:46 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-02fde0c1-62a3-41e0-a6b3-423c917823f4 tempest-ProjectReaderTests-90568800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f962efc-a0bd-4a83-9908-cbec322624b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:46 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-02fde0c1-62a3-41e0-a6b3-423c917823f4 tempest-ProjectReaderTests-90568800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c94939a-4f89-4ba6-b396-fdbbfcd2fdb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:46 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-02fde0c1-62a3-41e0-a6b3-423c917823f4 tempest-ProjectReaderTests-90568800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c94939a-4f89-4ba6-b396-fdbbfcd2fdb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '920b5ec5-5878-48a2-8623-a9de2745c9d1', 'volume_name': 'volume-920b5ec5-5878-48a2-8623-a9de2745c9d1', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:46 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-02fde0c1-62a3-41e0-a6b3-423c917823f4 tempest-ProjectReaderTests-90568800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8a5470a-c7bc-4cc7-b49c-fdc3bb98af66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:46 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-02fde0c1-62a3-41e0-a6b3-423c917823f4 tempest-ProjectReaderTests-90568800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8a5470a-c7bc-4cc7-b49c-fdc3bb98af66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:46 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-02fde0c1-62a3-41e0-a6b3-423c917823f4 tempest-ProjectReaderTests-90568800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96dcc5a3-026b-442a-ab02-093dc6a5355a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:46 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-02fde0c1-62a3-41e0-a6b3-423c917823f4 tempest-ProjectReaderTests-90568800 None] Volume 920b5ec5-5878-48a2-8623-a9de2745c9d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-920b5ec5-5878-48a2-8623-a9de2745c9d1', 'volume_size': 1} Nov 06 15:41:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-02fde0c1-62a3-41e0-a6b3-423c917823f4 tempest-ProjectReaderTests-90568800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:41:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0fafb719-1e60-43c1-a7f7-ad915b8b4cb9 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a83c848a-d6b9-4ff1-8e43-41a6b093a614" returned: 0 in 0.341s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:46 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0fafb719-1e60-43c1-a7f7-ad915b8b4cb9 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] <== create_volume: return (887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:41:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0fafb719-1e60-43c1-a7f7-ad915b8b4cb9 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.890s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:41:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a72b45ac-2d76-4de8-8c2f-3fac6eb38f2c tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.082s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:41:46 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-a72b45ac-2d76-4de8-8c2f-3fac6eb38f2c tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:41:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2024884261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8131c3b-3b42-4ff3-81f0-d6f7176c4a32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a587835d01e74f8d8028b1e7f34a9d24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:41:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:41:45Z,use_quota=True,user_id='e212f1db05e541fa97ad1852a9378f25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:41:46 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-a72b45ac-2d76-4de8-8c2f-3fac6eb38f2c tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Creating volume d8131c3b-3b42-4ff3-81f0-d6f7176c4a32 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:41:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a72b45ac-2d76-4de8-8c2f-3fac6eb38f2c tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:41:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a72b45ac-2d76-4de8-8c2f-3fac6eb38f2c tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:41:46 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-a72b45ac-2d76-4de8-8c2f-3fac6eb38f2c tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:41:46 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-a72b45ac-2d76-4de8-8c2f-3fac6eb38f2c tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:41:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a72b45ac-2d76-4de8-8c2f-3fac6eb38f2c tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:41:46 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-a72b45ac-2d76-4de8-8c2f-3fac6eb38f2c tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:41:46 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-a72b45ac-2d76-4de8-8c2f-3fac6eb38f2c tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:41:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a72b45ac-2d76-4de8-8c2f-3fac6eb38f2c tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d8131c3b-3b42-4ff3-81f0-d6f7176c4a32 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:46 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0fafb719-1e60-43c1-a7f7-ad915b8b4cb9 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49579f22-497f-4f58-b434-a60eb26a42b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a83c848a-d6b9-4ff1-8e43-41a6b093a614', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:47 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0fafb719-1e60-43c1-a7f7-ad915b8b4cb9 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3047d92-f400-44f6-b65f-24de1b3296a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:47 devstack sudo[107909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d8131c3b-3b42-4ff3-81f0-d6f7176c4a32 1073741824 Nov 06 15:41:47 devstack sudo[107909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:47 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-0fafb719-1e60-43c1-a7f7-ad915b8b4cb9 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Volume volume-a83c848a-d6b9-4ff1-8e43-41a6b093a614 (a83c848a-d6b9-4ff1-8e43-41a6b093a614): created successfully Nov 06 15:41:47 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0fafb719-1e60-43c1-a7f7-ad915b8b4cb9 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3047d92-f400-44f6-b65f-24de1b3296a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:47 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0fafb719-1e60-43c1-a7f7-ad915b8b4cb9 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Flow 'volume_create_manager' (02523863-0e0a-4e6c-b597-9497c8db5ec1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:41:47 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-0fafb719-1e60-43c1-a7f7-ad915b8b4cb9 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Created volume successfully. Nov 06 15:41:47 devstack sudo[107909]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a72b45ac-2d76-4de8-8c2f-3fac6eb38f2c tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d8131c3b-3b42-4ff3-81f0-d6f7176c4a32 1073741824" returned: 0 in 0.534s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a72b45ac-2d76-4de8-8c2f-3fac6eb38f2c tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d8131c3b-3b42-4ff3-81f0-d6f7176c4a32 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:47 devstack sudo[107916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d8131c3b-3b42-4ff3-81f0-d6f7176c4a32 Nov 06 15:41:47 devstack sudo[107916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1b0f8e6e-1b1b-4006-9c7f-08dacf57f0b1 tempest-ProjectMemberTests-2050864699 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:41:47 devstack sudo[107916]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a72b45ac-2d76-4de8-8c2f-3fac6eb38f2c tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d8131c3b-3b42-4ff3-81f0-d6f7176c4a32" returned: 0 in 0.328s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:47 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-a72b45ac-2d76-4de8-8c2f-3fac6eb38f2c tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] <== create_volume: return (913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:41:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a72b45ac-2d76-4de8-8c2f-3fac6eb38f2c tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.915s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:41:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-29c6169a-101f-4b41-ae78-5dc7e9511c38 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.514s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:41:47 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-29c6169a-101f-4b41-ae78-5dc7e9511c38 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:41:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-186931152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e441185-ada6-4a70-bb1a-687622fdefb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a587835d01e74f8d8028b1e7f34a9d24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:41:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:41:45Z,use_quota=True,user_id='e212f1db05e541fa97ad1852a9378f25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:41:47 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-29c6169a-101f-4b41-ae78-5dc7e9511c38 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Creating volume 0e441185-ada6-4a70-bb1a-687622fdefb1 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:41:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-29c6169a-101f-4b41-ae78-5dc7e9511c38 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:41:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-29c6169a-101f-4b41-ae78-5dc7e9511c38 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:41:47 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-29c6169a-101f-4b41-ae78-5dc7e9511c38 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:41:47 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-29c6169a-101f-4b41-ae78-5dc7e9511c38 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:41:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-29c6169a-101f-4b41-ae78-5dc7e9511c38 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:41:47 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-29c6169a-101f-4b41-ae78-5dc7e9511c38 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:41:47 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-29c6169a-101f-4b41-ae78-5dc7e9511c38 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:41:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-29c6169a-101f-4b41-ae78-5dc7e9511c38 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0e441185-ada6-4a70-bb1a-687622fdefb1 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:47 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a72b45ac-2d76-4de8-8c2f-3fac6eb38f2c tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52b7c53f-6584-4ef7-9082-8eaa289930b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8131c3b-3b42-4ff3-81f0-d6f7176c4a32', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:47 devstack sudo[107919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0e441185-ada6-4a70-bb1a-687622fdefb1 1073741824 Nov 06 15:41:47 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a72b45ac-2d76-4de8-8c2f-3fac6eb38f2c tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eff7a8ec-0b6e-467c-b493-2dc1cc7bca8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:47 devstack sudo[107919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:47 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-a72b45ac-2d76-4de8-8c2f-3fac6eb38f2c tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Volume volume-d8131c3b-3b42-4ff3-81f0-d6f7176c4a32 (d8131c3b-3b42-4ff3-81f0-d6f7176c4a32): created successfully Nov 06 15:41:47 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a72b45ac-2d76-4de8-8c2f-3fac6eb38f2c tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eff7a8ec-0b6e-467c-b493-2dc1cc7bca8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:47 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a72b45ac-2d76-4de8-8c2f-3fac6eb38f2c tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Flow 'volume_create_manager' (0f98cb4c-df5e-45ac-aafc-8e4830a17f03) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:41:47 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-a72b45ac-2d76-4de8-8c2f-3fac6eb38f2c tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Created volume successfully. Nov 06 15:41:48 devstack sudo[107919]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-29c6169a-101f-4b41-ae78-5dc7e9511c38 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0e441185-ada6-4a70-bb1a-687622fdefb1 1073741824" returned: 0 in 0.443s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-29c6169a-101f-4b41-ae78-5dc7e9511c38 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0e441185-ada6-4a70-bb1a-687622fdefb1 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:48 devstack sudo[107926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0e441185-ada6-4a70-bb1a-687622fdefb1 Nov 06 15:41:48 devstack sudo[107926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:48 devstack sudo[107926]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-29c6169a-101f-4b41-ae78-5dc7e9511c38 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0e441185-ada6-4a70-bb1a-687622fdefb1" returned: 0 in 0.233s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:48 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-29c6169a-101f-4b41-ae78-5dc7e9511c38 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] <== create_volume: return (721ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:41:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-29c6169a-101f-4b41-ae78-5dc7e9511c38 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.723s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:41:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-02fde0c1-62a3-41e0-a6b3-423c917823f4 tempest-ProjectReaderTests-90568800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.650s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:41:48 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-02fde0c1-62a3-41e0-a6b3-423c917823f4 tempest-ProjectReaderTests-90568800 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:41:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1522785542',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=920b5ec5-5878-48a2-8623-a9de2745c9d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa0e5fb1579d44329b27513f0572ba4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:41:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:41:47Z,use_quota=True,user_id='8f151b147eaa443a8d1a0ac4f9b0c7fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:41:48 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-02fde0c1-62a3-41e0-a6b3-423c917823f4 tempest-ProjectReaderTests-90568800 None] Creating volume 920b5ec5-5878-48a2-8623-a9de2745c9d1 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:41:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-02fde0c1-62a3-41e0-a6b3-423c917823f4 tempest-ProjectReaderTests-90568800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:41:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-02fde0c1-62a3-41e0-a6b3-423c917823f4 tempest-ProjectReaderTests-90568800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:41:48 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-02fde0c1-62a3-41e0-a6b3-423c917823f4 tempest-ProjectReaderTests-90568800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:41:48 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-02fde0c1-62a3-41e0-a6b3-423c917823f4 tempest-ProjectReaderTests-90568800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:41:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-02fde0c1-62a3-41e0-a6b3-423c917823f4 tempest-ProjectReaderTests-90568800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:41:48 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-02fde0c1-62a3-41e0-a6b3-423c917823f4 tempest-ProjectReaderTests-90568800 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:41:48 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-02fde0c1-62a3-41e0-a6b3-423c917823f4 tempest-ProjectReaderTests-90568800 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:41:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-02fde0c1-62a3-41e0-a6b3-423c917823f4 tempest-ProjectReaderTests-90568800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-920b5ec5-5878-48a2-8623-a9de2745c9d1 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:48 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-29c6169a-101f-4b41-ae78-5dc7e9511c38 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ccdc909-fb9a-4d0a-b010-97d4e70a69a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e441185-ada6-4a70-bb1a-687622fdefb1', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:48 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-29c6169a-101f-4b41-ae78-5dc7e9511c38 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (736c416d-31b9-41d6-b7cd-68d3894c81ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:48 devstack sudo[107929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-920b5ec5-5878-48a2-8623-a9de2745c9d1 1073741824 Nov 06 15:41:48 devstack sudo[107929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:48 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-29c6169a-101f-4b41-ae78-5dc7e9511c38 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Volume volume-0e441185-ada6-4a70-bb1a-687622fdefb1 (0e441185-ada6-4a70-bb1a-687622fdefb1): created successfully Nov 06 15:41:48 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-29c6169a-101f-4b41-ae78-5dc7e9511c38 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (736c416d-31b9-41d6-b7cd-68d3894c81ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:48 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-29c6169a-101f-4b41-ae78-5dc7e9511c38 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Flow 'volume_create_manager' (895ecca6-b076-43ef-815b-1c9094112855) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:41:48 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-29c6169a-101f-4b41-ae78-5dc7e9511c38 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Created volume successfully. Nov 06 15:41:49 devstack sudo[107929]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-02fde0c1-62a3-41e0-a6b3-423c917823f4 tempest-ProjectReaderTests-90568800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-920b5ec5-5878-48a2-8623-a9de2745c9d1 1073741824" returned: 0 in 0.453s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-02fde0c1-62a3-41e0-a6b3-423c917823f4 tempest-ProjectReaderTests-90568800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-920b5ec5-5878-48a2-8623-a9de2745c9d1 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:49 devstack sudo[107934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-920b5ec5-5878-48a2-8623-a9de2745c9d1 Nov 06 15:41:49 devstack sudo[107934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:49 devstack sudo[107934]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-02fde0c1-62a3-41e0-a6b3-423c917823f4 tempest-ProjectReaderTests-90568800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-920b5ec5-5878-48a2-8623-a9de2745c9d1" returned: 0 in 0.240s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:49 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-02fde0c1-62a3-41e0-a6b3-423c917823f4 tempest-ProjectReaderTests-90568800 None] <== create_volume: return (732ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:41:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-02fde0c1-62a3-41e0-a6b3-423c917823f4 tempest-ProjectReaderTests-90568800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.734s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:41:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1b0f8e6e-1b1b-4006-9c7f-08dacf57f0b1 tempest-ProjectMemberTests-2050864699 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.631s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:41:49 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-02fde0c1-62a3-41e0-a6b3-423c917823f4 tempest-ProjectReaderTests-90568800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96dcc5a3-026b-442a-ab02-093dc6a5355a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-920b5ec5-5878-48a2-8623-a9de2745c9d1', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:49 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-02fde0c1-62a3-41e0-a6b3-423c917823f4 tempest-ProjectReaderTests-90568800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83879318-b460-406f-9841-a34140ca3b59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:49 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-1b0f8e6e-1b1b-4006-9c7f-08dacf57f0b1 tempest-ProjectMemberTests-2050864699 None] Creating offline snapshot 640a6e9f-afcf-40d9-b78c-ee319308a0ff of volume ee946548-f107-4f74-a205-ecb3f6c716b2 {{(pid=87132) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 15:41:49 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-02fde0c1-62a3-41e0-a6b3-423c917823f4 tempest-ProjectReaderTests-90568800 None] Volume volume-920b5ec5-5878-48a2-8623-a9de2745c9d1 (920b5ec5-5878-48a2-8623-a9de2745c9d1): created successfully Nov 06 15:41:49 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-02fde0c1-62a3-41e0-a6b3-423c917823f4 tempest-ProjectReaderTests-90568800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83879318-b460-406f-9841-a34140ca3b59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:49 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-02fde0c1-62a3-41e0-a6b3-423c917823f4 tempest-ProjectReaderTests-90568800 None] Flow 'volume_create_manager' (221f8faa-7c75-4f86-8c9e-853796469b28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:41:49 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c69e673-20e8-49bc-9507-0b9393e044a7]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:41:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1b0f8e6e-1b1b-4006-9c7f-08dacf57f0b1 tempest-ProjectMemberTests-2050864699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ee946548-f107-4f74-a205-ecb3f6c716b2 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:49 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-02fde0c1-62a3-41e0-a6b3-423c917823f4 tempest-ProjectReaderTests-90568800 None] Created volume successfully. Nov 06 15:41:49 devstack sudo[107938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ee946548-f107-4f74-a205-ecb3f6c716b2 Nov 06 15:41:49 devstack sudo[107938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:49 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-ab97754f-557c-4664-a067-93a61e84adf3 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Acquiring lock "cinder-0e441185-ada6-4a70-bb1a-687622fdefb1-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:41:49 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-ab97754f-557c-4664-a067-93a61e84adf3 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Lock "cinder-0e441185-ada6-4a70-bb1a-687622fdefb1-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:41:49 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-ab97754f-557c-4664-a067-93a61e84adf3 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Acquiring lock "cinder-quobyte-0e441185-ada6-4a70-bb1a-687622fdefb1" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:41:49 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-ab97754f-557c-4664-a067-93a61e84adf3 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Lock "cinder-quobyte-0e441185-ada6-4a70-bb1a-687622fdefb1" acquired by "delete_volume" :: waited 0.019s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:41:49 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[61eb0d04-c6a9-424c-92bb-5bb246667b8a]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:41:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ab97754f-557c-4664-a067-93a61e84adf3 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0e441185-ada6-4a70-bb1a-687622fdefb1 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:49 devstack sudo[107938]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1b0f8e6e-1b1b-4006-9c7f-08dacf57f0b1 tempest-ProjectMemberTests-2050864699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ee946548-f107-4f74-a205-ecb3f6c716b2" returned: 0 in 0.393s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1b0f8e6e-1b1b-4006-9c7f-08dacf57f0b1 tempest-ProjectMemberTests-2050864699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ee946548-f107-4f74-a205-ecb3f6c716b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ee946548-f107-4f74-a205-ecb3f6c716b2.640a6e9f-afcf-40d9-b78c-ee319308a0ff 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:49 devstack sudo[107944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ee946548-f107-4f74-a205-ecb3f6c716b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ee946548-f107-4f74-a205-ecb3f6c716b2.640a6e9f-afcf-40d9-b78c-ee319308a0ff 1G Nov 06 15:41:49 devstack sudo[107944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:49 devstack sudo[107942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0e441185-ada6-4a70-bb1a-687622fdefb1 Nov 06 15:41:49 devstack sudo[107942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:50 devstack sudo[107942]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ab97754f-557c-4664-a067-93a61e84adf3 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0e441185-ada6-4a70-bb1a-687622fdefb1" returned: 0 in 0.414s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ab97754f-557c-4664-a067-93a61e84adf3 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0e441185-ada6-4a70-bb1a-687622fdefb1 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:50 devstack sudo[107954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0e441185-ada6-4a70-bb1a-687622fdefb1 Nov 06 15:41:50 devstack sudo[107954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-340add4c-3009-4e9c-9468-96959ff37793 tempest-ProjectReaderTests-90568800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:41:50 devstack sudo[107944]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1b0f8e6e-1b1b-4006-9c7f-08dacf57f0b1 tempest-ProjectMemberTests-2050864699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ee946548-f107-4f74-a205-ecb3f6c716b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ee946548-f107-4f74-a205-ecb3f6c716b2.640a6e9f-afcf-40d9-b78c-ee319308a0ff 1G" returned: 0 in 0.507s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1b0f8e6e-1b1b-4006-9c7f-08dacf57f0b1 tempest-ProjectMemberTests-2050864699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee946548-f107-4f74-a205-ecb3f6c716b2 -F qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ee946548-f107-4f74-a205-ecb3f6c716b2.640a6e9f-afcf-40d9-b78c-ee319308a0ff {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:50 devstack sudo[107956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee946548-f107-4f74-a205-ecb3f6c716b2 -F qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ee946548-f107-4f74-a205-ecb3f6c716b2.640a6e9f-afcf-40d9-b78c-ee319308a0ff Nov 06 15:41:50 devstack sudo[107956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:50 devstack sudo[107954]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ab97754f-557c-4664-a067-93a61e84adf3 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-0e441185-ada6-4a70-bb1a-687622fdefb1" returned: 0 in 0.306s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:50 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-ab97754f-557c-4664-a067-93a61e84adf3 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Lock "cinder-quobyte-0e441185-ada6-4a70-bb1a-687622fdefb1" released by "delete_volume" :: held 0.763s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:41:50 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-ab97754f-557c-4664-a067-93a61e84adf3 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Created reservations ['495cf6c5-c48f-44f1-8d24-ebe504eb839b', '0de7c4d7-e736-4b92-981d-f66133e45fd9', 'affdbb45-a2af-4efe-bf91-3e5313442ecd', 'c405503c-ccf7-434c-a5cb-7fb30051325f'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:41:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ab97754f-557c-4664-a067-93a61e84adf3 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:41:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ab97754f-557c-4664-a067-93a61e84adf3 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:41:50 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-ab97754f-557c-4664-a067-93a61e84adf3 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:41:50 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-ab97754f-557c-4664-a067-93a61e84adf3 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:41:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ab97754f-557c-4664-a067-93a61e84adf3 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:41:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ab97754f-557c-4664-a067-93a61e84adf3 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:50 devstack sudo[107956]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1b0f8e6e-1b1b-4006-9c7f-08dacf57f0b1 tempest-ProjectMemberTests-2050864699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee946548-f107-4f74-a205-ecb3f6c716b2 -F qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ee946548-f107-4f74-a205-ecb3f6c716b2.640a6e9f-afcf-40d9-b78c-ee319308a0ff" returned: 0 in 0.319s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:50 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-1b0f8e6e-1b1b-4006-9c7f-08dacf57f0b1 tempest-ProjectMemberTests-2050864699 None] /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ee946548-f107-4f74-a205-ecb3f6c716b2.640a6e9f-afcf-40d9-b78c-ee319308a0ff is being set with open permissions: ugo+rw Nov 06 15:41:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1b0f8e6e-1b1b-4006-9c7f-08dacf57f0b1 tempest-ProjectMemberTests-2050864699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ee946548-f107-4f74-a205-ecb3f6c716b2.640a6e9f-afcf-40d9-b78c-ee319308a0ff {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:50 devstack sudo[107962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:41:50 devstack sudo[107962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:50 devstack sudo[107964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ee946548-f107-4f74-a205-ecb3f6c716b2.640a6e9f-afcf-40d9-b78c-ee319308a0ff Nov 06 15:41:50 devstack sudo[107964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:50 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a3ba9025-f169-499a-b54b-107bd269ef0e tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Acquiring lock "cinder-d8131c3b-3b42-4ff3-81f0-d6f7176c4a32-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:41:50 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a3ba9025-f169-499a-b54b-107bd269ef0e tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Lock "cinder-d8131c3b-3b42-4ff3-81f0-d6f7176c4a32-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:41:50 devstack sudo[107962]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ab97754f-557c-4664-a067-93a61e84adf3 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.368s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:50 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-ab97754f-557c-4664-a067-93a61e84adf3 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:41:50 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a3ba9025-f169-499a-b54b-107bd269ef0e tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Acquiring lock "cinder-quobyte-d8131c3b-3b42-4ff3-81f0-d6f7176c4a32" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:41:50 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-ab97754f-557c-4664-a067-93a61e84adf3 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Deleted volume successfully. Nov 06 15:41:50 devstack sudo[107964]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1b0f8e6e-1b1b-4006-9c7f-08dacf57f0b1 tempest-ProjectMemberTests-2050864699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ee946548-f107-4f74-a205-ecb3f6c716b2.640a6e9f-afcf-40d9-b78c-ee319308a0ff" returned: 0 in 0.356s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:51 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a3ba9025-f169-499a-b54b-107bd269ef0e tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Lock "cinder-quobyte-d8131c3b-3b42-4ff3-81f0-d6f7176c4a32" acquired by "delete_volume" :: waited 0.029s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:41:51 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-ab97754f-557c-4664-a067-93a61e84adf3 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Lock "cinder-0e441185-ada6-4a70-bb1a-687622fdefb1-delete_volume" released by "delete_volume" :: held 1.374s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:41:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1b0f8e6e-1b1b-4006-9c7f-08dacf57f0b1 tempest-ProjectMemberTests-2050864699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ee946548-f107-4f74-a205-ecb3f6c716b2.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:51 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[134e195d-6fdc-4d00-9338-83dfe48dc9e7]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:41:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a3ba9025-f169-499a-b54b-107bd269ef0e tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d8131c3b-3b42-4ff3-81f0-d6f7176c4a32 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:51 devstack sudo[107968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ee946548-f107-4f74-a205-ecb3f6c716b2.info Nov 06 15:41:51 devstack sudo[107968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:51 devstack sudo[107969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d8131c3b-3b42-4ff3-81f0-d6f7176c4a32 Nov 06 15:41:51 devstack sudo[107969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:51 devstack sudo[107968]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1b0f8e6e-1b1b-4006-9c7f-08dacf57f0b1 tempest-ProjectMemberTests-2050864699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ee946548-f107-4f74-a205-ecb3f6c716b2.info" returned: 0 in 0.264s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:51 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-1b0f8e6e-1b1b-4006-9c7f-08dacf57f0b1 tempest-ProjectMemberTests-2050864699 None] /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ee946548-f107-4f74-a205-ecb3f6c716b2.info is being set with open permissions: ugo+rw Nov 06 15:41:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1b0f8e6e-1b1b-4006-9c7f-08dacf57f0b1 tempest-ProjectMemberTests-2050864699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ee946548-f107-4f74-a205-ecb3f6c716b2.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:51 devstack sudo[107973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ee946548-f107-4f74-a205-ecb3f6c716b2.info Nov 06 15:41:51 devstack sudo[107973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:51 devstack sudo[107969]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a3ba9025-f169-499a-b54b-107bd269ef0e tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d8131c3b-3b42-4ff3-81f0-d6f7176c4a32" returned: 0 in 0.399s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a3ba9025-f169-499a-b54b-107bd269ef0e tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d8131c3b-3b42-4ff3-81f0-d6f7176c4a32 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:51 devstack sudo[107978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d8131c3b-3b42-4ff3-81f0-d6f7176c4a32 Nov 06 15:41:51 devstack sudo[107978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:51 devstack sudo[107973]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1b0f8e6e-1b1b-4006-9c7f-08dacf57f0b1 tempest-ProjectMemberTests-2050864699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ee946548-f107-4f74-a205-ecb3f6c716b2.info" returned: 0 in 0.245s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1b0f8e6e-1b1b-4006-9c7f-08dacf57f0b1 tempest-ProjectMemberTests-2050864699 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.218s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:41:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-340add4c-3009-4e9c-9468-96959ff37793 tempest-ProjectReaderTests-90568800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.311s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:41:51 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-340add4c-3009-4e9c-9468-96959ff37793 tempest-ProjectReaderTests-90568800 None] Creating offline snapshot b3b2d37e-3e44-4c43-9704-564ce3efddc7 of volume 920b5ec5-5878-48a2-8623-a9de2745c9d1 {{(pid=87132) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 15:41:51 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-1b0f8e6e-1b1b-4006-9c7f-08dacf57f0b1 tempest-ProjectMemberTests-2050864699 None] Create snapshot completed successfully Nov 06 15:41:51 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd9736e5-e18e-4484-9b69-7dade1f24703]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:41:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-340add4c-3009-4e9c-9468-96959ff37793 tempest-ProjectReaderTests-90568800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-920b5ec5-5878-48a2-8623-a9de2745c9d1 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:51 devstack sudo[107978]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a3ba9025-f169-499a-b54b-107bd269ef0e tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-d8131c3b-3b42-4ff3-81f0-d6f7176c4a32" returned: 0 in 0.268s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:51 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a3ba9025-f169-499a-b54b-107bd269ef0e tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Lock "cinder-quobyte-d8131c3b-3b42-4ff3-81f0-d6f7176c4a32" released by "delete_volume" :: held 0.729s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:41:51 devstack sudo[107981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-920b5ec5-5878-48a2-8623-a9de2745c9d1 Nov 06 15:41:51 devstack sudo[107981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:51 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-a3ba9025-f169-499a-b54b-107bd269ef0e tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Created reservations ['40524d32-f593-4628-8a03-b1ce2fe4ede1', '618d4f80-9671-4bc1-9047-be8b713e1f76', 'f39c69e0-79e0-4074-b27d-55437c1ea76e', 'f267a43c-4330-436e-b4bb-36725993406a'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:41:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a3ba9025-f169-499a-b54b-107bd269ef0e tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:41:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a3ba9025-f169-499a-b54b-107bd269ef0e tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:41:51 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-a3ba9025-f169-499a-b54b-107bd269ef0e tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:41:51 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-a3ba9025-f169-499a-b54b-107bd269ef0e tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:41:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a3ba9025-f169-499a-b54b-107bd269ef0e tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:41:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a3ba9025-f169-499a-b54b-107bd269ef0e tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:51 devstack sudo[107984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:41:51 devstack sudo[107984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:52 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-1da52a8e-9036-4baf-a7de-eac06e95809c tempest-ProjectMemberTests-2050864699 None] Acquiring lock "cinder-640a6e9f-afcf-40d9-b78c-ee319308a0ff-delete_snapshot" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:41:52 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-1da52a8e-9036-4baf-a7de-eac06e95809c tempest-ProjectMemberTests-2050864699 None] Lock "cinder-640a6e9f-afcf-40d9-b78c-ee319308a0ff-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:41:52 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-1da52a8e-9036-4baf-a7de-eac06e95809c tempest-ProjectMemberTests-2050864699 None] Acquiring lock "cinder-quobyte-ee946548-f107-4f74-a205-ecb3f6c716b2" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:41:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-340add4c-3009-4e9c-9468-96959ff37793 tempest-ProjectReaderTests-90568800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-920b5ec5-5878-48a2-8623-a9de2745c9d1" returned: 0 in 0.447s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:52 devstack sudo[107981]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-340add4c-3009-4e9c-9468-96959ff37793 tempest-ProjectReaderTests-90568800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-920b5ec5-5878-48a2-8623-a9de2745c9d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-920b5ec5-5878-48a2-8623-a9de2745c9d1.b3b2d37e-3e44-4c43-9704-564ce3efddc7 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:52 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-1da52a8e-9036-4baf-a7de-eac06e95809c tempest-ProjectMemberTests-2050864699 None] Lock "cinder-quobyte-ee946548-f107-4f74-a205-ecb3f6c716b2" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:41:52 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-1da52a8e-9036-4baf-a7de-eac06e95809c tempest-ProjectMemberTests-2050864699 None] Acquiring lock "cinder-quobyte-640a6e9f-afcf-40d9-b78c-ee319308a0ff" by "_delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:41:52 devstack sudo[107991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-920b5ec5-5878-48a2-8623-a9de2745c9d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-920b5ec5-5878-48a2-8623-a9de2745c9d1.b3b2d37e-3e44-4c43-9704-564ce3efddc7 1G Nov 06 15:41:52 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-1da52a8e-9036-4baf-a7de-eac06e95809c tempest-ProjectMemberTests-2050864699 None] Lock "cinder-quobyte-640a6e9f-afcf-40d9-b78c-ee319308a0ff" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:41:52 devstack sudo[107991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:52 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-1da52a8e-9036-4baf-a7de-eac06e95809c tempest-ProjectMemberTests-2050864699 None] Deleting offline snapshot 640a6e9f-afcf-40d9-b78c-ee319308a0ff of volume ee946548-f107-4f74-a205-ecb3f6c716b2 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 15:41:52 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-1da52a8e-9036-4baf-a7de-eac06e95809c tempest-ProjectMemberTests-2050864699 None] snapshot_file for this snap is: volume-ee946548-f107-4f74-a205-ecb3f6c716b2.640a6e9f-afcf-40d9-b78c-ee319308a0ff {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 15:41:52 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-950d011b-7d96-4483-87f0-3eea965e9276 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Acquiring lock "cinder-a83c848a-d6b9-4ff1-8e43-41a6b093a614-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:41:52 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d02576c-36b9-4281-b749-a2e92f3266b2]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:41:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1da52a8e-9036-4baf-a7de-eac06e95809c tempest-ProjectMemberTests-2050864699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ee946548-f107-4f74-a205-ecb3f6c716b2.640a6e9f-afcf-40d9-b78c-ee319308a0ff {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:52 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-950d011b-7d96-4483-87f0-3eea965e9276 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Lock "cinder-a83c848a-d6b9-4ff1-8e43-41a6b093a614-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:41:52 devstack sudo[107984]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a3ba9025-f169-499a-b54b-107bd269ef0e tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.409s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:52 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-a3ba9025-f169-499a-b54b-107bd269ef0e tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:41:52 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-a3ba9025-f169-499a-b54b-107bd269ef0e tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Deleted volume successfully. Nov 06 15:41:52 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-950d011b-7d96-4483-87f0-3eea965e9276 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Acquiring lock "cinder-quobyte-a83c848a-d6b9-4ff1-8e43-41a6b093a614" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:41:52 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a3ba9025-f169-499a-b54b-107bd269ef0e tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Lock "cinder-d8131c3b-3b42-4ff3-81f0-d6f7176c4a32-delete_volume" released by "delete_volume" :: held 1.450s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:41:52 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-950d011b-7d96-4483-87f0-3eea965e9276 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Lock "cinder-quobyte-a83c848a-d6b9-4ff1-8e43-41a6b093a614" acquired by "delete_volume" :: waited 0.021s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:41:52 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1c1de32-fb0d-4fe3-887b-82ad3e3d2b7b]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:41:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-950d011b-7d96-4483-87f0-3eea965e9276 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a83c848a-d6b9-4ff1-8e43-41a6b093a614 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:52 devstack sudo[107994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ee946548-f107-4f74-a205-ecb3f6c716b2.640a6e9f-afcf-40d9-b78c-ee319308a0ff Nov 06 15:41:52 devstack sudo[107994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:52 devstack sudo[107995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a83c848a-d6b9-4ff1-8e43-41a6b093a614 Nov 06 15:41:52 devstack sudo[107995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:52 devstack sudo[107991]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-340add4c-3009-4e9c-9468-96959ff37793 tempest-ProjectReaderTests-90568800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-920b5ec5-5878-48a2-8623-a9de2745c9d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-920b5ec5-5878-48a2-8623-a9de2745c9d1.b3b2d37e-3e44-4c43-9704-564ce3efddc7 1G" returned: 0 in 0.602s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-340add4c-3009-4e9c-9468-96959ff37793 tempest-ProjectReaderTests-90568800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-920b5ec5-5878-48a2-8623-a9de2745c9d1 -F qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-920b5ec5-5878-48a2-8623-a9de2745c9d1.b3b2d37e-3e44-4c43-9704-564ce3efddc7 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:52 devstack sudo[108004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-920b5ec5-5878-48a2-8623-a9de2745c9d1 -F qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-920b5ec5-5878-48a2-8623-a9de2745c9d1.b3b2d37e-3e44-4c43-9704-564ce3efddc7 Nov 06 15:41:52 devstack sudo[108004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:52 devstack sudo[107994]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1da52a8e-9036-4baf-a7de-eac06e95809c tempest-ProjectMemberTests-2050864699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ee946548-f107-4f74-a205-ecb3f6c716b2.640a6e9f-afcf-40d9-b78c-ee319308a0ff" returned: 0 in 0.554s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:52 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-1da52a8e-9036-4baf-a7de-eac06e95809c tempest-ProjectMemberTests-2050864699 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ee946548-f107-4f74-a205-ecb3f6c716b2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 15:41:52 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6fdc01b-e5f3-4262-8f34-ed949d1cee42]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:41:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1da52a8e-9036-4baf-a7de-eac06e95809c tempest-ProjectMemberTests-2050864699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ee946548-f107-4f74-a205-ecb3f6c716b2 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:52 devstack sudo[107995]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-950d011b-7d96-4483-87f0-3eea965e9276 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a83c848a-d6b9-4ff1-8e43-41a6b093a614" returned: 0 in 0.496s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-950d011b-7d96-4483-87f0-3eea965e9276 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a83c848a-d6b9-4ff1-8e43-41a6b093a614 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:52 devstack sudo[108012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a83c848a-d6b9-4ff1-8e43-41a6b093a614 Nov 06 15:41:52 devstack sudo[108012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:52 devstack sudo[108011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ee946548-f107-4f74-a205-ecb3f6c716b2 Nov 06 15:41:52 devstack sudo[108011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:53 devstack sudo[108004]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-340add4c-3009-4e9c-9468-96959ff37793 tempest-ProjectReaderTests-90568800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-920b5ec5-5878-48a2-8623-a9de2745c9d1 -F qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-920b5ec5-5878-48a2-8623-a9de2745c9d1.b3b2d37e-3e44-4c43-9704-564ce3efddc7" returned: 0 in 0.408s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:53 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-340add4c-3009-4e9c-9468-96959ff37793 tempest-ProjectReaderTests-90568800 None] /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-920b5ec5-5878-48a2-8623-a9de2745c9d1.b3b2d37e-3e44-4c43-9704-564ce3efddc7 is being set with open permissions: ugo+rw Nov 06 15:41:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-340add4c-3009-4e9c-9468-96959ff37793 tempest-ProjectReaderTests-90568800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-920b5ec5-5878-48a2-8623-a9de2745c9d1.b3b2d37e-3e44-4c43-9704-564ce3efddc7 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:53 devstack sudo[108020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-920b5ec5-5878-48a2-8623-a9de2745c9d1.b3b2d37e-3e44-4c43-9704-564ce3efddc7 Nov 06 15:41:53 devstack sudo[108020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:53 devstack sudo[108012]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-950d011b-7d96-4483-87f0-3eea965e9276 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a83c848a-d6b9-4ff1-8e43-41a6b093a614" returned: 0 in 0.323s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:53 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-950d011b-7d96-4483-87f0-3eea965e9276 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Lock "cinder-quobyte-a83c848a-d6b9-4ff1-8e43-41a6b093a614" released by "delete_volume" :: held 0.875s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:41:53 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-950d011b-7d96-4483-87f0-3eea965e9276 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Created reservations ['1a8d4c7a-143f-4144-b61b-ebb43eb3f89f', 'db98e02f-a6cc-40c9-9a45-aeff854f82b2', '350ae76b-3109-4087-9b31-255efbdd1d5f', '53a8cc91-b7dc-4529-9c0a-c26df6b9bd3a'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:41:53 devstack sudo[108011]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1da52a8e-9036-4baf-a7de-eac06e95809c tempest-ProjectMemberTests-2050864699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ee946548-f107-4f74-a205-ecb3f6c716b2" returned: 0 in 0.460s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1da52a8e-9036-4baf-a7de-eac06e95809c tempest-ProjectMemberTests-2050864699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ee946548-f107-4f74-a205-ecb3f6c716b2.640a6e9f-afcf-40d9-b78c-ee319308a0ff {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:53 devstack sudo[108025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ee946548-f107-4f74-a205-ecb3f6c716b2.640a6e9f-afcf-40d9-b78c-ee319308a0ff Nov 06 15:41:53 devstack sudo[108025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-950d011b-7d96-4483-87f0-3eea965e9276 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:41:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-950d011b-7d96-4483-87f0-3eea965e9276 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:41:53 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-950d011b-7d96-4483-87f0-3eea965e9276 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:41:53 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-950d011b-7d96-4483-87f0-3eea965e9276 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:41:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-950d011b-7d96-4483-87f0-3eea965e9276 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:41:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-950d011b-7d96-4483-87f0-3eea965e9276 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:53 devstack sudo[108020]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-340add4c-3009-4e9c-9468-96959ff37793 tempest-ProjectReaderTests-90568800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-920b5ec5-5878-48a2-8623-a9de2745c9d1.b3b2d37e-3e44-4c43-9704-564ce3efddc7" returned: 0 in 0.334s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:53 devstack sudo[108028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:41:53 devstack sudo[108028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:53 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-703aaed5-204e-43ca-835a-37d894407dea tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Acquiring lock "cinder-805018a4-417a-4dce-a7b2-15628a29a8a8-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:41:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-340add4c-3009-4e9c-9468-96959ff37793 tempest-ProjectReaderTests-90568800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-920b5ec5-5878-48a2-8623-a9de2745c9d1.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:53 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-703aaed5-204e-43ca-835a-37d894407dea tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Lock "cinder-805018a4-417a-4dce-a7b2-15628a29a8a8-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:41:53 devstack sudo[108030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-920b5ec5-5878-48a2-8623-a9de2745c9d1.info Nov 06 15:41:53 devstack sudo[108030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:53 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-703aaed5-204e-43ca-835a-37d894407dea tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Acquiring lock "cinder-quobyte-805018a4-417a-4dce-a7b2-15628a29a8a8" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:41:53 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-703aaed5-204e-43ca-835a-37d894407dea tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Lock "cinder-quobyte-805018a4-417a-4dce-a7b2-15628a29a8a8" acquired by "delete_volume" :: waited 0.044s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:41:53 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[018a2a78-8754-4e99-a546-c12b8aea5479]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:41:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-703aaed5-204e-43ca-835a-37d894407dea tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-805018a4-417a-4dce-a7b2-15628a29a8a8 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:53 devstack sudo[108028]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-950d011b-7d96-4483-87f0-3eea965e9276 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.354s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:53 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-950d011b-7d96-4483-87f0-3eea965e9276 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:41:53 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-950d011b-7d96-4483-87f0-3eea965e9276 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Deleted volume successfully. Nov 06 15:41:53 devstack sudo[108025]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1da52a8e-9036-4baf-a7de-eac06e95809c tempest-ProjectMemberTests-2050864699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ee946548-f107-4f74-a205-ecb3f6c716b2.640a6e9f-afcf-40d9-b78c-ee319308a0ff" returned: 0 in 0.501s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1da52a8e-9036-4baf-a7de-eac06e95809c tempest-ProjectMemberTests-2050864699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ee946548-f107-4f74-a205-ecb3f6c716b2.640a6e9f-afcf-40d9-b78c-ee319308a0ff {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:53 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-950d011b-7d96-4483-87f0-3eea965e9276 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Lock "cinder-a83c848a-d6b9-4ff1-8e43-41a6b093a614-delete_volume" released by "delete_volume" :: held 1.571s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:41:53 devstack sudo[108030]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-340add4c-3009-4e9c-9468-96959ff37793 tempest-ProjectReaderTests-90568800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-920b5ec5-5878-48a2-8623-a9de2745c9d1.info" returned: 0 in 0.344s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:53 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-340add4c-3009-4e9c-9468-96959ff37793 tempest-ProjectReaderTests-90568800 None] /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-920b5ec5-5878-48a2-8623-a9de2745c9d1.info is being set with open permissions: ugo+rw Nov 06 15:41:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-340add4c-3009-4e9c-9468-96959ff37793 tempest-ProjectReaderTests-90568800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-920b5ec5-5878-48a2-8623-a9de2745c9d1.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:53 devstack sudo[108036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-805018a4-417a-4dce-a7b2-15628a29a8a8 Nov 06 15:41:53 devstack sudo[108036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:53 devstack sudo[108039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ee946548-f107-4f74-a205-ecb3f6c716b2.640a6e9f-afcf-40d9-b78c-ee319308a0ff Nov 06 15:41:53 devstack sudo[108039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:53 devstack sudo[108041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-920b5ec5-5878-48a2-8623-a9de2745c9d1.info Nov 06 15:41:53 devstack sudo[108041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:54 devstack sudo[108036]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:54 devstack sudo[108041]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-703aaed5-204e-43ca-835a-37d894407dea tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-805018a4-417a-4dce-a7b2-15628a29a8a8" returned: 0 in 0.466s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-703aaed5-204e-43ca-835a-37d894407dea tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-805018a4-417a-4dce-a7b2-15628a29a8a8 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-340add4c-3009-4e9c-9468-96959ff37793 tempest-ProjectReaderTests-90568800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-920b5ec5-5878-48a2-8623-a9de2745c9d1.info" returned: 0 in 0.318s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:54 devstack sudo[108039]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-340add4c-3009-4e9c-9468-96959ff37793 tempest-ProjectReaderTests-90568800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.600s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:41:54 devstack sudo[108049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-805018a4-417a-4dce-a7b2-15628a29a8a8 Nov 06 15:41:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1da52a8e-9036-4baf-a7de-eac06e95809c tempest-ProjectMemberTests-2050864699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ee946548-f107-4f74-a205-ecb3f6c716b2.640a6e9f-afcf-40d9-b78c-ee319308a0ff" returned: 0 in 0.379s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:54 devstack sudo[108049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:54 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-1da52a8e-9036-4baf-a7de-eac06e95809c tempest-ProjectMemberTests-2050864699 None] Lock "cinder-quobyte-640a6e9f-afcf-40d9-b78c-ee319308a0ff" released by "_delete_snapshot" :: held 2.115s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:41:54 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-340add4c-3009-4e9c-9468-96959ff37793 tempest-ProjectReaderTests-90568800 None] Create snapshot completed successfully Nov 06 15:41:54 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-1da52a8e-9036-4baf-a7de-eac06e95809c tempest-ProjectMemberTests-2050864699 None] Lock "cinder-quobyte-ee946548-f107-4f74-a205-ecb3f6c716b2" released by "delete_snapshot" :: held 2.169s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:41:54 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-1da52a8e-9036-4baf-a7de-eac06e95809c tempest-ProjectMemberTests-2050864699 None] Created reservations ['86d320e1-3520-43cd-9627-45b151df070a', 'c81c7e98-cd9e-4349-ba04-07ecf839d53b', '3c42d1e2-2160-4c50-afda-950ff7b428f3', '2e3becd2-0d62-4ea9-bf65-eae488e0887d'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:41:54 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-1da52a8e-9036-4baf-a7de-eac06e95809c tempest-ProjectMemberTests-2050864699 None] Delete snapshot completed successfully. Nov 06 15:41:54 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-1da52a8e-9036-4baf-a7de-eac06e95809c tempest-ProjectMemberTests-2050864699 None] Lock "cinder-640a6e9f-afcf-40d9-b78c-ee319308a0ff-delete_snapshot" released by "delete_snapshot" :: held 2.355s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:41:54 devstack sudo[108049]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-703aaed5-204e-43ca-835a-37d894407dea tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-805018a4-417a-4dce-a7b2-15628a29a8a8" returned: 0 in 0.316s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:54 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-703aaed5-204e-43ca-835a-37d894407dea tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Lock "cinder-quobyte-805018a4-417a-4dce-a7b2-15628a29a8a8" released by "delete_volume" :: held 0.838s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:41:54 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-9eafa2be-8f6b-4c7c-9af0-2fd5c08d9687 tempest-ProjectReaderTests-90568800 None] Acquiring lock "cinder-b3b2d37e-3e44-4c43-9704-564ce3efddc7-delete_snapshot" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:41:54 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-703aaed5-204e-43ca-835a-37d894407dea tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Created reservations ['c4d17e6a-44cc-4777-8136-7e0e3b500fad', 'adfd2ee5-62b2-46c4-9244-891a2159f746', '042fbafe-c1ac-4ee9-85e0-60c40a14a35c', 'ea17ae6d-28d0-401a-b5a4-e026912c38c9'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:41:54 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-9eafa2be-8f6b-4c7c-9af0-2fd5c08d9687 tempest-ProjectReaderTests-90568800 None] Lock "cinder-b3b2d37e-3e44-4c43-9704-564ce3efddc7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:41:54 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-9eafa2be-8f6b-4c7c-9af0-2fd5c08d9687 tempest-ProjectReaderTests-90568800 None] Acquiring lock "cinder-quobyte-920b5ec5-5878-48a2-8623-a9de2745c9d1" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:41:54 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-9eafa2be-8f6b-4c7c-9af0-2fd5c08d9687 tempest-ProjectReaderTests-90568800 None] Lock "cinder-quobyte-920b5ec5-5878-48a2-8623-a9de2745c9d1" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:41:54 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-9eafa2be-8f6b-4c7c-9af0-2fd5c08d9687 tempest-ProjectReaderTests-90568800 None] Acquiring lock "cinder-quobyte-b3b2d37e-3e44-4c43-9704-564ce3efddc7" by "_delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:41:54 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-9eafa2be-8f6b-4c7c-9af0-2fd5c08d9687 tempest-ProjectReaderTests-90568800 None] Lock "cinder-quobyte-b3b2d37e-3e44-4c43-9704-564ce3efddc7" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:41:54 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-9eafa2be-8f6b-4c7c-9af0-2fd5c08d9687 tempest-ProjectReaderTests-90568800 None] Deleting offline snapshot b3b2d37e-3e44-4c43-9704-564ce3efddc7 of volume 920b5ec5-5878-48a2-8623-a9de2745c9d1 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 15:41:54 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-9eafa2be-8f6b-4c7c-9af0-2fd5c08d9687 tempest-ProjectReaderTests-90568800 None] snapshot_file for this snap is: volume-920b5ec5-5878-48a2-8623-a9de2745c9d1.b3b2d37e-3e44-4c43-9704-564ce3efddc7 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 15:41:54 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[38a3c299-8704-407c-96fb-276bb73da70e]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:41:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9eafa2be-8f6b-4c7c-9af0-2fd5c08d9687 tempest-ProjectReaderTests-90568800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-920b5ec5-5878-48a2-8623-a9de2745c9d1.b3b2d37e-3e44-4c43-9704-564ce3efddc7 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-703aaed5-204e-43ca-835a-37d894407dea tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:41:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-703aaed5-204e-43ca-835a-37d894407dea tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:41:54 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-703aaed5-204e-43ca-835a-37d894407dea tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:41:54 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-703aaed5-204e-43ca-835a-37d894407dea tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:41:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-703aaed5-204e-43ca-835a-37d894407dea tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:41:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-703aaed5-204e-43ca-835a-37d894407dea tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:54 devstack sudo[108053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:41:54 devstack sudo[108053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:54 devstack sudo[108052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-920b5ec5-5878-48a2-8623-a9de2745c9d1.b3b2d37e-3e44-4c43-9704-564ce3efddc7 Nov 06 15:41:54 devstack sudo[108052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:54 devstack sudo[108053]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-703aaed5-204e-43ca-835a-37d894407dea tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.269s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:54 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-703aaed5-204e-43ca-835a-37d894407dea tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:41:54 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-703aaed5-204e-43ca-835a-37d894407dea tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Deleted volume successfully. Nov 06 15:41:55 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-703aaed5-204e-43ca-835a-37d894407dea tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Lock "cinder-805018a4-417a-4dce-a7b2-15628a29a8a8-delete_volume" released by "delete_volume" :: held 1.501s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:41:55 devstack sudo[108052]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9eafa2be-8f6b-4c7c-9af0-2fd5c08d9687 tempest-ProjectReaderTests-90568800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-920b5ec5-5878-48a2-8623-a9de2745c9d1.b3b2d37e-3e44-4c43-9704-564ce3efddc7" returned: 0 in 0.386s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:55 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-9eafa2be-8f6b-4c7c-9af0-2fd5c08d9687 tempest-ProjectReaderTests-90568800 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-920b5ec5-5878-48a2-8623-a9de2745c9d1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 15:41:55 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c15ce81-cacd-4252-8f12-ba8e8328530c]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:41:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9eafa2be-8f6b-4c7c-9af0-2fd5c08d9687 tempest-ProjectReaderTests-90568800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-920b5ec5-5878-48a2-8623-a9de2745c9d1 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:55 devstack sudo[108061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-920b5ec5-5878-48a2-8623-a9de2745c9d1 Nov 06 15:41:55 devstack sudo[108061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:55 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-2322e264-c409-4739-9a9c-9b789fd503a8 tempest-ProjectMemberTests-2050864699 None] Acquiring lock "cinder-ee946548-f107-4f74-a205-ecb3f6c716b2-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:41:55 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-2322e264-c409-4739-9a9c-9b789fd503a8 tempest-ProjectMemberTests-2050864699 None] Lock "cinder-ee946548-f107-4f74-a205-ecb3f6c716b2-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:41:55 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-2322e264-c409-4739-9a9c-9b789fd503a8 tempest-ProjectMemberTests-2050864699 None] Acquiring lock "cinder-quobyte-ee946548-f107-4f74-a205-ecb3f6c716b2" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:41:55 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-2322e264-c409-4739-9a9c-9b789fd503a8 tempest-ProjectMemberTests-2050864699 None] Lock "cinder-quobyte-ee946548-f107-4f74-a205-ecb3f6c716b2" acquired by "delete_volume" :: waited 0.024s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:41:55 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[71f6bf75-6ed0-4153-b0e6-a0601166469d]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:41:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2322e264-c409-4739-9a9c-9b789fd503a8 tempest-ProjectMemberTests-2050864699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ee946548-f107-4f74-a205-ecb3f6c716b2 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:55 devstack sudo[108061]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9eafa2be-8f6b-4c7c-9af0-2fd5c08d9687 tempest-ProjectReaderTests-90568800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-920b5ec5-5878-48a2-8623-a9de2745c9d1" returned: 0 in 0.405s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9eafa2be-8f6b-4c7c-9af0-2fd5c08d9687 tempest-ProjectReaderTests-90568800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-920b5ec5-5878-48a2-8623-a9de2745c9d1.b3b2d37e-3e44-4c43-9704-564ce3efddc7 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:55 devstack sudo[108067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-920b5ec5-5878-48a2-8623-a9de2745c9d1.b3b2d37e-3e44-4c43-9704-564ce3efddc7 Nov 06 15:41:55 devstack sudo[108067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:55 devstack sudo[108066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ee946548-f107-4f74-a205-ecb3f6c716b2 Nov 06 15:41:55 devstack sudo[108066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:55 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e0492896-7473-468a-b11a-eb3eb6bc3eb3 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Acquiring lock "cinder-f95e19ec-6f28-49f7-8497-415dee766160-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:41:55 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e0492896-7473-468a-b11a-eb3eb6bc3eb3 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Lock "cinder-f95e19ec-6f28-49f7-8497-415dee766160-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:41:55 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e0492896-7473-468a-b11a-eb3eb6bc3eb3 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Acquiring lock "cinder-quobyte-f95e19ec-6f28-49f7-8497-415dee766160" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:41:55 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e0492896-7473-468a-b11a-eb3eb6bc3eb3 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Lock "cinder-quobyte-f95e19ec-6f28-49f7-8497-415dee766160" acquired by "delete_volume" :: waited 0.018s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:41:55 devstack sudo[108066]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2322e264-c409-4739-9a9c-9b789fd503a8 tempest-ProjectMemberTests-2050864699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ee946548-f107-4f74-a205-ecb3f6c716b2" returned: 0 in 0.439s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2322e264-c409-4739-9a9c-9b789fd503a8 tempest-ProjectMemberTests-2050864699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ee946548-f107-4f74-a205-ecb3f6c716b2 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:55 devstack sudo[108067]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:55 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac33a2d0-e471-4045-b3a3-c0b9a640c908]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:41:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e0492896-7473-468a-b11a-eb3eb6bc3eb3 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f95e19ec-6f28-49f7-8497-415dee766160 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9eafa2be-8f6b-4c7c-9af0-2fd5c08d9687 tempest-ProjectReaderTests-90568800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-920b5ec5-5878-48a2-8623-a9de2745c9d1.b3b2d37e-3e44-4c43-9704-564ce3efddc7" returned: 0 in 0.454s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9eafa2be-8f6b-4c7c-9af0-2fd5c08d9687 tempest-ProjectReaderTests-90568800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-920b5ec5-5878-48a2-8623-a9de2745c9d1.b3b2d37e-3e44-4c43-9704-564ce3efddc7 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:55 devstack sudo[108078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ee946548-f107-4f74-a205-ecb3f6c716b2 Nov 06 15:41:55 devstack sudo[108078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:55 devstack sudo[108081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-920b5ec5-5878-48a2-8623-a9de2745c9d1.b3b2d37e-3e44-4c43-9704-564ce3efddc7 Nov 06 15:41:55 devstack sudo[108081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:56 devstack sudo[108079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f95e19ec-6f28-49f7-8497-415dee766160 Nov 06 15:41:56 devstack sudo[108079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:56 devstack sudo[108078]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2322e264-c409-4739-9a9c-9b789fd503a8 tempest-ProjectMemberTests-2050864699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ee946548-f107-4f74-a205-ecb3f6c716b2" returned: 0 in 0.285s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:56 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-2322e264-c409-4739-9a9c-9b789fd503a8 tempest-ProjectMemberTests-2050864699 None] Lock "cinder-quobyte-ee946548-f107-4f74-a205-ecb3f6c716b2" released by "delete_volume" :: held 0.803s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:41:56 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-2322e264-c409-4739-9a9c-9b789fd503a8 tempest-ProjectMemberTests-2050864699 None] Created reservations ['018e0820-f978-4ef2-8504-043769263db4', 'f7cff2f0-2824-4192-84ba-e7fb644eea2e', '75d61a7a-3cde-4ca7-b64e-d1b36b3ffe8a', 'b153f06b-523c-4cb6-985e-b15be24ad818'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:41:56 devstack sudo[108081]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9eafa2be-8f6b-4c7c-9af0-2fd5c08d9687 tempest-ProjectReaderTests-90568800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-920b5ec5-5878-48a2-8623-a9de2745c9d1.b3b2d37e-3e44-4c43-9704-564ce3efddc7" returned: 0 in 0.366s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:56 devstack sudo[108079]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e0492896-7473-468a-b11a-eb3eb6bc3eb3 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f95e19ec-6f28-49f7-8497-415dee766160" returned: 0 in 0.421s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e0492896-7473-468a-b11a-eb3eb6bc3eb3 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f95e19ec-6f28-49f7-8497-415dee766160 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:56 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-9eafa2be-8f6b-4c7c-9af0-2fd5c08d9687 tempest-ProjectReaderTests-90568800 None] Lock "cinder-quobyte-b3b2d37e-3e44-4c43-9704-564ce3efddc7" released by "_delete_snapshot" :: held 1.750s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:41:56 devstack sudo[108089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f95e19ec-6f28-49f7-8497-415dee766160 Nov 06 15:41:56 devstack sudo[108089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:56 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-9eafa2be-8f6b-4c7c-9af0-2fd5c08d9687 tempest-ProjectReaderTests-90568800 None] Lock "cinder-quobyte-920b5ec5-5878-48a2-8623-a9de2745c9d1" released by "delete_snapshot" :: held 1.803s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:41:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-2322e264-c409-4739-9a9c-9b789fd503a8 tempest-ProjectMemberTests-2050864699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:41:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-2322e264-c409-4739-9a9c-9b789fd503a8 tempest-ProjectMemberTests-2050864699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:41:56 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-2322e264-c409-4739-9a9c-9b789fd503a8 tempest-ProjectMemberTests-2050864699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:41:56 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-2322e264-c409-4739-9a9c-9b789fd503a8 tempest-ProjectMemberTests-2050864699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:41:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-2322e264-c409-4739-9a9c-9b789fd503a8 tempest-ProjectMemberTests-2050864699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:41:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2322e264-c409-4739-9a9c-9b789fd503a8 tempest-ProjectMemberTests-2050864699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:56 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-9eafa2be-8f6b-4c7c-9af0-2fd5c08d9687 tempest-ProjectReaderTests-90568800 None] Created reservations ['0a680c43-43a0-4259-8d5b-fd16987b4e89', '56253329-2750-4af9-b4e3-76a0522a6c5c', '32421658-80e1-4d7c-b360-0c5f2d2c1d9b', '54842a4d-40aa-4d27-8f45-34d42b2d05fc'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:41:56 devstack sudo[108091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:41:56 devstack sudo[108091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:56 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-9eafa2be-8f6b-4c7c-9af0-2fd5c08d9687 tempest-ProjectReaderTests-90568800 None] Delete snapshot completed successfully. Nov 06 15:41:56 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-9eafa2be-8f6b-4c7c-9af0-2fd5c08d9687 tempest-ProjectReaderTests-90568800 None] Lock "cinder-b3b2d37e-3e44-4c43-9704-564ce3efddc7-delete_snapshot" released by "delete_snapshot" :: held 2.083s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:41:56 devstack sudo[108089]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:56 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c6545154-23c5-4649-8d3b-8e71ce3951ce tempest-ProjectReaderTests-90568800 None] Acquiring lock "cinder-920b5ec5-5878-48a2-8623-a9de2745c9d1-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:41:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e0492896-7473-468a-b11a-eb3eb6bc3eb3 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f95e19ec-6f28-49f7-8497-415dee766160" returned: 0 in 0.385s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:56 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c6545154-23c5-4649-8d3b-8e71ce3951ce tempest-ProjectReaderTests-90568800 None] Lock "cinder-920b5ec5-5878-48a2-8623-a9de2745c9d1-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:41:56 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e0492896-7473-468a-b11a-eb3eb6bc3eb3 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Lock "cinder-quobyte-f95e19ec-6f28-49f7-8497-415dee766160" released by "delete_volume" :: held 0.877s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:41:56 devstack sudo[108091]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2322e264-c409-4739-9a9c-9b789fd503a8 tempest-ProjectMemberTests-2050864699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.299s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:56 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-2322e264-c409-4739-9a9c-9b789fd503a8 tempest-ProjectMemberTests-2050864699 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:41:56 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-2322e264-c409-4739-9a9c-9b789fd503a8 tempest-ProjectMemberTests-2050864699 None] Deleted volume successfully. Nov 06 15:41:56 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-2322e264-c409-4739-9a9c-9b789fd503a8 tempest-ProjectMemberTests-2050864699 None] Lock "cinder-ee946548-f107-4f74-a205-ecb3f6c716b2-delete_volume" released by "delete_volume" :: held 1.465s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:41:56 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c6545154-23c5-4649-8d3b-8e71ce3951ce tempest-ProjectReaderTests-90568800 None] Acquiring lock "cinder-quobyte-920b5ec5-5878-48a2-8623-a9de2745c9d1" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:41:56 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c6545154-23c5-4649-8d3b-8e71ce3951ce tempest-ProjectReaderTests-90568800 None] Lock "cinder-quobyte-920b5ec5-5878-48a2-8623-a9de2745c9d1" acquired by "delete_volume" :: waited 0.017s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:41:56 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-e0492896-7473-468a-b11a-eb3eb6bc3eb3 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Created reservations ['061fd2ef-1881-45b1-8299-eb1585f5aa04', '2afee206-eaad-4397-b491-32e714d736f1', '9805c257-ac53-49c0-aee1-519ec2a28cd2', '91379757-bd4d-4462-be16-294b511b7674'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:41:56 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3fc4450-e42d-4b4a-899c-9bd4c4e2c021]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:41:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c6545154-23c5-4649-8d3b-8e71ce3951ce tempest-ProjectReaderTests-90568800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-920b5ec5-5878-48a2-8623-a9de2745c9d1 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e0492896-7473-468a-b11a-eb3eb6bc3eb3 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:41:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e0492896-7473-468a-b11a-eb3eb6bc3eb3 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:41:57 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e0492896-7473-468a-b11a-eb3eb6bc3eb3 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:41:57 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e0492896-7473-468a-b11a-eb3eb6bc3eb3 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:41:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e0492896-7473-468a-b11a-eb3eb6bc3eb3 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:41:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e0492896-7473-468a-b11a-eb3eb6bc3eb3 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:57 devstack sudo[108096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:41:57 devstack sudo[108096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:57 devstack sudo[108095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-920b5ec5-5878-48a2-8623-a9de2745c9d1 Nov 06 15:41:57 devstack sudo[108095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:57 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-9bd96da1-1263-4b9c-af12-5965a2a07c36 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Acquiring lock "cinder-49a193ee-de72-48b1-bd5f-e9eb478f9006-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:41:57 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-9bd96da1-1263-4b9c-af12-5965a2a07c36 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Lock "cinder-49a193ee-de72-48b1-bd5f-e9eb478f9006-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:41:57 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-9bd96da1-1263-4b9c-af12-5965a2a07c36 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Acquiring lock "cinder-quobyte-49a193ee-de72-48b1-bd5f-e9eb478f9006" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:41:57 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-9bd96da1-1263-4b9c-af12-5965a2a07c36 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Lock "cinder-quobyte-49a193ee-de72-48b1-bd5f-e9eb478f9006" acquired by "delete_volume" :: waited 0.031s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:41:57 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-5278d11a-2d50-445a-b94f-6ff6f173e0a4 tempest-ProjectMemberTests-2050864699 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:41:57 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5278d11a-2d50-445a-b94f-6ff6f173e0a4 tempest-ProjectMemberTests-2050864699 None] Flow 'volume_create_manager' (43254b29-11e2-4648-a25a-85570bf0ae38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:41:57 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5278d11a-2d50-445a-b94f-6ff6f173e0a4 tempest-ProjectMemberTests-2050864699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6841b4f8-f321-4a37-a30c-e45ce110f564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:57 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c0a62d3-5a37-44b8-b9db-a3bdbd0b97e4]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:41:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9bd96da1-1263-4b9c-af12-5965a2a07c36 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-49a193ee-de72-48b1-bd5f-e9eb478f9006 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:57 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5278d11a-2d50-445a-b94f-6ff6f173e0a4 tempest-ProjectMemberTests-2050864699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6841b4f8-f321-4a37-a30c-e45ce110f564) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:41:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1844538443',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb45bee0-19f9-47fb-a495-c35e5e4b1a3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='631b1acb2fe74ff38bf682df0fb94c26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:41:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:41:57Z,use_quota=True,user_id='c2ab5a7c9b61494492f0f3bd6193ebdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:57 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5278d11a-2d50-445a-b94f-6ff6f173e0a4 tempest-ProjectMemberTests-2050864699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (848daea5-e050-45a3-901d-e41be43ae494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:57 devstack sudo[108096]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:57 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5278d11a-2d50-445a-b94f-6ff6f173e0a4 tempest-ProjectMemberTests-2050864699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (848daea5-e050-45a3-901d-e41be43ae494) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:57 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5278d11a-2d50-445a-b94f-6ff6f173e0a4 tempest-ProjectMemberTests-2050864699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (533becbf-8550-4853-a758-499fadb69168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:57 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5278d11a-2d50-445a-b94f-6ff6f173e0a4 tempest-ProjectMemberTests-2050864699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (533becbf-8550-4853-a758-499fadb69168) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb45bee0-19f9-47fb-a495-c35e5e4b1a3b', 'volume_name': 'volume-bb45bee0-19f9-47fb-a495-c35e5e4b1a3b', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:57 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5278d11a-2d50-445a-b94f-6ff6f173e0a4 tempest-ProjectMemberTests-2050864699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f0acfe9-d693-43b6-8606-205a65395806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:57 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5278d11a-2d50-445a-b94f-6ff6f173e0a4 tempest-ProjectMemberTests-2050864699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f0acfe9-d693-43b6-8606-205a65395806) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:57 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5278d11a-2d50-445a-b94f-6ff6f173e0a4 tempest-ProjectMemberTests-2050864699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (861f3503-96da-41a8-9c9a-0a958b7eb7c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:57 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-5278d11a-2d50-445a-b94f-6ff6f173e0a4 tempest-ProjectMemberTests-2050864699 None] Volume bb45bee0-19f9-47fb-a495-c35e5e4b1a3b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb45bee0-19f9-47fb-a495-c35e5e4b1a3b', 'volume_size': 1} Nov 06 15:41:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5278d11a-2d50-445a-b94f-6ff6f173e0a4 tempest-ProjectMemberTests-2050864699 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:41:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5278d11a-2d50-445a-b94f-6ff6f173e0a4 tempest-ProjectMemberTests-2050864699 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:41:57 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-5278d11a-2d50-445a-b94f-6ff6f173e0a4 tempest-ProjectMemberTests-2050864699 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:41:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1844538443',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb45bee0-19f9-47fb-a495-c35e5e4b1a3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='631b1acb2fe74ff38bf682df0fb94c26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:41:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:41:57Z,use_quota=True,user_id='c2ab5a7c9b61494492f0f3bd6193ebdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:41:57 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-5278d11a-2d50-445a-b94f-6ff6f173e0a4 tempest-ProjectMemberTests-2050864699 None] Creating volume bb45bee0-19f9-47fb-a495-c35e5e4b1a3b {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:41:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5278d11a-2d50-445a-b94f-6ff6f173e0a4 tempest-ProjectMemberTests-2050864699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:41:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5278d11a-2d50-445a-b94f-6ff6f173e0a4 tempest-ProjectMemberTests-2050864699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:41:57 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-5278d11a-2d50-445a-b94f-6ff6f173e0a4 tempest-ProjectMemberTests-2050864699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:41:57 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-5278d11a-2d50-445a-b94f-6ff6f173e0a4 tempest-ProjectMemberTests-2050864699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:41:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5278d11a-2d50-445a-b94f-6ff6f173e0a4 tempest-ProjectMemberTests-2050864699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:41:57 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-5278d11a-2d50-445a-b94f-6ff6f173e0a4 tempest-ProjectMemberTests-2050864699 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:41:57 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-5278d11a-2d50-445a-b94f-6ff6f173e0a4 tempest-ProjectMemberTests-2050864699 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:41:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5278d11a-2d50-445a-b94f-6ff6f173e0a4 tempest-ProjectMemberTests-2050864699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-bb45bee0-19f9-47fb-a495-c35e5e4b1a3b 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e0492896-7473-468a-b11a-eb3eb6bc3eb3 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.474s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:57 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-e0492896-7473-468a-b11a-eb3eb6bc3eb3 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:41:57 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-e0492896-7473-468a-b11a-eb3eb6bc3eb3 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Deleted volume successfully. Nov 06 15:41:57 devstack sudo[108104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-bb45bee0-19f9-47fb-a495-c35e5e4b1a3b 1073741824 Nov 06 15:41:57 devstack sudo[108104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:57 devstack sudo[108100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-49a193ee-de72-48b1-bd5f-e9eb478f9006 Nov 06 15:41:57 devstack sudo[108100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:57 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e0492896-7473-468a-b11a-eb3eb6bc3eb3 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Lock "cinder-f95e19ec-6f28-49f7-8497-415dee766160-delete_volume" released by "delete_volume" :: held 1.736s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:41:57 devstack sudo[108095]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c6545154-23c5-4649-8d3b-8e71ce3951ce tempest-ProjectReaderTests-90568800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-920b5ec5-5878-48a2-8623-a9de2745c9d1" returned: 0 in 0.668s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c6545154-23c5-4649-8d3b-8e71ce3951ce tempest-ProjectReaderTests-90568800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-920b5ec5-5878-48a2-8623-a9de2745c9d1 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:57 devstack sudo[108107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-920b5ec5-5878-48a2-8623-a9de2745c9d1 Nov 06 15:41:57 devstack sudo[108107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:57 devstack sudo[108107]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c6545154-23c5-4649-8d3b-8e71ce3951ce tempest-ProjectReaderTests-90568800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-920b5ec5-5878-48a2-8623-a9de2745c9d1" returned: 0 in 0.338s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:57 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c6545154-23c5-4649-8d3b-8e71ce3951ce tempest-ProjectReaderTests-90568800 None] Lock "cinder-quobyte-920b5ec5-5878-48a2-8623-a9de2745c9d1" released by "delete_volume" :: held 1.094s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:41:57 devstack sudo[108100]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9bd96da1-1263-4b9c-af12-5965a2a07c36 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-49a193ee-de72-48b1-bd5f-e9eb478f9006" returned: 0 in 0.551s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9bd96da1-1263-4b9c-af12-5965a2a07c36 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-49a193ee-de72-48b1-bd5f-e9eb478f9006 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:57 devstack sudo[108117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-49a193ee-de72-48b1-bd5f-e9eb478f9006 Nov 06 15:41:57 devstack sudo[108117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:58 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-c6545154-23c5-4649-8d3b-8e71ce3951ce tempest-ProjectReaderTests-90568800 None] Created reservations ['ed51c9b8-7f50-4a78-b8f7-c9e05ad63e49', '8a49a520-bf1a-443a-9416-7a879d4f9f3e', '73d3f493-95bb-4b8c-94cf-133299a7fedd', '5aba1a7a-d636-4f1c-b666-191348e376f1'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:41:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c6545154-23c5-4649-8d3b-8e71ce3951ce tempest-ProjectReaderTests-90568800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:41:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c6545154-23c5-4649-8d3b-8e71ce3951ce tempest-ProjectReaderTests-90568800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:41:58 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c6545154-23c5-4649-8d3b-8e71ce3951ce tempest-ProjectReaderTests-90568800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:41:58 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c6545154-23c5-4649-8d3b-8e71ce3951ce tempest-ProjectReaderTests-90568800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:41:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c6545154-23c5-4649-8d3b-8e71ce3951ce tempest-ProjectReaderTests-90568800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:41:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c6545154-23c5-4649-8d3b-8e71ce3951ce tempest-ProjectReaderTests-90568800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:58 devstack sudo[108104]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5278d11a-2d50-445a-b94f-6ff6f173e0a4 tempest-ProjectMemberTests-2050864699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-bb45bee0-19f9-47fb-a495-c35e5e4b1a3b 1073741824" returned: 0 in 0.644s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:58 devstack sudo[108119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:41:58 devstack sudo[108119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5278d11a-2d50-445a-b94f-6ff6f173e0a4 tempest-ProjectMemberTests-2050864699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-bb45bee0-19f9-47fb-a495-c35e5e4b1a3b {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:58 devstack sudo[108121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-bb45bee0-19f9-47fb-a495-c35e5e4b1a3b Nov 06 15:41:58 devstack sudo[108121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:58 devstack sudo[108117]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9bd96da1-1263-4b9c-af12-5965a2a07c36 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-49a193ee-de72-48b1-bd5f-e9eb478f9006" returned: 0 in 0.439s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:58 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-9bd96da1-1263-4b9c-af12-5965a2a07c36 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Lock "cinder-quobyte-49a193ee-de72-48b1-bd5f-e9eb478f9006" released by "delete_volume" :: held 1.103s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:41:58 devstack sudo[108119]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c6545154-23c5-4649-8d3b-8e71ce3951ce tempest-ProjectReaderTests-90568800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.401s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:58 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-c6545154-23c5-4649-8d3b-8e71ce3951ce tempest-ProjectReaderTests-90568800 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:41:58 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-c6545154-23c5-4649-8d3b-8e71ce3951ce tempest-ProjectReaderTests-90568800 None] Deleted volume successfully. Nov 06 15:41:58 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-9bd96da1-1263-4b9c-af12-5965a2a07c36 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Created reservations ['81efc79c-4b0f-4bb6-8812-b7cee231d51c', 'b143d8a1-baaf-4a1b-9834-c872b33f9093', 'beef0d0f-8565-4696-8abf-eb2e8378a435', 'e48597e8-ba4c-41d7-a71b-c0244bf4660c'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:41:58 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c6545154-23c5-4649-8d3b-8e71ce3951ce tempest-ProjectReaderTests-90568800 None] Lock "cinder-920b5ec5-5878-48a2-8623-a9de2745c9d1-delete_volume" released by "delete_volume" :: held 1.801s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:41:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9bd96da1-1263-4b9c-af12-5965a2a07c36 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:41:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9bd96da1-1263-4b9c-af12-5965a2a07c36 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:41:58 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-9bd96da1-1263-4b9c-af12-5965a2a07c36 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:41:58 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-9bd96da1-1263-4b9c-af12-5965a2a07c36 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:41:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9bd96da1-1263-4b9c-af12-5965a2a07c36 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:41:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9bd96da1-1263-4b9c-af12-5965a2a07c36 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:58 devstack sudo[108121]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5278d11a-2d50-445a-b94f-6ff6f173e0a4 tempest-ProjectMemberTests-2050864699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-bb45bee0-19f9-47fb-a495-c35e5e4b1a3b" returned: 0 in 0.420s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:58 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-5278d11a-2d50-445a-b94f-6ff6f173e0a4 tempest-ProjectMemberTests-2050864699 None] <== create_volume: return (1158ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:41:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5278d11a-2d50-445a-b94f-6ff6f173e0a4 tempest-ProjectMemberTests-2050864699 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.162s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:41:58 devstack sudo[108132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:41:58 devstack sudo[108132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:58 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5278d11a-2d50-445a-b94f-6ff6f173e0a4 tempest-ProjectMemberTests-2050864699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (861f3503-96da-41a8-9c9a-0a958b7eb7c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb45bee0-19f9-47fb-a495-c35e5e4b1a3b', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:58 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5278d11a-2d50-445a-b94f-6ff6f173e0a4 tempest-ProjectMemberTests-2050864699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c5244af-3214-4ba7-9d20-06e8377f2491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:58 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-5278d11a-2d50-445a-b94f-6ff6f173e0a4 tempest-ProjectMemberTests-2050864699 None] Volume volume-bb45bee0-19f9-47fb-a495-c35e5e4b1a3b (bb45bee0-19f9-47fb-a495-c35e5e4b1a3b): created successfully Nov 06 15:41:58 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5278d11a-2d50-445a-b94f-6ff6f173e0a4 tempest-ProjectMemberTests-2050864699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c5244af-3214-4ba7-9d20-06e8377f2491) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:58 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5278d11a-2d50-445a-b94f-6ff6f173e0a4 tempest-ProjectMemberTests-2050864699 None] Flow 'volume_create_manager' (43254b29-11e2-4648-a25a-85570bf0ae38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:41:58 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-5278d11a-2d50-445a-b94f-6ff6f173e0a4 tempest-ProjectMemberTests-2050864699 None] Created volume successfully. Nov 06 15:41:58 devstack sudo[108132]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9bd96da1-1263-4b9c-af12-5965a2a07c36 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.306s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:58 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-9bd96da1-1263-4b9c-af12-5965a2a07c36 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:41:58 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-9bd96da1-1263-4b9c-af12-5965a2a07c36 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Deleted volume successfully. Nov 06 15:41:58 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c8fee79-6393-45e4-9b8c-c994ecd3e1ed tempest-ProjectReaderTests-90568800 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:41:58 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3c8fee79-6393-45e4-9b8c-c994ecd3e1ed tempest-ProjectReaderTests-90568800 None] Flow 'volume_create_manager' (0df702e8-8ae0-452a-bb79-37a9b49730ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:41:58 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3c8fee79-6393-45e4-9b8c-c994ecd3e1ed tempest-ProjectReaderTests-90568800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86413b91-50ea-42fe-af02-18cd937fb362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:59 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3c8fee79-6393-45e4-9b8c-c994ecd3e1ed tempest-ProjectReaderTests-90568800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86413b91-50ea-42fe-af02-18cd937fb362) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:41:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1117011194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e539b63-aa8c-40c2-bb53-935423e07d04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa0e5fb1579d44329b27513f0572ba4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:41:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:41:59Z,use_quota=True,user_id='8f151b147eaa443a8d1a0ac4f9b0c7fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:59 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3c8fee79-6393-45e4-9b8c-c994ecd3e1ed tempest-ProjectReaderTests-90568800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71f885de-6c10-4773-b5a4-097fda9a7dd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:59 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3c8fee79-6393-45e4-9b8c-c994ecd3e1ed tempest-ProjectReaderTests-90568800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71f885de-6c10-4773-b5a4-097fda9a7dd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:59 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3c8fee79-6393-45e4-9b8c-c994ecd3e1ed tempest-ProjectReaderTests-90568800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2043010f-507b-4501-b3cf-eafa845f4558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:59 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3c8fee79-6393-45e4-9b8c-c994ecd3e1ed tempest-ProjectReaderTests-90568800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2043010f-507b-4501-b3cf-eafa845f4558) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e539b63-aa8c-40c2-bb53-935423e07d04', 'volume_name': 'volume-3e539b63-aa8c-40c2-bb53-935423e07d04', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:59 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3c8fee79-6393-45e4-9b8c-c994ecd3e1ed tempest-ProjectReaderTests-90568800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03d56315-d8ef-420c-aeb1-7da9206af924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:59 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3c8fee79-6393-45e4-9b8c-c994ecd3e1ed tempest-ProjectReaderTests-90568800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03d56315-d8ef-420c-aeb1-7da9206af924) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:59 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3c8fee79-6393-45e4-9b8c-c994ecd3e1ed tempest-ProjectReaderTests-90568800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea88d58f-dfcc-492e-bd5d-ef072445ace6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:59 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-3c8fee79-6393-45e4-9b8c-c994ecd3e1ed tempest-ProjectReaderTests-90568800 None] Volume 3e539b63-aa8c-40c2-bb53-935423e07d04: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e539b63-aa8c-40c2-bb53-935423e07d04', 'volume_size': 1} Nov 06 15:41:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3c8fee79-6393-45e4-9b8c-c994ecd3e1ed tempest-ProjectReaderTests-90568800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:41:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3c8fee79-6393-45e4-9b8c-c994ecd3e1ed tempest-ProjectReaderTests-90568800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:41:59 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3c8fee79-6393-45e4-9b8c-c994ecd3e1ed tempest-ProjectReaderTests-90568800 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:41:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1117011194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e539b63-aa8c-40c2-bb53-935423e07d04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa0e5fb1579d44329b27513f0572ba4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:41:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:41:59Z,use_quota=True,user_id='8f151b147eaa443a8d1a0ac4f9b0c7fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:41:59 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-3c8fee79-6393-45e4-9b8c-c994ecd3e1ed tempest-ProjectReaderTests-90568800 None] Creating volume 3e539b63-aa8c-40c2-bb53-935423e07d04 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:41:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3c8fee79-6393-45e4-9b8c-c994ecd3e1ed tempest-ProjectReaderTests-90568800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:41:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3c8fee79-6393-45e4-9b8c-c994ecd3e1ed tempest-ProjectReaderTests-90568800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:41:59 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3c8fee79-6393-45e4-9b8c-c994ecd3e1ed tempest-ProjectReaderTests-90568800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:41:59 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3c8fee79-6393-45e4-9b8c-c994ecd3e1ed tempest-ProjectReaderTests-90568800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:41:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3c8fee79-6393-45e4-9b8c-c994ecd3e1ed tempest-ProjectReaderTests-90568800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:41:59 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3c8fee79-6393-45e4-9b8c-c994ecd3e1ed tempest-ProjectReaderTests-90568800 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:41:59 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-3c8fee79-6393-45e4-9b8c-c994ecd3e1ed tempest-ProjectReaderTests-90568800 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:41:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3c8fee79-6393-45e4-9b8c-c994ecd3e1ed tempest-ProjectReaderTests-90568800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-3e539b63-aa8c-40c2-bb53-935423e07d04 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:59 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-9bd96da1-1263-4b9c-af12-5965a2a07c36 tempest-CreateVolumesFromSourceVolumeTest-1622572681 None] Lock "cinder-49a193ee-de72-48b1-bd5f-e9eb478f9006-delete_volume" released by "delete_volume" :: held 1.846s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:41:59 devstack sudo[108135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-3e539b63-aa8c-40c2-bb53-935423e07d04 1073741824 Nov 06 15:41:59 devstack sudo[108135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a398f18a-a8b3-4707-b5f4-356a7f2e7e8e tempest-ProjectMemberTests-2050864699 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:41:59 devstack sudo[108135]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3c8fee79-6393-45e4-9b8c-c994ecd3e1ed tempest-ProjectReaderTests-90568800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-3e539b63-aa8c-40c2-bb53-935423e07d04 1073741824" returned: 0 in 0.496s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3c8fee79-6393-45e4-9b8c-c994ecd3e1ed tempest-ProjectReaderTests-90568800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-3e539b63-aa8c-40c2-bb53-935423e07d04 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:59 devstack sudo[108141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-3e539b63-aa8c-40c2-bb53-935423e07d04 Nov 06 15:41:59 devstack sudo[108141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:41:59 devstack sudo[108141]: pam_unix(sudo:session): session closed for user root Nov 06 15:41:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3c8fee79-6393-45e4-9b8c-c994ecd3e1ed tempest-ProjectReaderTests-90568800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-3e539b63-aa8c-40c2-bb53-935423e07d04" returned: 0 in 0.305s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:41:59 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3c8fee79-6393-45e4-9b8c-c994ecd3e1ed tempest-ProjectReaderTests-90568800 None] <== create_volume: return (851ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:41:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3c8fee79-6393-45e4-9b8c-c994ecd3e1ed tempest-ProjectReaderTests-90568800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.855s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:41:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a398f18a-a8b3-4707-b5f4-356a7f2e7e8e tempest-ProjectMemberTests-2050864699 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.365s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:41:59 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3c8fee79-6393-45e4-9b8c-c994ecd3e1ed tempest-ProjectReaderTests-90568800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea88d58f-dfcc-492e-bd5d-ef072445ace6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e539b63-aa8c-40c2-bb53-935423e07d04', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:59 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3c8fee79-6393-45e4-9b8c-c994ecd3e1ed tempest-ProjectReaderTests-90568800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee8e980b-9e0c-4f08-9966-d7c7a7e96255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:41:59 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-a398f18a-a8b3-4707-b5f4-356a7f2e7e8e tempest-ProjectMemberTests-2050864699 None] Creating offline snapshot adda7d1c-9a52-4f0c-82e7-505f3036a3a2 of volume bb45bee0-19f9-47fb-a495-c35e5e4b1a3b {{(pid=87132) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 15:41:59 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-3c8fee79-6393-45e4-9b8c-c994ecd3e1ed tempest-ProjectReaderTests-90568800 None] Volume volume-3e539b63-aa8c-40c2-bb53-935423e07d04 (3e539b63-aa8c-40c2-bb53-935423e07d04): created successfully Nov 06 15:41:59 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3c8fee79-6393-45e4-9b8c-c994ecd3e1ed tempest-ProjectReaderTests-90568800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee8e980b-9e0c-4f08-9966-d7c7a7e96255) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:41:59 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3c8fee79-6393-45e4-9b8c-c994ecd3e1ed tempest-ProjectReaderTests-90568800 None] Flow 'volume_create_manager' (0df702e8-8ae0-452a-bb79-37a9b49730ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:41:59 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dc1f0d7-82b2-48e2-97e8-32731891ac64]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:41:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a398f18a-a8b3-4707-b5f4-356a7f2e7e8e tempest-ProjectMemberTests-2050864699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-bb45bee0-19f9-47fb-a495-c35e5e4b1a3b {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:41:59 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-3c8fee79-6393-45e4-9b8c-c994ecd3e1ed tempest-ProjectReaderTests-90568800 None] Created volume successfully. Nov 06 15:42:00 devstack sudo[108144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-bb45bee0-19f9-47fb-a495-c35e5e4b1a3b Nov 06 15:42:00 devstack sudo[108144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:00 devstack sudo[108144]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a398f18a-a8b3-4707-b5f4-356a7f2e7e8e tempest-ProjectMemberTests-2050864699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-bb45bee0-19f9-47fb-a495-c35e5e4b1a3b" returned: 0 in 0.466s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a398f18a-a8b3-4707-b5f4-356a7f2e7e8e tempest-ProjectMemberTests-2050864699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-bb45bee0-19f9-47fb-a495-c35e5e4b1a3b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-bb45bee0-19f9-47fb-a495-c35e5e4b1a3b.adda7d1c-9a52-4f0c-82e7-505f3036a3a2 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:00 devstack sudo[108149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-bb45bee0-19f9-47fb-a495-c35e5e4b1a3b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-bb45bee0-19f9-47fb-a495-c35e5e4b1a3b.adda7d1c-9a52-4f0c-82e7-505f3036a3a2 1G Nov 06 15:42:00 devstack sudo[108149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:00 devstack sudo[108149]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a398f18a-a8b3-4707-b5f4-356a7f2e7e8e tempest-ProjectMemberTests-2050864699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-bb45bee0-19f9-47fb-a495-c35e5e4b1a3b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-bb45bee0-19f9-47fb-a495-c35e5e4b1a3b.adda7d1c-9a52-4f0c-82e7-505f3036a3a2 1G" returned: 0 in 0.519s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a398f18a-a8b3-4707-b5f4-356a7f2e7e8e tempest-ProjectMemberTests-2050864699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb45bee0-19f9-47fb-a495-c35e5e4b1a3b -F qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-bb45bee0-19f9-47fb-a495-c35e5e4b1a3b.adda7d1c-9a52-4f0c-82e7-505f3036a3a2 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:01 devstack sudo[108155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb45bee0-19f9-47fb-a495-c35e5e4b1a3b -F qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-bb45bee0-19f9-47fb-a495-c35e5e4b1a3b.adda7d1c-9a52-4f0c-82e7-505f3036a3a2 Nov 06 15:42:01 devstack sudo[108155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:01 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:SELECT=230,cinder:INSERT=91,cinder:UPDATE=352,cinder:DELETE=29 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 15:42:01 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:SELECT=252,cinder:DELETE=29,cinder:UPDATE=307,cinder:INSERT=87 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 15:42:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-2b4a7095-ff46-4366-857e-b0c661ed7495 tempest-ProjectReaderTests-90568800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:42:01 devstack sudo[108155]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a398f18a-a8b3-4707-b5f4-356a7f2e7e8e tempest-ProjectMemberTests-2050864699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb45bee0-19f9-47fb-a495-c35e5e4b1a3b -F qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-bb45bee0-19f9-47fb-a495-c35e5e4b1a3b.adda7d1c-9a52-4f0c-82e7-505f3036a3a2" returned: 0 in 0.426s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:01 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-a398f18a-a8b3-4707-b5f4-356a7f2e7e8e tempest-ProjectMemberTests-2050864699 None] /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-bb45bee0-19f9-47fb-a495-c35e5e4b1a3b.adda7d1c-9a52-4f0c-82e7-505f3036a3a2 is being set with open permissions: ugo+rw Nov 06 15:42:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a398f18a-a8b3-4707-b5f4-356a7f2e7e8e tempest-ProjectMemberTests-2050864699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-bb45bee0-19f9-47fb-a495-c35e5e4b1a3b.adda7d1c-9a52-4f0c-82e7-505f3036a3a2 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:01 devstack sudo[108161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-bb45bee0-19f9-47fb-a495-c35e5e4b1a3b.adda7d1c-9a52-4f0c-82e7-505f3036a3a2 Nov 06 15:42:01 devstack sudo[108161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:01 devstack sudo[108161]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a398f18a-a8b3-4707-b5f4-356a7f2e7e8e tempest-ProjectMemberTests-2050864699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-bb45bee0-19f9-47fb-a495-c35e5e4b1a3b.adda7d1c-9a52-4f0c-82e7-505f3036a3a2" returned: 0 in 0.277s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a398f18a-a8b3-4707-b5f4-356a7f2e7e8e tempest-ProjectMemberTests-2050864699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-bb45bee0-19f9-47fb-a495-c35e5e4b1a3b.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:01 devstack sudo[108164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-bb45bee0-19f9-47fb-a495-c35e5e4b1a3b.info Nov 06 15:42:01 devstack sudo[108164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:02 devstack sudo[108164]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a398f18a-a8b3-4707-b5f4-356a7f2e7e8e tempest-ProjectMemberTests-2050864699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-bb45bee0-19f9-47fb-a495-c35e5e4b1a3b.info" returned: 0 in 0.322s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:02 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-a398f18a-a8b3-4707-b5f4-356a7f2e7e8e tempest-ProjectMemberTests-2050864699 None] /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-bb45bee0-19f9-47fb-a495-c35e5e4b1a3b.info is being set with open permissions: ugo+rw Nov 06 15:42:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a398f18a-a8b3-4707-b5f4-356a7f2e7e8e tempest-ProjectMemberTests-2050864699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-bb45bee0-19f9-47fb-a495-c35e5e4b1a3b.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:02 devstack sudo[108201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-bb45bee0-19f9-47fb-a495-c35e5e4b1a3b.info Nov 06 15:42:02 devstack sudo[108201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:02 devstack sudo[108201]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a398f18a-a8b3-4707-b5f4-356a7f2e7e8e tempest-ProjectMemberTests-2050864699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-bb45bee0-19f9-47fb-a495-c35e5e4b1a3b.info" returned: 0 in 0.335s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a398f18a-a8b3-4707-b5f4-356a7f2e7e8e tempest-ProjectMemberTests-2050864699 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.485s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:42:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-2b4a7095-ff46-4366-857e-b0c661ed7495 tempest-ProjectReaderTests-90568800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.061s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:42:02 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-2b4a7095-ff46-4366-857e-b0c661ed7495 tempest-ProjectReaderTests-90568800 None] Creating offline snapshot 3f3e8e87-f4ad-4542-873a-8b7b92cbc8a3 of volume 3e539b63-aa8c-40c2-bb53-935423e07d04 {{(pid=87132) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 15:42:02 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a0d8307-5153-4a51-be84-d4bc3b57ac9e]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:42:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2b4a7095-ff46-4366-857e-b0c661ed7495 tempest-ProjectReaderTests-90568800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-3e539b63-aa8c-40c2-bb53-935423e07d04 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:02 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-a398f18a-a8b3-4707-b5f4-356a7f2e7e8e tempest-ProjectMemberTests-2050864699 None] Create snapshot completed successfully Nov 06 15:42:02 devstack sudo[108206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-3e539b63-aa8c-40c2-bb53-935423e07d04 Nov 06 15:42:02 devstack sudo[108206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:02 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-dea06d75-c25f-487b-a24b-5fda5cfbb6f3 tempest-ProjectMemberTests-2050864699 None] Acquiring lock "cinder-adda7d1c-9a52-4f0c-82e7-505f3036a3a2-delete_snapshot" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:42:02 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-dea06d75-c25f-487b-a24b-5fda5cfbb6f3 tempest-ProjectMemberTests-2050864699 None] Lock "cinder-adda7d1c-9a52-4f0c-82e7-505f3036a3a2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:42:02 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-dea06d75-c25f-487b-a24b-5fda5cfbb6f3 tempest-ProjectMemberTests-2050864699 None] Acquiring lock "cinder-quobyte-bb45bee0-19f9-47fb-a495-c35e5e4b1a3b" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:42:02 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-dea06d75-c25f-487b-a24b-5fda5cfbb6f3 tempest-ProjectMemberTests-2050864699 None] Lock "cinder-quobyte-bb45bee0-19f9-47fb-a495-c35e5e4b1a3b" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:42:02 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-dea06d75-c25f-487b-a24b-5fda5cfbb6f3 tempest-ProjectMemberTests-2050864699 None] Acquiring lock "cinder-quobyte-adda7d1c-9a52-4f0c-82e7-505f3036a3a2" by "_delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:42:02 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-dea06d75-c25f-487b-a24b-5fda5cfbb6f3 tempest-ProjectMemberTests-2050864699 None] Lock "cinder-quobyte-adda7d1c-9a52-4f0c-82e7-505f3036a3a2" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:42:02 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-dea06d75-c25f-487b-a24b-5fda5cfbb6f3 tempest-ProjectMemberTests-2050864699 None] Deleting offline snapshot adda7d1c-9a52-4f0c-82e7-505f3036a3a2 of volume bb45bee0-19f9-47fb-a495-c35e5e4b1a3b {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 15:42:02 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-dea06d75-c25f-487b-a24b-5fda5cfbb6f3 tempest-ProjectMemberTests-2050864699 None] snapshot_file for this snap is: volume-bb45bee0-19f9-47fb-a495-c35e5e4b1a3b.adda7d1c-9a52-4f0c-82e7-505f3036a3a2 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 15:42:02 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[da413603-d996-446d-8919-7cc259d15b09]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:42:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-dea06d75-c25f-487b-a24b-5fda5cfbb6f3 tempest-ProjectMemberTests-2050864699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-bb45bee0-19f9-47fb-a495-c35e5e4b1a3b.adda7d1c-9a52-4f0c-82e7-505f3036a3a2 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:02 devstack sudo[108206]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2b4a7095-ff46-4366-857e-b0c661ed7495 tempest-ProjectReaderTests-90568800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-3e539b63-aa8c-40c2-bb53-935423e07d04" returned: 0 in 0.485s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2b4a7095-ff46-4366-857e-b0c661ed7495 tempest-ProjectReaderTests-90568800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-3e539b63-aa8c-40c2-bb53-935423e07d04,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-3e539b63-aa8c-40c2-bb53-935423e07d04.3f3e8e87-f4ad-4542-873a-8b7b92cbc8a3 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:02 devstack sudo[108212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-3e539b63-aa8c-40c2-bb53-935423e07d04,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-3e539b63-aa8c-40c2-bb53-935423e07d04.3f3e8e87-f4ad-4542-873a-8b7b92cbc8a3 1G Nov 06 15:42:02 devstack sudo[108212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:03 devstack sudo[108210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-bb45bee0-19f9-47fb-a495-c35e5e4b1a3b.adda7d1c-9a52-4f0c-82e7-505f3036a3a2 Nov 06 15:42:03 devstack sudo[108210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:03 devstack sudo[108210]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-dea06d75-c25f-487b-a24b-5fda5cfbb6f3 tempest-ProjectMemberTests-2050864699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-bb45bee0-19f9-47fb-a495-c35e5e4b1a3b.adda7d1c-9a52-4f0c-82e7-505f3036a3a2" returned: 0 in 0.462s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:03 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-dea06d75-c25f-487b-a24b-5fda5cfbb6f3 tempest-ProjectMemberTests-2050864699 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bb45bee0-19f9-47fb-a495-c35e5e4b1a3b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 15:42:03 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6149ad5-37f3-4044-ab41-53489a281737]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:42:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-dea06d75-c25f-487b-a24b-5fda5cfbb6f3 tempest-ProjectMemberTests-2050864699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-bb45bee0-19f9-47fb-a495-c35e5e4b1a3b {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:03 devstack sudo[108212]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2b4a7095-ff46-4366-857e-b0c661ed7495 tempest-ProjectReaderTests-90568800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-3e539b63-aa8c-40c2-bb53-935423e07d04,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-3e539b63-aa8c-40c2-bb53-935423e07d04.3f3e8e87-f4ad-4542-873a-8b7b92cbc8a3 1G" returned: 0 in 0.507s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2b4a7095-ff46-4366-857e-b0c661ed7495 tempest-ProjectReaderTests-90568800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e539b63-aa8c-40c2-bb53-935423e07d04 -F qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-3e539b63-aa8c-40c2-bb53-935423e07d04.3f3e8e87-f4ad-4542-873a-8b7b92cbc8a3 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:03 devstack sudo[108223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-bb45bee0-19f9-47fb-a495-c35e5e4b1a3b Nov 06 15:42:03 devstack sudo[108223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:03 devstack sudo[108224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e539b63-aa8c-40c2-bb53-935423e07d04 -F qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-3e539b63-aa8c-40c2-bb53-935423e07d04.3f3e8e87-f4ad-4542-873a-8b7b92cbc8a3 Nov 06 15:42:03 devstack sudo[108224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:03 devstack sudo[108223]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-dea06d75-c25f-487b-a24b-5fda5cfbb6f3 tempest-ProjectMemberTests-2050864699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-bb45bee0-19f9-47fb-a495-c35e5e4b1a3b" returned: 0 in 0.479s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-dea06d75-c25f-487b-a24b-5fda5cfbb6f3 tempest-ProjectMemberTests-2050864699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-bb45bee0-19f9-47fb-a495-c35e5e4b1a3b.adda7d1c-9a52-4f0c-82e7-505f3036a3a2 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:03 devstack sudo[108224]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2b4a7095-ff46-4366-857e-b0c661ed7495 tempest-ProjectReaderTests-90568800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e539b63-aa8c-40c2-bb53-935423e07d04 -F qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-3e539b63-aa8c-40c2-bb53-935423e07d04.3f3e8e87-f4ad-4542-873a-8b7b92cbc8a3" returned: 0 in 0.399s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:03 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-2b4a7095-ff46-4366-857e-b0c661ed7495 tempest-ProjectReaderTests-90568800 None] /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-3e539b63-aa8c-40c2-bb53-935423e07d04.3f3e8e87-f4ad-4542-873a-8b7b92cbc8a3 is being set with open permissions: ugo+rw Nov 06 15:42:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2b4a7095-ff46-4366-857e-b0c661ed7495 tempest-ProjectReaderTests-90568800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-3e539b63-aa8c-40c2-bb53-935423e07d04.3f3e8e87-f4ad-4542-873a-8b7b92cbc8a3 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:03 devstack sudo[108234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-bb45bee0-19f9-47fb-a495-c35e5e4b1a3b.adda7d1c-9a52-4f0c-82e7-505f3036a3a2 Nov 06 15:42:03 devstack sudo[108234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:03 devstack sudo[108235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-3e539b63-aa8c-40c2-bb53-935423e07d04.3f3e8e87-f4ad-4542-873a-8b7b92cbc8a3 Nov 06 15:42:03 devstack sudo[108235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:04 devstack sudo[108235]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2b4a7095-ff46-4366-857e-b0c661ed7495 tempest-ProjectReaderTests-90568800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-3e539b63-aa8c-40c2-bb53-935423e07d04.3f3e8e87-f4ad-4542-873a-8b7b92cbc8a3" returned: 0 in 0.265s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2b4a7095-ff46-4366-857e-b0c661ed7495 tempest-ProjectReaderTests-90568800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-3e539b63-aa8c-40c2-bb53-935423e07d04.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:04 devstack sudo[108242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-3e539b63-aa8c-40c2-bb53-935423e07d04.info Nov 06 15:42:04 devstack sudo[108242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:04 devstack sudo[108234]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-dea06d75-c25f-487b-a24b-5fda5cfbb6f3 tempest-ProjectMemberTests-2050864699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-bb45bee0-19f9-47fb-a495-c35e5e4b1a3b.adda7d1c-9a52-4f0c-82e7-505f3036a3a2" returned: 0 in 0.403s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-dea06d75-c25f-487b-a24b-5fda5cfbb6f3 tempest-ProjectMemberTests-2050864699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-bb45bee0-19f9-47fb-a495-c35e5e4b1a3b.adda7d1c-9a52-4f0c-82e7-505f3036a3a2 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:04 devstack sudo[108244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-bb45bee0-19f9-47fb-a495-c35e5e4b1a3b.adda7d1c-9a52-4f0c-82e7-505f3036a3a2 Nov 06 15:42:04 devstack sudo[108244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:04 devstack sudo[108242]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2b4a7095-ff46-4366-857e-b0c661ed7495 tempest-ProjectReaderTests-90568800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-3e539b63-aa8c-40c2-bb53-935423e07d04.info" returned: 0 in 0.269s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:04 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-2b4a7095-ff46-4366-857e-b0c661ed7495 tempest-ProjectReaderTests-90568800 None] /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-3e539b63-aa8c-40c2-bb53-935423e07d04.info is being set with open permissions: ugo+rw Nov 06 15:42:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2b4a7095-ff46-4366-857e-b0c661ed7495 tempest-ProjectReaderTests-90568800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-3e539b63-aa8c-40c2-bb53-935423e07d04.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:04 devstack sudo[108247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-3e539b63-aa8c-40c2-bb53-935423e07d04.info Nov 06 15:42:04 devstack sudo[108247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:04 devstack sudo[108244]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-dea06d75-c25f-487b-a24b-5fda5cfbb6f3 tempest-ProjectMemberTests-2050864699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-bb45bee0-19f9-47fb-a495-c35e5e4b1a3b.adda7d1c-9a52-4f0c-82e7-505f3036a3a2" returned: 0 in 0.277s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:04 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-dea06d75-c25f-487b-a24b-5fda5cfbb6f3 tempest-ProjectMemberTests-2050864699 None] Lock "cinder-quobyte-adda7d1c-9a52-4f0c-82e7-505f3036a3a2" released by "_delete_snapshot" :: held 1.774s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:42:04 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-dea06d75-c25f-487b-a24b-5fda5cfbb6f3 tempest-ProjectMemberTests-2050864699 None] Lock "cinder-quobyte-bb45bee0-19f9-47fb-a495-c35e5e4b1a3b" released by "delete_snapshot" :: held 1.812s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:42:04 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-dea06d75-c25f-487b-a24b-5fda5cfbb6f3 tempest-ProjectMemberTests-2050864699 None] Created reservations ['a200bf3c-07ea-4aab-8bcf-938caa724164', '4b813030-5d38-45c6-8a26-320c5718bc9a', '769acf9e-dd5e-4f58-977a-d76a3bb7a87e', '729cfc03-a9de-434b-9e20-c60340dfc154'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:42:04 devstack sudo[108247]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2b4a7095-ff46-4366-857e-b0c661ed7495 tempest-ProjectReaderTests-90568800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-3e539b63-aa8c-40c2-bb53-935423e07d04.info" returned: 0 in 0.291s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-2b4a7095-ff46-4366-857e-b0c661ed7495 tempest-ProjectReaderTests-90568800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.364s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:42:04 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-2b4a7095-ff46-4366-857e-b0c661ed7495 tempest-ProjectReaderTests-90568800 None] Create snapshot completed successfully Nov 06 15:42:04 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-dea06d75-c25f-487b-a24b-5fda5cfbb6f3 tempest-ProjectMemberTests-2050864699 None] Delete snapshot completed successfully. Nov 06 15:42:04 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-dea06d75-c25f-487b-a24b-5fda5cfbb6f3 tempest-ProjectMemberTests-2050864699 None] Lock "cinder-adda7d1c-9a52-4f0c-82e7-505f3036a3a2-delete_snapshot" released by "delete_snapshot" :: held 2.075s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:42:04 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-efb21091-41f7-4d05-ac05-12c701692e02 tempest-ProjectMemberTests-2050864699 None] Acquiring lock "cinder-bb45bee0-19f9-47fb-a495-c35e5e4b1a3b-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:42:05 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-efb21091-41f7-4d05-ac05-12c701692e02 tempest-ProjectMemberTests-2050864699 None] Lock "cinder-bb45bee0-19f9-47fb-a495-c35e5e4b1a3b-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:42:05 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-efb21091-41f7-4d05-ac05-12c701692e02 tempest-ProjectMemberTests-2050864699 None] Acquiring lock "cinder-quobyte-bb45bee0-19f9-47fb-a495-c35e5e4b1a3b" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:42:05 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-efb21091-41f7-4d05-ac05-12c701692e02 tempest-ProjectMemberTests-2050864699 None] Lock "cinder-quobyte-bb45bee0-19f9-47fb-a495-c35e5e4b1a3b" acquired by "delete_volume" :: waited 0.025s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:42:05 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc7725ce-46de-43ad-aaa1-c6eaa6925457]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:42:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-efb21091-41f7-4d05-ac05-12c701692e02 tempest-ProjectMemberTests-2050864699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-bb45bee0-19f9-47fb-a495-c35e5e4b1a3b {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:05 devstack sudo[108251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-bb45bee0-19f9-47fb-a495-c35e5e4b1a3b Nov 06 15:42:05 devstack sudo[108251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:05 devstack sudo[108251]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-efb21091-41f7-4d05-ac05-12c701692e02 tempest-ProjectMemberTests-2050864699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-bb45bee0-19f9-47fb-a495-c35e5e4b1a3b" returned: 0 in 0.476s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-efb21091-41f7-4d05-ac05-12c701692e02 tempest-ProjectMemberTests-2050864699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-bb45bee0-19f9-47fb-a495-c35e5e4b1a3b {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:05 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-bf1eac69-5b3e-4657-a069-1c9dfb523ed9 tempest-ProjectReaderTests-90568800 None] Acquiring lock "cinder-3f3e8e87-f4ad-4542-873a-8b7b92cbc8a3-delete_snapshot" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:42:05 devstack sudo[108257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-bb45bee0-19f9-47fb-a495-c35e5e4b1a3b Nov 06 15:42:05 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-bf1eac69-5b3e-4657-a069-1c9dfb523ed9 tempest-ProjectReaderTests-90568800 None] Lock "cinder-3f3e8e87-f4ad-4542-873a-8b7b92cbc8a3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:42:05 devstack sudo[108257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:05 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-bf1eac69-5b3e-4657-a069-1c9dfb523ed9 tempest-ProjectReaderTests-90568800 None] Acquiring lock "cinder-quobyte-3e539b63-aa8c-40c2-bb53-935423e07d04" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:42:05 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-bf1eac69-5b3e-4657-a069-1c9dfb523ed9 tempest-ProjectReaderTests-90568800 None] Lock "cinder-quobyte-3e539b63-aa8c-40c2-bb53-935423e07d04" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:42:05 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-bf1eac69-5b3e-4657-a069-1c9dfb523ed9 tempest-ProjectReaderTests-90568800 None] Acquiring lock "cinder-quobyte-3f3e8e87-f4ad-4542-873a-8b7b92cbc8a3" by "_delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:42:05 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-bf1eac69-5b3e-4657-a069-1c9dfb523ed9 tempest-ProjectReaderTests-90568800 None] Lock "cinder-quobyte-3f3e8e87-f4ad-4542-873a-8b7b92cbc8a3" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:42:05 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-bf1eac69-5b3e-4657-a069-1c9dfb523ed9 tempest-ProjectReaderTests-90568800 None] Deleting offline snapshot 3f3e8e87-f4ad-4542-873a-8b7b92cbc8a3 of volume 3e539b63-aa8c-40c2-bb53-935423e07d04 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 15:42:05 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-bf1eac69-5b3e-4657-a069-1c9dfb523ed9 tempest-ProjectReaderTests-90568800 None] snapshot_file for this snap is: volume-3e539b63-aa8c-40c2-bb53-935423e07d04.3f3e8e87-f4ad-4542-873a-8b7b92cbc8a3 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 15:42:05 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[039df811-b4a7-4f39-a178-9c851f355d48]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:42:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bf1eac69-5b3e-4657-a069-1c9dfb523ed9 tempest-ProjectReaderTests-90568800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-3e539b63-aa8c-40c2-bb53-935423e07d04.3f3e8e87-f4ad-4542-873a-8b7b92cbc8a3 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:05 devstack sudo[108259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-3e539b63-aa8c-40c2-bb53-935423e07d04.3f3e8e87-f4ad-4542-873a-8b7b92cbc8a3 Nov 06 15:42:05 devstack sudo[108259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:05 devstack sudo[108257]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-efb21091-41f7-4d05-ac05-12c701692e02 tempest-ProjectMemberTests-2050864699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-bb45bee0-19f9-47fb-a495-c35e5e4b1a3b" returned: 0 in 0.329s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:05 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-efb21091-41f7-4d05-ac05-12c701692e02 tempest-ProjectMemberTests-2050864699 None] Lock "cinder-quobyte-bb45bee0-19f9-47fb-a495-c35e5e4b1a3b" released by "delete_volume" :: held 0.884s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:42:06 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-efb21091-41f7-4d05-ac05-12c701692e02 tempest-ProjectMemberTests-2050864699 None] Created reservations ['50158696-994d-42e4-812c-8cfd1fb00f02', '504bb228-5e85-4245-b921-a359751c40e6', 'af38e352-a9aa-4ada-a966-8db65e0bc5e9', '19b053bd-e8f5-4f2f-983b-8f25298cc88e'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:42:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-efb21091-41f7-4d05-ac05-12c701692e02 tempest-ProjectMemberTests-2050864699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:42:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-efb21091-41f7-4d05-ac05-12c701692e02 tempest-ProjectMemberTests-2050864699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:42:06 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-efb21091-41f7-4d05-ac05-12c701692e02 tempest-ProjectMemberTests-2050864699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:42:06 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-efb21091-41f7-4d05-ac05-12c701692e02 tempest-ProjectMemberTests-2050864699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:42:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-efb21091-41f7-4d05-ac05-12c701692e02 tempest-ProjectMemberTests-2050864699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:42:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-efb21091-41f7-4d05-ac05-12c701692e02 tempest-ProjectMemberTests-2050864699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:06 devstack sudo[108264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:42:06 devstack sudo[108264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:06 devstack sudo[108259]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bf1eac69-5b3e-4657-a069-1c9dfb523ed9 tempest-ProjectReaderTests-90568800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-3e539b63-aa8c-40c2-bb53-935423e07d04.3f3e8e87-f4ad-4542-873a-8b7b92cbc8a3" returned: 0 in 0.509s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:06 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-bf1eac69-5b3e-4657-a069-1c9dfb523ed9 tempest-ProjectReaderTests-90568800 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3e539b63-aa8c-40c2-bb53-935423e07d04(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 15:42:06 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbe3da87-7e2b-4c91-b8cd-4264784a24f4]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:42:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bf1eac69-5b3e-4657-a069-1c9dfb523ed9 tempest-ProjectReaderTests-90568800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-3e539b63-aa8c-40c2-bb53-935423e07d04 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:06 devstack sudo[108268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-3e539b63-aa8c-40c2-bb53-935423e07d04 Nov 06 15:42:06 devstack sudo[108268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:06 devstack sudo[108264]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-efb21091-41f7-4d05-ac05-12c701692e02 tempest-ProjectMemberTests-2050864699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.324s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:06 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-efb21091-41f7-4d05-ac05-12c701692e02 tempest-ProjectMemberTests-2050864699 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:42:06 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-efb21091-41f7-4d05-ac05-12c701692e02 tempest-ProjectMemberTests-2050864699 None] Deleted volume successfully. Nov 06 15:42:06 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-efb21091-41f7-4d05-ac05-12c701692e02 tempest-ProjectMemberTests-2050864699 None] Lock "cinder-bb45bee0-19f9-47fb-a495-c35e5e4b1a3b-delete_volume" released by "delete_volume" :: held 1.500s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:42:06 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-cda4f2e4-94dc-4ce1-b206-219ba0831b43 tempest-ProjectMemberTests-2050864699 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:42:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-cda4f2e4-94dc-4ce1-b206-219ba0831b43 tempest-ProjectMemberTests-2050864699 None] Flow 'volume_create_manager' (4f6a0cc8-47cd-4b33-afb8-1fa09c510b04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:42:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-cda4f2e4-94dc-4ce1-b206-219ba0831b43 tempest-ProjectMemberTests-2050864699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f6f8acc-919a-4566-942a-0a03571ce0cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:42:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-cda4f2e4-94dc-4ce1-b206-219ba0831b43 tempest-ProjectMemberTests-2050864699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f6f8acc-919a-4566-942a-0a03571ce0cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:42:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-164273877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a39e248e-b5a0-40e0-ad41-d84ab95cc466,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='631b1acb2fe74ff38bf682df0fb94c26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:42:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:42:07Z,use_quota=True,user_id='c2ab5a7c9b61494492f0f3bd6193ebdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:42:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-cda4f2e4-94dc-4ce1-b206-219ba0831b43 tempest-ProjectMemberTests-2050864699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (398d1941-c837-41de-8dba-f13239f9552e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:42:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-cda4f2e4-94dc-4ce1-b206-219ba0831b43 tempest-ProjectMemberTests-2050864699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (398d1941-c837-41de-8dba-f13239f9552e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:42:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-cda4f2e4-94dc-4ce1-b206-219ba0831b43 tempest-ProjectMemberTests-2050864699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebd2b6bc-e124-4f57-9922-aaec646e2d83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:42:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-cda4f2e4-94dc-4ce1-b206-219ba0831b43 tempest-ProjectMemberTests-2050864699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebd2b6bc-e124-4f57-9922-aaec646e2d83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a39e248e-b5a0-40e0-ad41-d84ab95cc466', 'volume_name': 'volume-a39e248e-b5a0-40e0-ad41-d84ab95cc466', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:42:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-cda4f2e4-94dc-4ce1-b206-219ba0831b43 tempest-ProjectMemberTests-2050864699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (145c60bf-9972-43d9-9a08-0f8edb4cb533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:42:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-cda4f2e4-94dc-4ce1-b206-219ba0831b43 tempest-ProjectMemberTests-2050864699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (145c60bf-9972-43d9-9a08-0f8edb4cb533) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:42:06 devstack sudo[108268]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-cda4f2e4-94dc-4ce1-b206-219ba0831b43 tempest-ProjectMemberTests-2050864699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf97f35d-4bfe-43fa-a541-dc245dd5cd50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:42:06 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-cda4f2e4-94dc-4ce1-b206-219ba0831b43 tempest-ProjectMemberTests-2050864699 None] Volume a39e248e-b5a0-40e0-ad41-d84ab95cc466: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a39e248e-b5a0-40e0-ad41-d84ab95cc466', 'volume_size': 1} Nov 06 15:42:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-cda4f2e4-94dc-4ce1-b206-219ba0831b43 tempest-ProjectMemberTests-2050864699 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:42:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-cda4f2e4-94dc-4ce1-b206-219ba0831b43 tempest-ProjectMemberTests-2050864699 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:42:06 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-cda4f2e4-94dc-4ce1-b206-219ba0831b43 tempest-ProjectMemberTests-2050864699 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:42:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-164273877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a39e248e-b5a0-40e0-ad41-d84ab95cc466,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='631b1acb2fe74ff38bf682df0fb94c26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:42:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:42:07Z,use_quota=True,user_id='c2ab5a7c9b61494492f0f3bd6193ebdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:42:06 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-cda4f2e4-94dc-4ce1-b206-219ba0831b43 tempest-ProjectMemberTests-2050864699 None] Creating volume a39e248e-b5a0-40e0-ad41-d84ab95cc466 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:42:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-cda4f2e4-94dc-4ce1-b206-219ba0831b43 tempest-ProjectMemberTests-2050864699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:42:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-cda4f2e4-94dc-4ce1-b206-219ba0831b43 tempest-ProjectMemberTests-2050864699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:42:06 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-cda4f2e4-94dc-4ce1-b206-219ba0831b43 tempest-ProjectMemberTests-2050864699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:42:06 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-cda4f2e4-94dc-4ce1-b206-219ba0831b43 tempest-ProjectMemberTests-2050864699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:42:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-cda4f2e4-94dc-4ce1-b206-219ba0831b43 tempest-ProjectMemberTests-2050864699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:42:06 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-cda4f2e4-94dc-4ce1-b206-219ba0831b43 tempest-ProjectMemberTests-2050864699 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:42:06 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-cda4f2e4-94dc-4ce1-b206-219ba0831b43 tempest-ProjectMemberTests-2050864699 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:42:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-cda4f2e4-94dc-4ce1-b206-219ba0831b43 tempest-ProjectMemberTests-2050864699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a39e248e-b5a0-40e0-ad41-d84ab95cc466 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bf1eac69-5b3e-4657-a069-1c9dfb523ed9 tempest-ProjectReaderTests-90568800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-3e539b63-aa8c-40c2-bb53-935423e07d04" returned: 0 in 0.607s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bf1eac69-5b3e-4657-a069-1c9dfb523ed9 tempest-ProjectReaderTests-90568800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-3e539b63-aa8c-40c2-bb53-935423e07d04.3f3e8e87-f4ad-4542-873a-8b7b92cbc8a3 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:06 devstack sudo[108275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a39e248e-b5a0-40e0-ad41-d84ab95cc466 1073741824 Nov 06 15:42:06 devstack sudo[108275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:06 devstack sudo[108276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-3e539b63-aa8c-40c2-bb53-935423e07d04.3f3e8e87-f4ad-4542-873a-8b7b92cbc8a3 Nov 06 15:42:06 devstack sudo[108276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:07 devstack sudo[108276]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bf1eac69-5b3e-4657-a069-1c9dfb523ed9 tempest-ProjectReaderTests-90568800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-3e539b63-aa8c-40c2-bb53-935423e07d04.3f3e8e87-f4ad-4542-873a-8b7b92cbc8a3" returned: 0 in 0.446s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bf1eac69-5b3e-4657-a069-1c9dfb523ed9 tempest-ProjectReaderTests-90568800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-3e539b63-aa8c-40c2-bb53-935423e07d04.3f3e8e87-f4ad-4542-873a-8b7b92cbc8a3 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:07 devstack sudo[108286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-3e539b63-aa8c-40c2-bb53-935423e07d04.3f3e8e87-f4ad-4542-873a-8b7b92cbc8a3 Nov 06 15:42:07 devstack sudo[108286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:07 devstack sudo[108275]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-cda4f2e4-94dc-4ce1-b206-219ba0831b43 tempest-ProjectMemberTests-2050864699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a39e248e-b5a0-40e0-ad41-d84ab95cc466 1073741824" returned: 0 in 0.583s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-cda4f2e4-94dc-4ce1-b206-219ba0831b43 tempest-ProjectMemberTests-2050864699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a39e248e-b5a0-40e0-ad41-d84ab95cc466 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:07 devstack sudo[108288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a39e248e-b5a0-40e0-ad41-d84ab95cc466 Nov 06 15:42:07 devstack sudo[108288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:07 devstack sudo[108286]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bf1eac69-5b3e-4657-a069-1c9dfb523ed9 tempest-ProjectReaderTests-90568800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-3e539b63-aa8c-40c2-bb53-935423e07d04.3f3e8e87-f4ad-4542-873a-8b7b92cbc8a3" returned: 0 in 0.375s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:07 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-bf1eac69-5b3e-4657-a069-1c9dfb523ed9 tempest-ProjectReaderTests-90568800 None] Lock "cinder-quobyte-3f3e8e87-f4ad-4542-873a-8b7b92cbc8a3" released by "_delete_snapshot" :: held 2.092s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:42:07 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-bf1eac69-5b3e-4657-a069-1c9dfb523ed9 tempest-ProjectReaderTests-90568800 None] Lock "cinder-quobyte-3e539b63-aa8c-40c2-bb53-935423e07d04" released by "delete_snapshot" :: held 2.123s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:42:07 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-bf1eac69-5b3e-4657-a069-1c9dfb523ed9 tempest-ProjectReaderTests-90568800 None] Created reservations ['34f7163f-e528-4931-9b09-222d39bb1741', '148db4b5-cad2-4fcb-8b86-2611013dafaa', '01fa9b44-4992-4d81-80a2-46bc3b58dbd9', '1228756e-854a-41f5-9c80-08078dcfbd90'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:42:07 devstack sudo[108288]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-cda4f2e4-94dc-4ce1-b206-219ba0831b43 tempest-ProjectMemberTests-2050864699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a39e248e-b5a0-40e0-ad41-d84ab95cc466" returned: 0 in 0.411s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:07 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-cda4f2e4-94dc-4ce1-b206-219ba0831b43 tempest-ProjectMemberTests-2050864699 None] <== create_volume: return (1054ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:42:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-cda4f2e4-94dc-4ce1-b206-219ba0831b43 tempest-ProjectMemberTests-2050864699 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.057s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:42:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-cda4f2e4-94dc-4ce1-b206-219ba0831b43 tempest-ProjectMemberTests-2050864699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf97f35d-4bfe-43fa-a541-dc245dd5cd50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a39e248e-b5a0-40e0-ad41-d84ab95cc466', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:42:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-cda4f2e4-94dc-4ce1-b206-219ba0831b43 tempest-ProjectMemberTests-2050864699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cd4cac2-aedc-4696-83a8-161a26a43d77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:42:07 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-cda4f2e4-94dc-4ce1-b206-219ba0831b43 tempest-ProjectMemberTests-2050864699 None] Volume volume-a39e248e-b5a0-40e0-ad41-d84ab95cc466 (a39e248e-b5a0-40e0-ad41-d84ab95cc466): created successfully Nov 06 15:42:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-cda4f2e4-94dc-4ce1-b206-219ba0831b43 tempest-ProjectMemberTests-2050864699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cd4cac2-aedc-4696-83a8-161a26a43d77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:42:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-cda4f2e4-94dc-4ce1-b206-219ba0831b43 tempest-ProjectMemberTests-2050864699 None] Flow 'volume_create_manager' (4f6a0cc8-47cd-4b33-afb8-1fa09c510b04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:42:07 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-bf1eac69-5b3e-4657-a069-1c9dfb523ed9 tempest-ProjectReaderTests-90568800 None] Delete snapshot completed successfully. Nov 06 15:42:08 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-bf1eac69-5b3e-4657-a069-1c9dfb523ed9 tempest-ProjectReaderTests-90568800 None] Lock "cinder-3f3e8e87-f4ad-4542-873a-8b7b92cbc8a3-delete_snapshot" released by "delete_snapshot" :: held 2.325s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:42:08 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-cda4f2e4-94dc-4ce1-b206-219ba0831b43 tempest-ProjectMemberTests-2050864699 None] Created volume successfully. Nov 06 15:42:08 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 15:42:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:42:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:42:08 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:42:08 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:42:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:42:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:08 devstack sudo[108292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:42:08 devstack sudo[108292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:08 devstack sudo[108292]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.249s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:08 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:42:08 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Running periodic task VolumeManager._thread_info {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 15:42:08 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] thread count: 28 {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 15:42:08 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] thread info: [<_MainThread(MainThread, started 140011251929216)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 06 15:42:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ece30bef-0355-42d9-9130-1f758feb3dd6 tempest-ProjectMemberTests-2050864699 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:42:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ece30bef-0355-42d9-9130-1f758feb3dd6 tempest-ProjectMemberTests-2050864699 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:42:09 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-ece30bef-0355-42d9-9130-1f758feb3dd6 tempest-ProjectMemberTests-2050864699 None] Creating offline snapshot 06fe3933-5652-4572-b584-51a38532edbf of volume a39e248e-b5a0-40e0-ad41-d84ab95cc466 {{(pid=87132) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 15:42:09 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[a483512e-ea48-46e6-93a9-35080722e326]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:42:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ece30bef-0355-42d9-9130-1f758feb3dd6 tempest-ProjectMemberTests-2050864699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a39e248e-b5a0-40e0-ad41-d84ab95cc466 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:09 devstack sudo[108295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a39e248e-b5a0-40e0-ad41-d84ab95cc466 Nov 06 15:42:09 devstack sudo[108295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:09 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-5fbfbc61-ab35-43b1-91cf-5e7eaa4d8e89 tempest-ProjectReaderTests-90568800 None] Acquiring lock "cinder-3e539b63-aa8c-40c2-bb53-935423e07d04-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:42:09 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-5fbfbc61-ab35-43b1-91cf-5e7eaa4d8e89 tempest-ProjectReaderTests-90568800 None] Lock "cinder-3e539b63-aa8c-40c2-bb53-935423e07d04-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:42:09 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-5fbfbc61-ab35-43b1-91cf-5e7eaa4d8e89 tempest-ProjectReaderTests-90568800 None] Acquiring lock "cinder-quobyte-3e539b63-aa8c-40c2-bb53-935423e07d04" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:42:09 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-5fbfbc61-ab35-43b1-91cf-5e7eaa4d8e89 tempest-ProjectReaderTests-90568800 None] Lock "cinder-quobyte-3e539b63-aa8c-40c2-bb53-935423e07d04" acquired by "delete_volume" :: waited 0.032s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:42:09 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[979cd78b-214d-497c-8761-92f605841d43]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:42:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5fbfbc61-ab35-43b1-91cf-5e7eaa4d8e89 tempest-ProjectReaderTests-90568800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-3e539b63-aa8c-40c2-bb53-935423e07d04 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:09 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-889ab15a-abc8-4089-8e69-16412e0f267e tempest-ProjectReaderTests-140075233 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:42:09 devstack sudo[108295]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:09 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-889ab15a-abc8-4089-8e69-16412e0f267e tempest-ProjectReaderTests-140075233 None] Flow 'volume_create_manager' (d9157c04-6c17-472c-a2ef-37bb2f3e3ac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:42:09 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-889ab15a-abc8-4089-8e69-16412e0f267e tempest-ProjectReaderTests-140075233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (429bee4c-7891-4293-b8a2-af4cf115aaf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:42:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ece30bef-0355-42d9-9130-1f758feb3dd6 tempest-ProjectMemberTests-2050864699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a39e248e-b5a0-40e0-ad41-d84ab95cc466" returned: 0 in 0.477s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ece30bef-0355-42d9-9130-1f758feb3dd6 tempest-ProjectMemberTests-2050864699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a39e248e-b5a0-40e0-ad41-d84ab95cc466,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a39e248e-b5a0-40e0-ad41-d84ab95cc466.06fe3933-5652-4572-b584-51a38532edbf 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:09 devstack sudo[108298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-3e539b63-aa8c-40c2-bb53-935423e07d04 Nov 06 15:42:09 devstack sudo[108298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:09 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-889ab15a-abc8-4089-8e69-16412e0f267e tempest-ProjectReaderTests-140075233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (429bee4c-7891-4293-b8a2-af4cf115aaf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:42:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1474374527',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad3ab231-514c-4b31-a04a-252fa367c23c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac9d16e12dfb4ef9893478823bf36158',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:42:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:42:09Z,use_quota=True,user_id='c627485c382a4cc6aecab8442ba4f552',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:42:09 devstack sudo[108303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a39e248e-b5a0-40e0-ad41-d84ab95cc466,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a39e248e-b5a0-40e0-ad41-d84ab95cc466.06fe3933-5652-4572-b584-51a38532edbf 1G Nov 06 15:42:09 devstack sudo[108303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:09 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-889ab15a-abc8-4089-8e69-16412e0f267e tempest-ProjectReaderTests-140075233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81fe3bff-63f4-41c8-a794-3d9c001f758e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:42:09 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-889ab15a-abc8-4089-8e69-16412e0f267e tempest-ProjectReaderTests-140075233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81fe3bff-63f4-41c8-a794-3d9c001f758e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:42:09 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-889ab15a-abc8-4089-8e69-16412e0f267e tempest-ProjectReaderTests-140075233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (682b3ebd-1631-4450-b141-6b5653073a0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:42:09 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-889ab15a-abc8-4089-8e69-16412e0f267e tempest-ProjectReaderTests-140075233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (682b3ebd-1631-4450-b141-6b5653073a0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad3ab231-514c-4b31-a04a-252fa367c23c', 'volume_name': 'volume-ad3ab231-514c-4b31-a04a-252fa367c23c', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:42:09 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-889ab15a-abc8-4089-8e69-16412e0f267e tempest-ProjectReaderTests-140075233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d85bac3-78e4-49ea-b7de-a33371aa57aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:42:09 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-889ab15a-abc8-4089-8e69-16412e0f267e tempest-ProjectReaderTests-140075233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d85bac3-78e4-49ea-b7de-a33371aa57aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:42:09 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-889ab15a-abc8-4089-8e69-16412e0f267e tempest-ProjectReaderTests-140075233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de57afc5-284b-4b27-bf65-cc55e246a806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:42:09 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-889ab15a-abc8-4089-8e69-16412e0f267e tempest-ProjectReaderTests-140075233 None] Volume ad3ab231-514c-4b31-a04a-252fa367c23c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad3ab231-514c-4b31-a04a-252fa367c23c', 'volume_size': 1} Nov 06 15:42:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-889ab15a-abc8-4089-8e69-16412e0f267e tempest-ProjectReaderTests-140075233 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:42:09 devstack sudo[108298]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5fbfbc61-ab35-43b1-91cf-5e7eaa4d8e89 tempest-ProjectReaderTests-90568800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-3e539b63-aa8c-40c2-bb53-935423e07d04" returned: 0 in 0.453s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5fbfbc61-ab35-43b1-91cf-5e7eaa4d8e89 tempest-ProjectReaderTests-90568800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-3e539b63-aa8c-40c2-bb53-935423e07d04 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:09 devstack sudo[108311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-3e539b63-aa8c-40c2-bb53-935423e07d04 Nov 06 15:42:09 devstack sudo[108311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:10 devstack sudo[108303]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ece30bef-0355-42d9-9130-1f758feb3dd6 tempest-ProjectMemberTests-2050864699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a39e248e-b5a0-40e0-ad41-d84ab95cc466,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a39e248e-b5a0-40e0-ad41-d84ab95cc466.06fe3933-5652-4572-b584-51a38532edbf 1G" returned: 0 in 0.479s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ece30bef-0355-42d9-9130-1f758feb3dd6 tempest-ProjectMemberTests-2050864699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a39e248e-b5a0-40e0-ad41-d84ab95cc466 -F qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a39e248e-b5a0-40e0-ad41-d84ab95cc466.06fe3933-5652-4572-b584-51a38532edbf {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:10 devstack sudo[108313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a39e248e-b5a0-40e0-ad41-d84ab95cc466 -F qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a39e248e-b5a0-40e0-ad41-d84ab95cc466.06fe3933-5652-4572-b584-51a38532edbf Nov 06 15:42:10 devstack sudo[108313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:10 devstack sudo[108311]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5fbfbc61-ab35-43b1-91cf-5e7eaa4d8e89 tempest-ProjectReaderTests-90568800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-3e539b63-aa8c-40c2-bb53-935423e07d04" returned: 0 in 0.303s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:10 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-5fbfbc61-ab35-43b1-91cf-5e7eaa4d8e89 tempest-ProjectReaderTests-90568800 None] Lock "cinder-quobyte-3e539b63-aa8c-40c2-bb53-935423e07d04" released by "delete_volume" :: held 0.858s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:42:10 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-5fbfbc61-ab35-43b1-91cf-5e7eaa4d8e89 tempest-ProjectReaderTests-90568800 None] Created reservations ['01058ad4-ea21-4edb-a094-bdc13e204962', 'ef482301-c6c7-4333-9181-e5800172e96e', '48026911-3a96-45d5-b610-15652b27c81b', '7b2b1973-0841-49cd-a0cb-b2d2b8f27e3a'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:42:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5fbfbc61-ab35-43b1-91cf-5e7eaa4d8e89 tempest-ProjectReaderTests-90568800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:42:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5fbfbc61-ab35-43b1-91cf-5e7eaa4d8e89 tempest-ProjectReaderTests-90568800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:42:10 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-5fbfbc61-ab35-43b1-91cf-5e7eaa4d8e89 tempest-ProjectReaderTests-90568800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:42:10 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-5fbfbc61-ab35-43b1-91cf-5e7eaa4d8e89 tempest-ProjectReaderTests-90568800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:42:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5fbfbc61-ab35-43b1-91cf-5e7eaa4d8e89 tempest-ProjectReaderTests-90568800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:42:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5fbfbc61-ab35-43b1-91cf-5e7eaa4d8e89 tempest-ProjectReaderTests-90568800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:10 devstack sudo[108319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:42:10 devstack sudo[108319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:10 devstack sudo[108313]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ece30bef-0355-42d9-9130-1f758feb3dd6 tempest-ProjectMemberTests-2050864699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a39e248e-b5a0-40e0-ad41-d84ab95cc466 -F qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a39e248e-b5a0-40e0-ad41-d84ab95cc466.06fe3933-5652-4572-b584-51a38532edbf" returned: 0 in 0.433s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:10 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-ece30bef-0355-42d9-9130-1f758feb3dd6 tempest-ProjectMemberTests-2050864699 None] /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a39e248e-b5a0-40e0-ad41-d84ab95cc466.06fe3933-5652-4572-b584-51a38532edbf is being set with open permissions: ugo+rw Nov 06 15:42:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ece30bef-0355-42d9-9130-1f758feb3dd6 tempest-ProjectMemberTests-2050864699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a39e248e-b5a0-40e0-ad41-d84ab95cc466.06fe3933-5652-4572-b584-51a38532edbf {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:10 devstack sudo[108321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a39e248e-b5a0-40e0-ad41-d84ab95cc466.06fe3933-5652-4572-b584-51a38532edbf Nov 06 15:42:10 devstack sudo[108321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:10 devstack sudo[108319]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5fbfbc61-ab35-43b1-91cf-5e7eaa4d8e89 tempest-ProjectReaderTests-90568800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.329s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:10 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-5fbfbc61-ab35-43b1-91cf-5e7eaa4d8e89 tempest-ProjectReaderTests-90568800 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:42:10 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-5fbfbc61-ab35-43b1-91cf-5e7eaa4d8e89 tempest-ProjectReaderTests-90568800 None] Deleted volume successfully. Nov 06 15:42:10 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-5fbfbc61-ab35-43b1-91cf-5e7eaa4d8e89 tempest-ProjectReaderTests-90568800 None] Lock "cinder-3e539b63-aa8c-40c2-bb53-935423e07d04-delete_volume" released by "delete_volume" :: held 1.487s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:42:10 devstack sudo[108321]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ece30bef-0355-42d9-9130-1f758feb3dd6 tempest-ProjectMemberTests-2050864699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a39e248e-b5a0-40e0-ad41-d84ab95cc466.06fe3933-5652-4572-b584-51a38532edbf" returned: 0 in 0.464s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ece30bef-0355-42d9-9130-1f758feb3dd6 tempest-ProjectMemberTests-2050864699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a39e248e-b5a0-40e0-ad41-d84ab95cc466.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:11 devstack sudo[108326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a39e248e-b5a0-40e0-ad41-d84ab95cc466.info Nov 06 15:42:11 devstack sudo[108326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:11 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-75b90d35-8701-43d3-9ec5-3e030e4c7c2c tempest-ProjectReaderTests-90568800 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:42:11 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-75b90d35-8701-43d3-9ec5-3e030e4c7c2c tempest-ProjectReaderTests-90568800 None] Flow 'volume_create_manager' (65fe55cc-2ad6-42d7-8d62-fd85bfadb28e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:42:11 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-75b90d35-8701-43d3-9ec5-3e030e4c7c2c tempest-ProjectReaderTests-90568800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ccc7d17-cfe3-428a-a8b7-fce5a81b3b06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:42:11 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-75b90d35-8701-43d3-9ec5-3e030e4c7c2c tempest-ProjectReaderTests-90568800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ccc7d17-cfe3-428a-a8b7-fce5a81b3b06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:42:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1097085186',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bc63350-0440-4334-9786-9292fb04d496,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa0e5fb1579d44329b27513f0572ba4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:42:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:42:11Z,use_quota=True,user_id='8f151b147eaa443a8d1a0ac4f9b0c7fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:42:11 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-75b90d35-8701-43d3-9ec5-3e030e4c7c2c tempest-ProjectReaderTests-90568800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cca39c6-9f98-4ca1-bc23-2fed5e2be509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:42:11 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-75b90d35-8701-43d3-9ec5-3e030e4c7c2c tempest-ProjectReaderTests-90568800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cca39c6-9f98-4ca1-bc23-2fed5e2be509) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:42:11 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-75b90d35-8701-43d3-9ec5-3e030e4c7c2c tempest-ProjectReaderTests-90568800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6afe235-7200-4c51-a854-51f2fcf8d78c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:42:11 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-75b90d35-8701-43d3-9ec5-3e030e4c7c2c tempest-ProjectReaderTests-90568800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6afe235-7200-4c51-a854-51f2fcf8d78c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9bc63350-0440-4334-9786-9292fb04d496', 'volume_name': 'volume-9bc63350-0440-4334-9786-9292fb04d496', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:42:11 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-75b90d35-8701-43d3-9ec5-3e030e4c7c2c tempest-ProjectReaderTests-90568800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8dd35a0-d1bf-4e75-8e7a-229e947d71d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:42:11 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-75b90d35-8701-43d3-9ec5-3e030e4c7c2c tempest-ProjectReaderTests-90568800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8dd35a0-d1bf-4e75-8e7a-229e947d71d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:42:11 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-75b90d35-8701-43d3-9ec5-3e030e4c7c2c tempest-ProjectReaderTests-90568800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c3b46e4-6820-4b77-860b-e8d81dda210b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:42:11 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-75b90d35-8701-43d3-9ec5-3e030e4c7c2c tempest-ProjectReaderTests-90568800 None] Volume 9bc63350-0440-4334-9786-9292fb04d496: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9bc63350-0440-4334-9786-9292fb04d496', 'volume_size': 1} Nov 06 15:42:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-75b90d35-8701-43d3-9ec5-3e030e4c7c2c tempest-ProjectReaderTests-90568800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:42:11 devstack sudo[108326]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ece30bef-0355-42d9-9130-1f758feb3dd6 tempest-ProjectMemberTests-2050864699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a39e248e-b5a0-40e0-ad41-d84ab95cc466.info" returned: 0 in 0.350s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:11 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-ece30bef-0355-42d9-9130-1f758feb3dd6 tempest-ProjectMemberTests-2050864699 None] /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a39e248e-b5a0-40e0-ad41-d84ab95cc466.info is being set with open permissions: ugo+rw Nov 06 15:42:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ece30bef-0355-42d9-9130-1f758feb3dd6 tempest-ProjectMemberTests-2050864699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a39e248e-b5a0-40e0-ad41-d84ab95cc466.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:11 devstack sudo[108329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a39e248e-b5a0-40e0-ad41-d84ab95cc466.info Nov 06 15:42:11 devstack sudo[108329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:11 devstack sudo[108329]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ece30bef-0355-42d9-9130-1f758feb3dd6 tempest-ProjectMemberTests-2050864699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a39e248e-b5a0-40e0-ad41-d84ab95cc466.info" returned: 0 in 0.265s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ece30bef-0355-42d9-9130-1f758feb3dd6 tempest-ProjectMemberTests-2050864699 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.597s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:42:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-889ab15a-abc8-4089-8e69-16412e0f267e tempest-ProjectReaderTests-140075233 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.992s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:42:11 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-889ab15a-abc8-4089-8e69-16412e0f267e tempest-ProjectReaderTests-140075233 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:42:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1474374527',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad3ab231-514c-4b31-a04a-252fa367c23c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac9d16e12dfb4ef9893478823bf36158',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:42:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:42:09Z,use_quota=True,user_id='c627485c382a4cc6aecab8442ba4f552',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:42:11 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-889ab15a-abc8-4089-8e69-16412e0f267e tempest-ProjectReaderTests-140075233 None] Creating volume ad3ab231-514c-4b31-a04a-252fa367c23c {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:42:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-889ab15a-abc8-4089-8e69-16412e0f267e tempest-ProjectReaderTests-140075233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:42:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-889ab15a-abc8-4089-8e69-16412e0f267e tempest-ProjectReaderTests-140075233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:42:11 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-889ab15a-abc8-4089-8e69-16412e0f267e tempest-ProjectReaderTests-140075233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:42:11 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-889ab15a-abc8-4089-8e69-16412e0f267e tempest-ProjectReaderTests-140075233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:42:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-889ab15a-abc8-4089-8e69-16412e0f267e tempest-ProjectReaderTests-140075233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:42:11 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-889ab15a-abc8-4089-8e69-16412e0f267e tempest-ProjectReaderTests-140075233 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:42:11 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-889ab15a-abc8-4089-8e69-16412e0f267e tempest-ProjectReaderTests-140075233 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:42:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-889ab15a-abc8-4089-8e69-16412e0f267e tempest-ProjectReaderTests-140075233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ad3ab231-514c-4b31-a04a-252fa367c23c 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:11 devstack sudo[108332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ad3ab231-514c-4b31-a04a-252fa367c23c 1073741824 Nov 06 15:42:11 devstack sudo[108332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:11 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-ece30bef-0355-42d9-9130-1f758feb3dd6 tempest-ProjectMemberTests-2050864699 None] Create snapshot completed successfully Nov 06 15:42:12 devstack sudo[108332]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-889ab15a-abc8-4089-8e69-16412e0f267e tempest-ProjectReaderTests-140075233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ad3ab231-514c-4b31-a04a-252fa367c23c 1073741824" returned: 0 in 0.470s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-889ab15a-abc8-4089-8e69-16412e0f267e tempest-ProjectReaderTests-140075233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ad3ab231-514c-4b31-a04a-252fa367c23c {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:12 devstack sudo[108338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ad3ab231-514c-4b31-a04a-252fa367c23c Nov 06 15:42:12 devstack sudo[108338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:12 devstack sudo[108338]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-889ab15a-abc8-4089-8e69-16412e0f267e tempest-ProjectReaderTests-140075233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ad3ab231-514c-4b31-a04a-252fa367c23c" returned: 0 in 0.258s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:12 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-889ab15a-abc8-4089-8e69-16412e0f267e tempest-ProjectReaderTests-140075233 None] <== create_volume: return (769ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:42:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-889ab15a-abc8-4089-8e69-16412e0f267e tempest-ProjectReaderTests-140075233 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.774s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:42:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-75b90d35-8701-43d3-9ec5-3e030e4c7c2c tempest-ProjectReaderTests-90568800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.133s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:42:12 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-75b90d35-8701-43d3-9ec5-3e030e4c7c2c tempest-ProjectReaderTests-90568800 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:42:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1097085186',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bc63350-0440-4334-9786-9292fb04d496,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa0e5fb1579d44329b27513f0572ba4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:42:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:42:11Z,use_quota=True,user_id='8f151b147eaa443a8d1a0ac4f9b0c7fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:42:12 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-75b90d35-8701-43d3-9ec5-3e030e4c7c2c tempest-ProjectReaderTests-90568800 None] Creating volume 9bc63350-0440-4334-9786-9292fb04d496 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:42:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-75b90d35-8701-43d3-9ec5-3e030e4c7c2c tempest-ProjectReaderTests-90568800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:42:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-75b90d35-8701-43d3-9ec5-3e030e4c7c2c tempest-ProjectReaderTests-90568800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:42:12 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-75b90d35-8701-43d3-9ec5-3e030e4c7c2c tempest-ProjectReaderTests-90568800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:42:12 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-75b90d35-8701-43d3-9ec5-3e030e4c7c2c tempest-ProjectReaderTests-90568800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:42:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-75b90d35-8701-43d3-9ec5-3e030e4c7c2c tempest-ProjectReaderTests-90568800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:42:12 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-75b90d35-8701-43d3-9ec5-3e030e4c7c2c tempest-ProjectReaderTests-90568800 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:42:12 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-75b90d35-8701-43d3-9ec5-3e030e4c7c2c tempest-ProjectReaderTests-90568800 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:42:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-75b90d35-8701-43d3-9ec5-3e030e4c7c2c tempest-ProjectReaderTests-90568800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-9bc63350-0440-4334-9786-9292fb04d496 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-889ab15a-abc8-4089-8e69-16412e0f267e tempest-ProjectReaderTests-140075233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de57afc5-284b-4b27-bf65-cc55e246a806) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad3ab231-514c-4b31-a04a-252fa367c23c', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:42:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-889ab15a-abc8-4089-8e69-16412e0f267e tempest-ProjectReaderTests-140075233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c7d47c7-e50f-4880-b06e-6d612dc77278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:42:12 devstack sudo[108341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-9bc63350-0440-4334-9786-9292fb04d496 1073741824 Nov 06 15:42:12 devstack sudo[108341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:12 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-422e96ea-9168-424f-877e-f40773623a29 tempest-ProjectMemberTests-2050864699 None] Acquiring lock "cinder-06fe3933-5652-4572-b584-51a38532edbf-delete_snapshot" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:42:12 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-889ab15a-abc8-4089-8e69-16412e0f267e tempest-ProjectReaderTests-140075233 None] Volume volume-ad3ab231-514c-4b31-a04a-252fa367c23c (ad3ab231-514c-4b31-a04a-252fa367c23c): created successfully Nov 06 15:42:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-889ab15a-abc8-4089-8e69-16412e0f267e tempest-ProjectReaderTests-140075233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c7d47c7-e50f-4880-b06e-6d612dc77278) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:42:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-889ab15a-abc8-4089-8e69-16412e0f267e tempest-ProjectReaderTests-140075233 None] Flow 'volume_create_manager' (d9157c04-6c17-472c-a2ef-37bb2f3e3ac4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:42:12 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-422e96ea-9168-424f-877e-f40773623a29 tempest-ProjectMemberTests-2050864699 None] Lock "cinder-06fe3933-5652-4572-b584-51a38532edbf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:42:12 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-422e96ea-9168-424f-877e-f40773623a29 tempest-ProjectMemberTests-2050864699 None] Acquiring lock "cinder-quobyte-a39e248e-b5a0-40e0-ad41-d84ab95cc466" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:42:12 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-889ab15a-abc8-4089-8e69-16412e0f267e tempest-ProjectReaderTests-140075233 None] Created volume successfully. Nov 06 15:42:12 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-422e96ea-9168-424f-877e-f40773623a29 tempest-ProjectMemberTests-2050864699 None] Lock "cinder-quobyte-a39e248e-b5a0-40e0-ad41-d84ab95cc466" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:42:12 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-422e96ea-9168-424f-877e-f40773623a29 tempest-ProjectMemberTests-2050864699 None] Acquiring lock "cinder-quobyte-06fe3933-5652-4572-b584-51a38532edbf" by "_delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:42:12 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-422e96ea-9168-424f-877e-f40773623a29 tempest-ProjectMemberTests-2050864699 None] Lock "cinder-quobyte-06fe3933-5652-4572-b584-51a38532edbf" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:42:12 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-422e96ea-9168-424f-877e-f40773623a29 tempest-ProjectMemberTests-2050864699 None] Deleting offline snapshot 06fe3933-5652-4572-b584-51a38532edbf of volume a39e248e-b5a0-40e0-ad41-d84ab95cc466 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 15:42:12 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-422e96ea-9168-424f-877e-f40773623a29 tempest-ProjectMemberTests-2050864699 None] snapshot_file for this snap is: volume-a39e248e-b5a0-40e0-ad41-d84ab95cc466.06fe3933-5652-4572-b584-51a38532edbf {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 15:42:12 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8bf1b7c-8ea1-4854-b761-5a930fe4c757]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:42:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-422e96ea-9168-424f-877e-f40773623a29 tempest-ProjectMemberTests-2050864699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a39e248e-b5a0-40e0-ad41-d84ab95cc466.06fe3933-5652-4572-b584-51a38532edbf {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:12 devstack sudo[108343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a39e248e-b5a0-40e0-ad41-d84ab95cc466.06fe3933-5652-4572-b584-51a38532edbf Nov 06 15:42:12 devstack sudo[108343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:13 devstack sudo[108341]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-75b90d35-8701-43d3-9ec5-3e030e4c7c2c tempest-ProjectReaderTests-90568800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-9bc63350-0440-4334-9786-9292fb04d496 1073741824" returned: 0 in 0.616s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:13 devstack sudo[108343]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-422e96ea-9168-424f-877e-f40773623a29 tempest-ProjectMemberTests-2050864699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a39e248e-b5a0-40e0-ad41-d84ab95cc466.06fe3933-5652-4572-b584-51a38532edbf" returned: 0 in 0.458s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:13 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-422e96ea-9168-424f-877e-f40773623a29 tempest-ProjectMemberTests-2050864699 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a39e248e-b5a0-40e0-ad41-d84ab95cc466(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 15:42:13 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-24e91bb2-0d45-41dc-853c-74ac628bacf9 tempest-ProjectReaderTests-140075233 None] Acquiring lock "cinder-ad3ab231-514c-4b31-a04a-252fa367c23c-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:42:13 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[27c93509-ccfe-407d-a424-1be265b02223]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:42:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-75b90d35-8701-43d3-9ec5-3e030e4c7c2c tempest-ProjectReaderTests-90568800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-9bc63350-0440-4334-9786-9292fb04d496 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-422e96ea-9168-424f-877e-f40773623a29 tempest-ProjectMemberTests-2050864699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a39e248e-b5a0-40e0-ad41-d84ab95cc466 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:13 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-24e91bb2-0d45-41dc-853c-74ac628bacf9 tempest-ProjectReaderTests-140075233 None] Lock "cinder-ad3ab231-514c-4b31-a04a-252fa367c23c-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:42:13 devstack sudo[108355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-9bc63350-0440-4334-9786-9292fb04d496 Nov 06 15:42:13 devstack sudo[108355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:13 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-24e91bb2-0d45-41dc-853c-74ac628bacf9 tempest-ProjectReaderTests-140075233 None] Acquiring lock "cinder-quobyte-ad3ab231-514c-4b31-a04a-252fa367c23c" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:42:13 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-24e91bb2-0d45-41dc-853c-74ac628bacf9 tempest-ProjectReaderTests-140075233 None] Lock "cinder-quobyte-ad3ab231-514c-4b31-a04a-252fa367c23c" acquired by "delete_volume" :: waited 0.036s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:42:13 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[153286c0-8a37-434f-b68d-46f98e84b05e]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:42:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-24e91bb2-0d45-41dc-853c-74ac628bacf9 tempest-ProjectReaderTests-140075233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ad3ab231-514c-4b31-a04a-252fa367c23c {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:13 devstack sudo[108356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a39e248e-b5a0-40e0-ad41-d84ab95cc466 Nov 06 15:42:13 devstack sudo[108356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:13 devstack sudo[108359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ad3ab231-514c-4b31-a04a-252fa367c23c Nov 06 15:42:13 devstack sudo[108359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:13 devstack sudo[108355]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-75b90d35-8701-43d3-9ec5-3e030e4c7c2c tempest-ProjectReaderTests-90568800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-9bc63350-0440-4334-9786-9292fb04d496" returned: 0 in 0.400s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:13 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-75b90d35-8701-43d3-9ec5-3e030e4c7c2c tempest-ProjectReaderTests-90568800 None] <== create_volume: return (1123ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:42:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-75b90d35-8701-43d3-9ec5-3e030e4c7c2c tempest-ProjectReaderTests-90568800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.127s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:42:13 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-75b90d35-8701-43d3-9ec5-3e030e4c7c2c tempest-ProjectReaderTests-90568800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c3b46e4-6820-4b77-860b-e8d81dda210b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9bc63350-0440-4334-9786-9292fb04d496', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:42:13 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-75b90d35-8701-43d3-9ec5-3e030e4c7c2c tempest-ProjectReaderTests-90568800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcbbbc1c-6571-443c-b49a-1ece443eb366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:42:13 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-75b90d35-8701-43d3-9ec5-3e030e4c7c2c tempest-ProjectReaderTests-90568800 None] Volume volume-9bc63350-0440-4334-9786-9292fb04d496 (9bc63350-0440-4334-9786-9292fb04d496): created successfully Nov 06 15:42:13 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-75b90d35-8701-43d3-9ec5-3e030e4c7c2c tempest-ProjectReaderTests-90568800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcbbbc1c-6571-443c-b49a-1ece443eb366) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:42:13 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-75b90d35-8701-43d3-9ec5-3e030e4c7c2c tempest-ProjectReaderTests-90568800 None] Flow 'volume_create_manager' (65fe55cc-2ad6-42d7-8d62-fd85bfadb28e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:42:13 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-75b90d35-8701-43d3-9ec5-3e030e4c7c2c tempest-ProjectReaderTests-90568800 None] Created volume successfully. Nov 06 15:42:13 devstack sudo[108356]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-422e96ea-9168-424f-877e-f40773623a29 tempest-ProjectMemberTests-2050864699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a39e248e-b5a0-40e0-ad41-d84ab95cc466" returned: 0 in 0.530s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-422e96ea-9168-424f-877e-f40773623a29 tempest-ProjectMemberTests-2050864699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a39e248e-b5a0-40e0-ad41-d84ab95cc466.06fe3933-5652-4572-b584-51a38532edbf {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:13 devstack sudo[108368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a39e248e-b5a0-40e0-ad41-d84ab95cc466.06fe3933-5652-4572-b584-51a38532edbf Nov 06 15:42:13 devstack sudo[108368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:13 devstack sudo[108359]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-24e91bb2-0d45-41dc-853c-74ac628bacf9 tempest-ProjectReaderTests-140075233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ad3ab231-514c-4b31-a04a-252fa367c23c" returned: 0 in 0.416s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-24e91bb2-0d45-41dc-853c-74ac628bacf9 tempest-ProjectReaderTests-140075233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ad3ab231-514c-4b31-a04a-252fa367c23c {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:13 devstack sudo[108370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ad3ab231-514c-4b31-a04a-252fa367c23c Nov 06 15:42:13 devstack sudo[108370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:13 devstack sudo[108370]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-24e91bb2-0d45-41dc-853c-74ac628bacf9 tempest-ProjectReaderTests-140075233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-ad3ab231-514c-4b31-a04a-252fa367c23c" returned: 0 in 0.251s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:14 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-24e91bb2-0d45-41dc-853c-74ac628bacf9 tempest-ProjectReaderTests-140075233 None] Lock "cinder-quobyte-ad3ab231-514c-4b31-a04a-252fa367c23c" released by "delete_volume" :: held 0.727s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:42:14 devstack sudo[108368]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-422e96ea-9168-424f-877e-f40773623a29 tempest-ProjectMemberTests-2050864699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a39e248e-b5a0-40e0-ad41-d84ab95cc466.06fe3933-5652-4572-b584-51a38532edbf" returned: 0 in 0.341s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-422e96ea-9168-424f-877e-f40773623a29 tempest-ProjectMemberTests-2050864699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a39e248e-b5a0-40e0-ad41-d84ab95cc466.06fe3933-5652-4572-b584-51a38532edbf {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:14 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-24e91bb2-0d45-41dc-853c-74ac628bacf9 tempest-ProjectReaderTests-140075233 None] Created reservations ['99b8b9b4-8c14-4ed4-a51f-40070b1bec44', '79134f6a-cb89-432e-93e9-df4d189bc389', 'ba062c3e-965f-497f-8fe6-37d7ee26e6eb', 'd3f83806-d9f8-4dfd-a7a0-4072cb71b351'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:42:14 devstack sudo[108376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a39e248e-b5a0-40e0-ad41-d84ab95cc466.06fe3933-5652-4572-b584-51a38532edbf Nov 06 15:42:14 devstack sudo[108376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-24e91bb2-0d45-41dc-853c-74ac628bacf9 tempest-ProjectReaderTests-140075233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:42:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-24e91bb2-0d45-41dc-853c-74ac628bacf9 tempest-ProjectReaderTests-140075233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:42:14 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-24e91bb2-0d45-41dc-853c-74ac628bacf9 tempest-ProjectReaderTests-140075233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:42:14 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-24e91bb2-0d45-41dc-853c-74ac628bacf9 tempest-ProjectReaderTests-140075233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:42:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-24e91bb2-0d45-41dc-853c-74ac628bacf9 tempest-ProjectReaderTests-140075233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:42:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-24e91bb2-0d45-41dc-853c-74ac628bacf9 tempest-ProjectReaderTests-140075233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:14 devstack sudo[108378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:42:14 devstack sudo[108378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:14 devstack sudo[108376]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-422e96ea-9168-424f-877e-f40773623a29 tempest-ProjectMemberTests-2050864699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a39e248e-b5a0-40e0-ad41-d84ab95cc466.06fe3933-5652-4572-b584-51a38532edbf" returned: 0 in 0.267s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:14 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-422e96ea-9168-424f-877e-f40773623a29 tempest-ProjectMemberTests-2050864699 None] Lock "cinder-quobyte-06fe3933-5652-4572-b584-51a38532edbf" released by "_delete_snapshot" :: held 1.780s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:42:14 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-422e96ea-9168-424f-877e-f40773623a29 tempest-ProjectMemberTests-2050864699 None] Lock "cinder-quobyte-a39e248e-b5a0-40e0-ad41-d84ab95cc466" released by "delete_snapshot" :: held 1.806s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:42:14 devstack sudo[108378]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-24e91bb2-0d45-41dc-853c-74ac628bacf9 tempest-ProjectReaderTests-140075233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.287s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:14 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-24e91bb2-0d45-41dc-853c-74ac628bacf9 tempest-ProjectReaderTests-140075233 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:42:14 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-24e91bb2-0d45-41dc-853c-74ac628bacf9 tempest-ProjectReaderTests-140075233 None] Deleted volume successfully. Nov 06 15:42:14 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-422e96ea-9168-424f-877e-f40773623a29 tempest-ProjectMemberTests-2050864699 None] Created reservations ['55474e7a-02d5-40b3-809c-e2059aad6f00', 'c92eb2ba-05ca-4a45-a4fb-8657f1d10d70', '42c058b4-1e30-49ce-85eb-a11e97b6cce7', '929eab7c-9b78-40e3-8f67-d5ff78fc133e'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:42:14 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-24e91bb2-0d45-41dc-853c-74ac628bacf9 tempest-ProjectReaderTests-140075233 None] Lock "cinder-ad3ab231-514c-4b31-a04a-252fa367c23c-delete_volume" released by "delete_volume" :: held 1.266s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:42:14 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-422e96ea-9168-424f-877e-f40773623a29 tempest-ProjectMemberTests-2050864699 None] Delete snapshot completed successfully. Nov 06 15:42:14 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-422e96ea-9168-424f-877e-f40773623a29 tempest-ProjectMemberTests-2050864699 None] Lock "cinder-06fe3933-5652-4572-b584-51a38532edbf-delete_snapshot" released by "delete_snapshot" :: held 2.006s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:42:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-162d1ead-c7dd-45d6-8698-9599f0700031 tempest-ProjectReaderTests-90568800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:42:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-162d1ead-c7dd-45d6-8698-9599f0700031 tempest-ProjectReaderTests-90568800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:42:14 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-162d1ead-c7dd-45d6-8698-9599f0700031 tempest-ProjectReaderTests-90568800 None] Creating offline snapshot 95651e44-3254-40e6-9545-9abf1501230f of volume 9bc63350-0440-4334-9786-9292fb04d496 {{(pid=87132) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 15:42:14 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7715947-b6b1-4874-81c4-5e2d0846f222]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:42:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-162d1ead-c7dd-45d6-8698-9599f0700031 tempest-ProjectReaderTests-90568800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-9bc63350-0440-4334-9786-9292fb04d496 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:14 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c8ec209c-50e5-4f9b-a0cc-808932aff18c tempest-ProjectMemberTests-2050864699 None] Acquiring lock "cinder-a39e248e-b5a0-40e0-ad41-d84ab95cc466-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:42:14 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c8ec209c-50e5-4f9b-a0cc-808932aff18c tempest-ProjectMemberTests-2050864699 None] Lock "cinder-a39e248e-b5a0-40e0-ad41-d84ab95cc466-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:42:14 devstack sudo[108382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-9bc63350-0440-4334-9786-9292fb04d496 Nov 06 15:42:14 devstack sudo[108382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:14 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d3bd171-8830-40b4-bf40-97cec6b048fa tempest-ProjectReaderTests-140075233 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:42:14 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9d3bd171-8830-40b4-bf40-97cec6b048fa tempest-ProjectReaderTests-140075233 None] Flow 'volume_create_manager' (f07a988d-c4a2-486b-8f0d-0bd45837c26a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:42:14 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9d3bd171-8830-40b4-bf40-97cec6b048fa tempest-ProjectReaderTests-140075233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ac42503-86af-41fd-8534-c320bf68d4a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:42:14 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c8ec209c-50e5-4f9b-a0cc-808932aff18c tempest-ProjectMemberTests-2050864699 None] Acquiring lock "cinder-quobyte-a39e248e-b5a0-40e0-ad41-d84ab95cc466" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:42:14 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9d3bd171-8830-40b4-bf40-97cec6b048fa tempest-ProjectReaderTests-140075233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ac42503-86af-41fd-8534-c320bf68d4a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:42:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1213773270',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c79b2b8-7f86-4066-b70e-01832653fc42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac9d16e12dfb4ef9893478823bf36158',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:42:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:42:15Z,use_quota=True,user_id='c627485c382a4cc6aecab8442ba4f552',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:42:14 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9d3bd171-8830-40b4-bf40-97cec6b048fa tempest-ProjectReaderTests-140075233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7287502-84fb-446f-b314-a79e532bc057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:42:14 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9d3bd171-8830-40b4-bf40-97cec6b048fa tempest-ProjectReaderTests-140075233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7287502-84fb-446f-b314-a79e532bc057) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:42:14 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9d3bd171-8830-40b4-bf40-97cec6b048fa tempest-ProjectReaderTests-140075233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d408e2d8-8935-4a1a-bf67-05192a8e24cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:42:14 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9d3bd171-8830-40b4-bf40-97cec6b048fa tempest-ProjectReaderTests-140075233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d408e2d8-8935-4a1a-bf67-05192a8e24cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c79b2b8-7f86-4066-b70e-01832653fc42', 'volume_name': 'volume-6c79b2b8-7f86-4066-b70e-01832653fc42', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:42:14 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9d3bd171-8830-40b4-bf40-97cec6b048fa tempest-ProjectReaderTests-140075233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f63715c-009b-4897-8d60-70dcc7bb54f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:42:14 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9d3bd171-8830-40b4-bf40-97cec6b048fa tempest-ProjectReaderTests-140075233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f63715c-009b-4897-8d60-70dcc7bb54f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:42:14 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9d3bd171-8830-40b4-bf40-97cec6b048fa tempest-ProjectReaderTests-140075233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9de1953-92cd-4b67-b236-fa91fe05ca71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:42:14 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-9d3bd171-8830-40b4-bf40-97cec6b048fa tempest-ProjectReaderTests-140075233 None] Volume 6c79b2b8-7f86-4066-b70e-01832653fc42: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c79b2b8-7f86-4066-b70e-01832653fc42', 'volume_size': 1} Nov 06 15:42:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9d3bd171-8830-40b4-bf40-97cec6b048fa tempest-ProjectReaderTests-140075233 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:42:14 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c8ec209c-50e5-4f9b-a0cc-808932aff18c tempest-ProjectMemberTests-2050864699 None] Lock "cinder-quobyte-a39e248e-b5a0-40e0-ad41-d84ab95cc466" acquired by "delete_volume" :: waited 0.063s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:42:15 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[49372ae3-6345-46a1-9280-1d2052428602]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:42:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c8ec209c-50e5-4f9b-a0cc-808932aff18c tempest-ProjectMemberTests-2050864699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a39e248e-b5a0-40e0-ad41-d84ab95cc466 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:15 devstack sudo[108382]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:15 devstack sudo[108384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a39e248e-b5a0-40e0-ad41-d84ab95cc466 Nov 06 15:42:15 devstack sudo[108384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-162d1ead-c7dd-45d6-8698-9599f0700031 tempest-ProjectReaderTests-90568800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-9bc63350-0440-4334-9786-9292fb04d496" returned: 0 in 0.438s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-162d1ead-c7dd-45d6-8698-9599f0700031 tempest-ProjectReaderTests-90568800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-9bc63350-0440-4334-9786-9292fb04d496,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-9bc63350-0440-4334-9786-9292fb04d496.95651e44-3254-40e6-9545-9abf1501230f 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:15 devstack sudo[108389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-9bc63350-0440-4334-9786-9292fb04d496,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-9bc63350-0440-4334-9786-9292fb04d496.95651e44-3254-40e6-9545-9abf1501230f 1G Nov 06 15:42:15 devstack sudo[108389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:15 devstack sudo[108384]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c8ec209c-50e5-4f9b-a0cc-808932aff18c tempest-ProjectMemberTests-2050864699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a39e248e-b5a0-40e0-ad41-d84ab95cc466" returned: 0 in 0.408s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c8ec209c-50e5-4f9b-a0cc-808932aff18c tempest-ProjectMemberTests-2050864699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a39e248e-b5a0-40e0-ad41-d84ab95cc466 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:15 devstack sudo[108398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a39e248e-b5a0-40e0-ad41-d84ab95cc466 Nov 06 15:42:15 devstack sudo[108398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:15 devstack sudo[108389]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-162d1ead-c7dd-45d6-8698-9599f0700031 tempest-ProjectReaderTests-90568800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-9bc63350-0440-4334-9786-9292fb04d496,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-9bc63350-0440-4334-9786-9292fb04d496.95651e44-3254-40e6-9545-9abf1501230f 1G" returned: 0 in 0.470s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-162d1ead-c7dd-45d6-8698-9599f0700031 tempest-ProjectReaderTests-90568800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9bc63350-0440-4334-9786-9292fb04d496 -F qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-9bc63350-0440-4334-9786-9292fb04d496.95651e44-3254-40e6-9545-9abf1501230f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:15 devstack sudo[108401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9bc63350-0440-4334-9786-9292fb04d496 -F qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-9bc63350-0440-4334-9786-9292fb04d496.95651e44-3254-40e6-9545-9abf1501230f Nov 06 15:42:15 devstack sudo[108401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:15 devstack sudo[108398]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c8ec209c-50e5-4f9b-a0cc-808932aff18c tempest-ProjectMemberTests-2050864699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a39e248e-b5a0-40e0-ad41-d84ab95cc466" returned: 0 in 0.321s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:15 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c8ec209c-50e5-4f9b-a0cc-808932aff18c tempest-ProjectMemberTests-2050864699 None] Lock "cinder-quobyte-a39e248e-b5a0-40e0-ad41-d84ab95cc466" released by "delete_volume" :: held 0.801s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:42:15 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-c8ec209c-50e5-4f9b-a0cc-808932aff18c tempest-ProjectMemberTests-2050864699 None] Created reservations ['c4edb3a4-c5f5-4b35-81ca-b7ddfe647d3c', '26951e67-ee39-439c-8710-4bad8ee63c26', 'b056743b-a4bb-419c-9b0f-368bd5b3ce03', 'abd5731d-24eb-4906-9379-79f442b7a19e'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:42:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c8ec209c-50e5-4f9b-a0cc-808932aff18c tempest-ProjectMemberTests-2050864699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:42:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c8ec209c-50e5-4f9b-a0cc-808932aff18c tempest-ProjectMemberTests-2050864699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:42:15 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c8ec209c-50e5-4f9b-a0cc-808932aff18c tempest-ProjectMemberTests-2050864699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:42:15 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c8ec209c-50e5-4f9b-a0cc-808932aff18c tempest-ProjectMemberTests-2050864699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:42:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c8ec209c-50e5-4f9b-a0cc-808932aff18c tempest-ProjectMemberTests-2050864699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:42:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c8ec209c-50e5-4f9b-a0cc-808932aff18c tempest-ProjectMemberTests-2050864699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:15 devstack sudo[108401]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-162d1ead-c7dd-45d6-8698-9599f0700031 tempest-ProjectReaderTests-90568800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9bc63350-0440-4334-9786-9292fb04d496 -F qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-9bc63350-0440-4334-9786-9292fb04d496.95651e44-3254-40e6-9545-9abf1501230f" returned: 0 in 0.357s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:15 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-162d1ead-c7dd-45d6-8698-9599f0700031 tempest-ProjectReaderTests-90568800 None] /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-9bc63350-0440-4334-9786-9292fb04d496.95651e44-3254-40e6-9545-9abf1501230f is being set with open permissions: ugo+rw Nov 06 15:42:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-162d1ead-c7dd-45d6-8698-9599f0700031 tempest-ProjectReaderTests-90568800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-9bc63350-0440-4334-9786-9292fb04d496.95651e44-3254-40e6-9545-9abf1501230f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:15 devstack sudo[108410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:42:15 devstack sudo[108410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:16 devstack sudo[108411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-9bc63350-0440-4334-9786-9292fb04d496.95651e44-3254-40e6-9545-9abf1501230f Nov 06 15:42:16 devstack sudo[108411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:16 devstack sudo[108410]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c8ec209c-50e5-4f9b-a0cc-808932aff18c tempest-ProjectMemberTests-2050864699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.247s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:16 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-c8ec209c-50e5-4f9b-a0cc-808932aff18c tempest-ProjectMemberTests-2050864699 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:42:16 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-c8ec209c-50e5-4f9b-a0cc-808932aff18c tempest-ProjectMemberTests-2050864699 None] Deleted volume successfully. Nov 06 15:42:16 devstack sudo[108411]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-162d1ead-c7dd-45d6-8698-9599f0700031 tempest-ProjectReaderTests-90568800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-9bc63350-0440-4334-9786-9292fb04d496.95651e44-3254-40e6-9545-9abf1501230f" returned: 0 in 0.248s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:16 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c8ec209c-50e5-4f9b-a0cc-808932aff18c tempest-ProjectMemberTests-2050864699 None] Lock "cinder-a39e248e-b5a0-40e0-ad41-d84ab95cc466-delete_volume" released by "delete_volume" :: held 1.446s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:42:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-162d1ead-c7dd-45d6-8698-9599f0700031 tempest-ProjectReaderTests-90568800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-9bc63350-0440-4334-9786-9292fb04d496.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:16 devstack sudo[108416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-9bc63350-0440-4334-9786-9292fb04d496.info Nov 06 15:42:16 devstack sudo[108416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:16 devstack sudo[108416]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-162d1ead-c7dd-45d6-8698-9599f0700031 tempest-ProjectReaderTests-90568800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-9bc63350-0440-4334-9786-9292fb04d496.info" returned: 0 in 0.244s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:16 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-162d1ead-c7dd-45d6-8698-9599f0700031 tempest-ProjectReaderTests-90568800 None] /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-9bc63350-0440-4334-9786-9292fb04d496.info is being set with open permissions: ugo+rw Nov 06 15:42:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-162d1ead-c7dd-45d6-8698-9599f0700031 tempest-ProjectReaderTests-90568800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-9bc63350-0440-4334-9786-9292fb04d496.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:16 devstack sudo[108419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-9bc63350-0440-4334-9786-9292fb04d496.info Nov 06 15:42:16 devstack sudo[108419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:16 devstack sudo[108419]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-162d1ead-c7dd-45d6-8698-9599f0700031 tempest-ProjectReaderTests-90568800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-9bc63350-0440-4334-9786-9292fb04d496.info" returned: 0 in 0.247s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-162d1ead-c7dd-45d6-8698-9599f0700031 tempest-ProjectReaderTests-90568800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.144s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:42:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9d3bd171-8830-40b4-bf40-97cec6b048fa tempest-ProjectReaderTests-140075233 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.829s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:42:16 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-9d3bd171-8830-40b4-bf40-97cec6b048fa tempest-ProjectReaderTests-140075233 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:42:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1213773270',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c79b2b8-7f86-4066-b70e-01832653fc42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac9d16e12dfb4ef9893478823bf36158',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:42:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:42:15Z,use_quota=True,user_id='c627485c382a4cc6aecab8442ba4f552',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:42:16 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-9d3bd171-8830-40b4-bf40-97cec6b048fa tempest-ProjectReaderTests-140075233 None] Creating volume 6c79b2b8-7f86-4066-b70e-01832653fc42 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:42:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9d3bd171-8830-40b4-bf40-97cec6b048fa tempest-ProjectReaderTests-140075233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:42:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9d3bd171-8830-40b4-bf40-97cec6b048fa tempest-ProjectReaderTests-140075233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:42:16 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-9d3bd171-8830-40b4-bf40-97cec6b048fa tempest-ProjectReaderTests-140075233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:42:16 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-9d3bd171-8830-40b4-bf40-97cec6b048fa tempest-ProjectReaderTests-140075233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:42:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9d3bd171-8830-40b4-bf40-97cec6b048fa tempest-ProjectReaderTests-140075233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:42:16 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-9d3bd171-8830-40b4-bf40-97cec6b048fa tempest-ProjectReaderTests-140075233 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:42:16 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-9d3bd171-8830-40b4-bf40-97cec6b048fa tempest-ProjectReaderTests-140075233 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:42:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9d3bd171-8830-40b4-bf40-97cec6b048fa tempest-ProjectReaderTests-140075233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-6c79b2b8-7f86-4066-b70e-01832653fc42 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:16 devstack sudo[108422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-6c79b2b8-7f86-4066-b70e-01832653fc42 1073741824 Nov 06 15:42:16 devstack sudo[108422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:16 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-162d1ead-c7dd-45d6-8698-9599f0700031 tempest-ProjectReaderTests-90568800 None] Create snapshot completed successfully Nov 06 15:42:17 devstack sudo[108422]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9d3bd171-8830-40b4-bf40-97cec6b048fa tempest-ProjectReaderTests-140075233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-6c79b2b8-7f86-4066-b70e-01832653fc42 1073741824" returned: 0 in 0.541s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9d3bd171-8830-40b4-bf40-97cec6b048fa tempest-ProjectReaderTests-140075233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-6c79b2b8-7f86-4066-b70e-01832653fc42 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:17 devstack sudo[108427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-6c79b2b8-7f86-4066-b70e-01832653fc42 Nov 06 15:42:17 devstack sudo[108427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:17 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f6bb7bc-a1d2-42f8-97c6-987682fe7713 tempest-ProjectMemberTests-2050864699 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:42:17 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9f6bb7bc-a1d2-42f8-97c6-987682fe7713 tempest-ProjectMemberTests-2050864699 None] Flow 'volume_create_manager' (ccc64399-03fa-4d8a-a9ad-4e55473e9f78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:42:17 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9f6bb7bc-a1d2-42f8-97c6-987682fe7713 tempest-ProjectMemberTests-2050864699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec39c67c-906d-4a23-af67-aa39b8a27698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:42:17 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9f6bb7bc-a1d2-42f8-97c6-987682fe7713 tempest-ProjectMemberTests-2050864699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec39c67c-906d-4a23-af67-aa39b8a27698) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:42:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1687225634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=956e52d7-5a9f-4bc1-8d2e-c206aa7b38e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='631b1acb2fe74ff38bf682df0fb94c26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:42:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:42:18Z,use_quota=True,user_id='c2ab5a7c9b61494492f0f3bd6193ebdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:42:17 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9f6bb7bc-a1d2-42f8-97c6-987682fe7713 tempest-ProjectMemberTests-2050864699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db190d1c-48a5-4c74-b8f6-8c19f5ebc0a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:42:17 devstack sudo[108427]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:17 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9f6bb7bc-a1d2-42f8-97c6-987682fe7713 tempest-ProjectMemberTests-2050864699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db190d1c-48a5-4c74-b8f6-8c19f5ebc0a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:42:17 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9f6bb7bc-a1d2-42f8-97c6-987682fe7713 tempest-ProjectMemberTests-2050864699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50324bb5-d2dc-4b81-80ac-41af01669d87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:42:17 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9f6bb7bc-a1d2-42f8-97c6-987682fe7713 tempest-ProjectMemberTests-2050864699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50324bb5-d2dc-4b81-80ac-41af01669d87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '956e52d7-5a9f-4bc1-8d2e-c206aa7b38e9', 'volume_name': 'volume-956e52d7-5a9f-4bc1-8d2e-c206aa7b38e9', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:42:17 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9f6bb7bc-a1d2-42f8-97c6-987682fe7713 tempest-ProjectMemberTests-2050864699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (421b0e21-5ca9-432d-8c1a-c30355bb3b60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:42:17 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9f6bb7bc-a1d2-42f8-97c6-987682fe7713 tempest-ProjectMemberTests-2050864699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (421b0e21-5ca9-432d-8c1a-c30355bb3b60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:42:17 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9f6bb7bc-a1d2-42f8-97c6-987682fe7713 tempest-ProjectMemberTests-2050864699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa613eed-42e2-4b53-a369-b7b60dce37f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:42:17 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-9f6bb7bc-a1d2-42f8-97c6-987682fe7713 tempest-ProjectMemberTests-2050864699 None] Volume 956e52d7-5a9f-4bc1-8d2e-c206aa7b38e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-956e52d7-5a9f-4bc1-8d2e-c206aa7b38e9', 'volume_size': 1} Nov 06 15:42:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9f6bb7bc-a1d2-42f8-97c6-987682fe7713 tempest-ProjectMemberTests-2050864699 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:42:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9d3bd171-8830-40b4-bf40-97cec6b048fa tempest-ProjectReaderTests-140075233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-6c79b2b8-7f86-4066-b70e-01832653fc42" returned: 0 in 0.351s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:17 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-9d3bd171-8830-40b4-bf40-97cec6b048fa tempest-ProjectReaderTests-140075233 None] <== create_volume: return (946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:42:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9d3bd171-8830-40b4-bf40-97cec6b048fa tempest-ProjectReaderTests-140075233 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.949s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:42:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9f6bb7bc-a1d2-42f8-97c6-987682fe7713 tempest-ProjectMemberTests-2050864699 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.010s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:42:17 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-9f6bb7bc-a1d2-42f8-97c6-987682fe7713 tempest-ProjectMemberTests-2050864699 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:42:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1687225634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=956e52d7-5a9f-4bc1-8d2e-c206aa7b38e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='631b1acb2fe74ff38bf682df0fb94c26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:42:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:42:18Z,use_quota=True,user_id='c2ab5a7c9b61494492f0f3bd6193ebdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:42:17 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-9f6bb7bc-a1d2-42f8-97c6-987682fe7713 tempest-ProjectMemberTests-2050864699 None] Creating volume 956e52d7-5a9f-4bc1-8d2e-c206aa7b38e9 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:42:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9f6bb7bc-a1d2-42f8-97c6-987682fe7713 tempest-ProjectMemberTests-2050864699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:42:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9f6bb7bc-a1d2-42f8-97c6-987682fe7713 tempest-ProjectMemberTests-2050864699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:42:17 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-9f6bb7bc-a1d2-42f8-97c6-987682fe7713 tempest-ProjectMemberTests-2050864699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:42:17 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-9f6bb7bc-a1d2-42f8-97c6-987682fe7713 tempest-ProjectMemberTests-2050864699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:42:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9f6bb7bc-a1d2-42f8-97c6-987682fe7713 tempest-ProjectMemberTests-2050864699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:42:17 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-9f6bb7bc-a1d2-42f8-97c6-987682fe7713 tempest-ProjectMemberTests-2050864699 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:42:17 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-9f6bb7bc-a1d2-42f8-97c6-987682fe7713 tempest-ProjectMemberTests-2050864699 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:42:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9f6bb7bc-a1d2-42f8-97c6-987682fe7713 tempest-ProjectMemberTests-2050864699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-956e52d7-5a9f-4bc1-8d2e-c206aa7b38e9 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:17 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9d3bd171-8830-40b4-bf40-97cec6b048fa tempest-ProjectReaderTests-140075233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9de1953-92cd-4b67-b236-fa91fe05ca71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c79b2b8-7f86-4066-b70e-01832653fc42', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:42:17 devstack sudo[108430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-956e52d7-5a9f-4bc1-8d2e-c206aa7b38e9 1073741824 Nov 06 15:42:17 devstack sudo[108430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:17 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9d3bd171-8830-40b4-bf40-97cec6b048fa tempest-ProjectReaderTests-140075233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83630e43-e0bd-4a85-b8f9-ea3c0ca8a59b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:42:17 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-9d3bd171-8830-40b4-bf40-97cec6b048fa tempest-ProjectReaderTests-140075233 None] Volume volume-6c79b2b8-7f86-4066-b70e-01832653fc42 (6c79b2b8-7f86-4066-b70e-01832653fc42): created successfully Nov 06 15:42:17 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9d3bd171-8830-40b4-bf40-97cec6b048fa tempest-ProjectReaderTests-140075233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83630e43-e0bd-4a85-b8f9-ea3c0ca8a59b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:42:17 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9d3bd171-8830-40b4-bf40-97cec6b048fa tempest-ProjectReaderTests-140075233 None] Flow 'volume_create_manager' (f07a988d-c4a2-486b-8f0d-0bd45837c26a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:42:17 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-9d3bd171-8830-40b4-bf40-97cec6b048fa tempest-ProjectReaderTests-140075233 None] Created volume successfully. Nov 06 15:42:17 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d66c6191-fa56-415a-9921-6c0da4cb11bf tempest-ProjectReaderTests-90568800 None] Acquiring lock "cinder-95651e44-3254-40e6-9545-9abf1501230f-delete_snapshot" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:42:17 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d66c6191-fa56-415a-9921-6c0da4cb11bf tempest-ProjectReaderTests-90568800 None] Lock "cinder-95651e44-3254-40e6-9545-9abf1501230f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:42:17 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d66c6191-fa56-415a-9921-6c0da4cb11bf tempest-ProjectReaderTests-90568800 None] Acquiring lock "cinder-quobyte-9bc63350-0440-4334-9786-9292fb04d496" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:42:17 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d66c6191-fa56-415a-9921-6c0da4cb11bf tempest-ProjectReaderTests-90568800 None] Lock "cinder-quobyte-9bc63350-0440-4334-9786-9292fb04d496" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:42:17 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d66c6191-fa56-415a-9921-6c0da4cb11bf tempest-ProjectReaderTests-90568800 None] Acquiring lock "cinder-quobyte-95651e44-3254-40e6-9545-9abf1501230f" by "_delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:42:17 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d66c6191-fa56-415a-9921-6c0da4cb11bf tempest-ProjectReaderTests-90568800 None] Lock "cinder-quobyte-95651e44-3254-40e6-9545-9abf1501230f" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:42:17 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-d66c6191-fa56-415a-9921-6c0da4cb11bf tempest-ProjectReaderTests-90568800 None] Deleting offline snapshot 95651e44-3254-40e6-9545-9abf1501230f of volume 9bc63350-0440-4334-9786-9292fb04d496 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 15:42:17 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-d66c6191-fa56-415a-9921-6c0da4cb11bf tempest-ProjectReaderTests-90568800 None] snapshot_file for this snap is: volume-9bc63350-0440-4334-9786-9292fb04d496.95651e44-3254-40e6-9545-9abf1501230f {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 15:42:17 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[3480d8d2-3676-41a4-a6c6-70cc13447417]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:42:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d66c6191-fa56-415a-9921-6c0da4cb11bf tempest-ProjectReaderTests-90568800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-9bc63350-0440-4334-9786-9292fb04d496.95651e44-3254-40e6-9545-9abf1501230f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:18 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-eef52c25-7006-4dff-ad27-17421ec3772f tempest-ProjectReaderTests-140075233 None] Acquiring lock "cinder-6c79b2b8-7f86-4066-b70e-01832653fc42-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:42:18 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-eef52c25-7006-4dff-ad27-17421ec3772f tempest-ProjectReaderTests-140075233 None] Lock "cinder-6c79b2b8-7f86-4066-b70e-01832653fc42-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:42:18 devstack sudo[108432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-9bc63350-0440-4334-9786-9292fb04d496.95651e44-3254-40e6-9545-9abf1501230f Nov 06 15:42:18 devstack sudo[108432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:18 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-eef52c25-7006-4dff-ad27-17421ec3772f tempest-ProjectReaderTests-140075233 None] Acquiring lock "cinder-quobyte-6c79b2b8-7f86-4066-b70e-01832653fc42" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:42:18 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-eef52c25-7006-4dff-ad27-17421ec3772f tempest-ProjectReaderTests-140075233 None] Lock "cinder-quobyte-6c79b2b8-7f86-4066-b70e-01832653fc42" acquired by "delete_volume" :: waited 0.019s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:42:18 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[d53b6656-93bc-4d2a-b0a2-1ccaedf7f60d]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:42:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-eef52c25-7006-4dff-ad27-17421ec3772f tempest-ProjectReaderTests-140075233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-6c79b2b8-7f86-4066-b70e-01832653fc42 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:18 devstack sudo[108437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-6c79b2b8-7f86-4066-b70e-01832653fc42 Nov 06 15:42:18 devstack sudo[108437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:18 devstack sudo[108430]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9f6bb7bc-a1d2-42f8-97c6-987682fe7713 tempest-ProjectMemberTests-2050864699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-956e52d7-5a9f-4bc1-8d2e-c206aa7b38e9 1073741824" returned: 0 in 0.585s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9f6bb7bc-a1d2-42f8-97c6-987682fe7713 tempest-ProjectMemberTests-2050864699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-956e52d7-5a9f-4bc1-8d2e-c206aa7b38e9 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:18 devstack sudo[108432]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d66c6191-fa56-415a-9921-6c0da4cb11bf tempest-ProjectReaderTests-90568800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-9bc63350-0440-4334-9786-9292fb04d496.95651e44-3254-40e6-9545-9abf1501230f" returned: 0 in 0.428s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:18 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-d66c6191-fa56-415a-9921-6c0da4cb11bf tempest-ProjectReaderTests-90568800 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9bc63350-0440-4334-9786-9292fb04d496(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 15:42:18 devstack sudo[108443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-956e52d7-5a9f-4bc1-8d2e-c206aa7b38e9 Nov 06 15:42:18 devstack sudo[108443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:18 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[3404e10a-35e8-4c7f-9a09-102beeeafea1]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:42:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d66c6191-fa56-415a-9921-6c0da4cb11bf tempest-ProjectReaderTests-90568800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-9bc63350-0440-4334-9786-9292fb04d496 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:18 devstack sudo[108445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-9bc63350-0440-4334-9786-9292fb04d496 Nov 06 15:42:18 devstack sudo[108445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:18 devstack sudo[108437]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-eef52c25-7006-4dff-ad27-17421ec3772f tempest-ProjectReaderTests-140075233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-6c79b2b8-7f86-4066-b70e-01832653fc42" returned: 0 in 0.400s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-eef52c25-7006-4dff-ad27-17421ec3772f tempest-ProjectReaderTests-140075233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-6c79b2b8-7f86-4066-b70e-01832653fc42 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:18 devstack sudo[108451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-6c79b2b8-7f86-4066-b70e-01832653fc42 Nov 06 15:42:18 devstack sudo[108451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:18 devstack sudo[108443]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9f6bb7bc-a1d2-42f8-97c6-987682fe7713 tempest-ProjectMemberTests-2050864699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-956e52d7-5a9f-4bc1-8d2e-c206aa7b38e9" returned: 0 in 0.262s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:18 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-9f6bb7bc-a1d2-42f8-97c6-987682fe7713 tempest-ProjectMemberTests-2050864699 None] <== create_volume: return (907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:42:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9f6bb7bc-a1d2-42f8-97c6-987682fe7713 tempest-ProjectMemberTests-2050864699 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.912s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:42:18 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9f6bb7bc-a1d2-42f8-97c6-987682fe7713 tempest-ProjectMemberTests-2050864699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa613eed-42e2-4b53-a369-b7b60dce37f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-956e52d7-5a9f-4bc1-8d2e-c206aa7b38e9', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:42:18 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9f6bb7bc-a1d2-42f8-97c6-987682fe7713 tempest-ProjectMemberTests-2050864699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8817e85d-15de-414b-8097-0c8f97451190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:42:18 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-9f6bb7bc-a1d2-42f8-97c6-987682fe7713 tempest-ProjectMemberTests-2050864699 None] Volume volume-956e52d7-5a9f-4bc1-8d2e-c206aa7b38e9 (956e52d7-5a9f-4bc1-8d2e-c206aa7b38e9): created successfully Nov 06 15:42:18 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9f6bb7bc-a1d2-42f8-97c6-987682fe7713 tempest-ProjectMemberTests-2050864699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8817e85d-15de-414b-8097-0c8f97451190) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:42:18 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9f6bb7bc-a1d2-42f8-97c6-987682fe7713 tempest-ProjectMemberTests-2050864699 None] Flow 'volume_create_manager' (ccc64399-03fa-4d8a-a9ad-4e55473e9f78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:42:18 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-9f6bb7bc-a1d2-42f8-97c6-987682fe7713 tempest-ProjectMemberTests-2050864699 None] Created volume successfully. Nov 06 15:42:18 devstack sudo[108445]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:18 devstack sudo[108451]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-eef52c25-7006-4dff-ad27-17421ec3772f tempest-ProjectReaderTests-140075233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-6c79b2b8-7f86-4066-b70e-01832653fc42" returned: 0 in 0.288s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d66c6191-fa56-415a-9921-6c0da4cb11bf tempest-ProjectReaderTests-90568800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-9bc63350-0440-4334-9786-9292fb04d496" returned: 0 in 0.432s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d66c6191-fa56-415a-9921-6c0da4cb11bf tempest-ProjectReaderTests-90568800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-9bc63350-0440-4334-9786-9292fb04d496.95651e44-3254-40e6-9545-9abf1501230f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:18 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-eef52c25-7006-4dff-ad27-17421ec3772f tempest-ProjectReaderTests-140075233 None] Lock "cinder-quobyte-6c79b2b8-7f86-4066-b70e-01832653fc42" released by "delete_volume" :: held 0.745s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:42:18 devstack sudo[108458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-9bc63350-0440-4334-9786-9292fb04d496.95651e44-3254-40e6-9545-9abf1501230f Nov 06 15:42:18 devstack sudo[108458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:18 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-eef52c25-7006-4dff-ad27-17421ec3772f tempest-ProjectReaderTests-140075233 None] Created reservations ['b2066aeb-b3dc-412b-8b33-8a6be31fafde', 'eb45ded7-c831-4dad-83c4-4aa5d9df9be3', 'a8f33dea-0607-4630-90a2-2c0ce13d6730', '3f0b9fa8-4319-41df-acdd-a033cfe640c7'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:42:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-eef52c25-7006-4dff-ad27-17421ec3772f tempest-ProjectReaderTests-140075233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:42:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-eef52c25-7006-4dff-ad27-17421ec3772f tempest-ProjectReaderTests-140075233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:42:19 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-eef52c25-7006-4dff-ad27-17421ec3772f tempest-ProjectReaderTests-140075233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:42:19 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-eef52c25-7006-4dff-ad27-17421ec3772f tempest-ProjectReaderTests-140075233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:42:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-eef52c25-7006-4dff-ad27-17421ec3772f tempest-ProjectReaderTests-140075233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:42:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-eef52c25-7006-4dff-ad27-17421ec3772f tempest-ProjectReaderTests-140075233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:19 devstack sudo[108460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:42:19 devstack sudo[108460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:19 devstack sudo[108458]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d66c6191-fa56-415a-9921-6c0da4cb11bf tempest-ProjectReaderTests-90568800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-9bc63350-0440-4334-9786-9292fb04d496.95651e44-3254-40e6-9545-9abf1501230f" returned: 0 in 0.437s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d66c6191-fa56-415a-9921-6c0da4cb11bf tempest-ProjectReaderTests-90568800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-9bc63350-0440-4334-9786-9292fb04d496.95651e44-3254-40e6-9545-9abf1501230f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:19 devstack sudo[108467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-9bc63350-0440-4334-9786-9292fb04d496.95651e44-3254-40e6-9545-9abf1501230f Nov 06 15:42:19 devstack sudo[108467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:19 devstack sudo[108460]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-eef52c25-7006-4dff-ad27-17421ec3772f tempest-ProjectReaderTests-140075233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.310s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:19 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-eef52c25-7006-4dff-ad27-17421ec3772f tempest-ProjectReaderTests-140075233 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:42:19 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-eef52c25-7006-4dff-ad27-17421ec3772f tempest-ProjectReaderTests-140075233 None] Deleted volume successfully. Nov 06 15:42:19 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-eef52c25-7006-4dff-ad27-17421ec3772f tempest-ProjectReaderTests-140075233 None] Lock "cinder-6c79b2b8-7f86-4066-b70e-01832653fc42-delete_volume" released by "delete_volume" :: held 1.316s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:42:19 devstack sudo[108467]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d66c6191-fa56-415a-9921-6c0da4cb11bf tempest-ProjectReaderTests-90568800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-9bc63350-0440-4334-9786-9292fb04d496.95651e44-3254-40e6-9545-9abf1501230f" returned: 0 in 0.329s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:19 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d66c6191-fa56-415a-9921-6c0da4cb11bf tempest-ProjectReaderTests-90568800 None] Lock "cinder-quobyte-95651e44-3254-40e6-9545-9abf1501230f" released by "_delete_snapshot" :: held 1.743s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:42:19 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d66c6191-fa56-415a-9921-6c0da4cb11bf tempest-ProjectReaderTests-90568800 None] Lock "cinder-quobyte-9bc63350-0440-4334-9786-9292fb04d496" released by "delete_snapshot" :: held 1.775s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:42:19 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-d66c6191-fa56-415a-9921-6c0da4cb11bf tempest-ProjectReaderTests-90568800 None] Created reservations ['1f4f060b-0153-4ef7-8ddb-a53a5421a634', '54697a51-700c-446d-ae87-2a42be12e8a6', 'c41f5737-d8f5-449b-982c-f7d17951b354', '5c53edbf-9a43-41d7-afc0-574d27c8f0a1'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:42:19 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc5e960a-a0ff-4739-b258-a2801a5d2291 tempest-ProjectReaderTests-140075233 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:42:19 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-cc5e960a-a0ff-4739-b258-a2801a5d2291 tempest-ProjectReaderTests-140075233 None] Flow 'volume_create_manager' (a1e4b2e7-1837-4f29-98a3-1be9aaece970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:42:19 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-cc5e960a-a0ff-4739-b258-a2801a5d2291 tempest-ProjectReaderTests-140075233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8d60d10-4b65-4512-afc3-bf3ace6d7e0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:42:19 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-cc5e960a-a0ff-4739-b258-a2801a5d2291 tempest-ProjectReaderTests-140075233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8d60d10-4b65-4512-afc3-bf3ace6d7e0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:42:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2081133736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d35ac62-629a-4ec0-be87-ce077fc3d564,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac9d16e12dfb4ef9893478823bf36158',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:42:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:42:20Z,use_quota=True,user_id='c627485c382a4cc6aecab8442ba4f552',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:42:19 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-cc5e960a-a0ff-4739-b258-a2801a5d2291 tempest-ProjectReaderTests-140075233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b46a9ce-8524-46dd-9627-5e7ab48a0155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:42:19 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-cc5e960a-a0ff-4739-b258-a2801a5d2291 tempest-ProjectReaderTests-140075233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b46a9ce-8524-46dd-9627-5e7ab48a0155) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:42:19 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-cc5e960a-a0ff-4739-b258-a2801a5d2291 tempest-ProjectReaderTests-140075233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8921af9-cde5-449c-b8b7-b47d65304a56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:42:19 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-cc5e960a-a0ff-4739-b258-a2801a5d2291 tempest-ProjectReaderTests-140075233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8921af9-cde5-449c-b8b7-b47d65304a56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d35ac62-629a-4ec0-be87-ce077fc3d564', 'volume_name': 'volume-1d35ac62-629a-4ec0-be87-ce077fc3d564', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:42:19 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-cc5e960a-a0ff-4739-b258-a2801a5d2291 tempest-ProjectReaderTests-140075233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0c0329c-0e52-4a31-92cb-95cac21b02e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:42:19 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-cc5e960a-a0ff-4739-b258-a2801a5d2291 tempest-ProjectReaderTests-140075233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0c0329c-0e52-4a31-92cb-95cac21b02e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:42:19 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-cc5e960a-a0ff-4739-b258-a2801a5d2291 tempest-ProjectReaderTests-140075233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ecda87b-afaa-4b40-9bd4-4401a361408b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:42:19 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-cc5e960a-a0ff-4739-b258-a2801a5d2291 tempest-ProjectReaderTests-140075233 None] Volume 1d35ac62-629a-4ec0-be87-ce077fc3d564: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d35ac62-629a-4ec0-be87-ce077fc3d564', 'volume_size': 1} Nov 06 15:42:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-cc5e960a-a0ff-4739-b258-a2801a5d2291 tempest-ProjectReaderTests-140075233 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:42:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-cc5e960a-a0ff-4739-b258-a2801a5d2291 tempest-ProjectReaderTests-140075233 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:42:19 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-cc5e960a-a0ff-4739-b258-a2801a5d2291 tempest-ProjectReaderTests-140075233 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:42:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2081133736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d35ac62-629a-4ec0-be87-ce077fc3d564,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac9d16e12dfb4ef9893478823bf36158',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:42:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:42:20Z,use_quota=True,user_id='c627485c382a4cc6aecab8442ba4f552',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:42:19 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-cc5e960a-a0ff-4739-b258-a2801a5d2291 tempest-ProjectReaderTests-140075233 None] Creating volume 1d35ac62-629a-4ec0-be87-ce077fc3d564 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:42:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-cc5e960a-a0ff-4739-b258-a2801a5d2291 tempest-ProjectReaderTests-140075233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:42:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-cc5e960a-a0ff-4739-b258-a2801a5d2291 tempest-ProjectReaderTests-140075233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:42:19 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-cc5e960a-a0ff-4739-b258-a2801a5d2291 tempest-ProjectReaderTests-140075233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:42:19 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-cc5e960a-a0ff-4739-b258-a2801a5d2291 tempest-ProjectReaderTests-140075233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:42:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-cc5e960a-a0ff-4739-b258-a2801a5d2291 tempest-ProjectReaderTests-140075233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:42:19 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-cc5e960a-a0ff-4739-b258-a2801a5d2291 tempest-ProjectReaderTests-140075233 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:42:19 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-cc5e960a-a0ff-4739-b258-a2801a5d2291 tempest-ProjectReaderTests-140075233 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:42:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-cc5e960a-a0ff-4739-b258-a2801a5d2291 tempest-ProjectReaderTests-140075233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-1d35ac62-629a-4ec0-be87-ce077fc3d564 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:19 devstack sudo[108470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-1d35ac62-629a-4ec0-be87-ce077fc3d564 1073741824 Nov 06 15:42:19 devstack sudo[108470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-777613ea-26bb-499d-9bc3-924104993f0c tempest-ProjectMemberTests-2050864699 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:42:19 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-d66c6191-fa56-415a-9921-6c0da4cb11bf tempest-ProjectReaderTests-90568800 None] Delete snapshot completed successfully. Nov 06 15:42:19 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d66c6191-fa56-415a-9921-6c0da4cb11bf tempest-ProjectReaderTests-90568800 None] Lock "cinder-95651e44-3254-40e6-9545-9abf1501230f-delete_snapshot" released by "delete_snapshot" :: held 2.089s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:42:20 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-08094925-09ca-40c0-a1c4-e0a36e5718e3 tempest-ProjectReaderTests-90568800 None] Acquiring lock "cinder-9bc63350-0440-4334-9786-9292fb04d496-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:42:20 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-08094925-09ca-40c0-a1c4-e0a36e5718e3 tempest-ProjectReaderTests-90568800 None] Lock "cinder-9bc63350-0440-4334-9786-9292fb04d496-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:42:20 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-08094925-09ca-40c0-a1c4-e0a36e5718e3 tempest-ProjectReaderTests-90568800 None] Acquiring lock "cinder-quobyte-9bc63350-0440-4334-9786-9292fb04d496" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:42:20 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-08094925-09ca-40c0-a1c4-e0a36e5718e3 tempest-ProjectReaderTests-90568800 None] Lock "cinder-quobyte-9bc63350-0440-4334-9786-9292fb04d496" acquired by "delete_volume" :: waited 0.022s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:42:20 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[7768a630-880f-47f6-b7f9-6050f0c59c14]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:42:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-08094925-09ca-40c0-a1c4-e0a36e5718e3 tempest-ProjectReaderTests-90568800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-9bc63350-0440-4334-9786-9292fb04d496 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:20 devstack sudo[108475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-9bc63350-0440-4334-9786-9292fb04d496 Nov 06 15:42:20 devstack sudo[108475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:20 devstack sudo[108470]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-cc5e960a-a0ff-4739-b258-a2801a5d2291 tempest-ProjectReaderTests-140075233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-1d35ac62-629a-4ec0-be87-ce077fc3d564 1073741824" returned: 0 in 0.556s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-cc5e960a-a0ff-4739-b258-a2801a5d2291 tempest-ProjectReaderTests-140075233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-1d35ac62-629a-4ec0-be87-ce077fc3d564 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:20 devstack sudo[108478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-1d35ac62-629a-4ec0-be87-ce077fc3d564 Nov 06 15:42:20 devstack sudo[108478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:20 devstack sudo[108475]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-08094925-09ca-40c0-a1c4-e0a36e5718e3 tempest-ProjectReaderTests-90568800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-9bc63350-0440-4334-9786-9292fb04d496" returned: 0 in 0.496s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-08094925-09ca-40c0-a1c4-e0a36e5718e3 tempest-ProjectReaderTests-90568800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-9bc63350-0440-4334-9786-9292fb04d496 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:20 devstack sudo[108484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-9bc63350-0440-4334-9786-9292fb04d496 Nov 06 15:42:20 devstack sudo[108484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:20 devstack sudo[108478]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-cc5e960a-a0ff-4739-b258-a2801a5d2291 tempest-ProjectReaderTests-140075233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-1d35ac62-629a-4ec0-be87-ce077fc3d564" returned: 0 in 0.311s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:20 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-cc5e960a-a0ff-4739-b258-a2801a5d2291 tempest-ProjectReaderTests-140075233 None] <== create_volume: return (914ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:42:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-cc5e960a-a0ff-4739-b258-a2801a5d2291 tempest-ProjectReaderTests-140075233 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.917s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:42:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-777613ea-26bb-499d-9bc3-924104993f0c tempest-ProjectMemberTests-2050864699 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.843s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:42:20 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-777613ea-26bb-499d-9bc3-924104993f0c tempest-ProjectMemberTests-2050864699 None] Creating offline snapshot 9a46e622-56be-44fa-883c-6925ef620598 of volume 956e52d7-5a9f-4bc1-8d2e-c206aa7b38e9 {{(pid=87132) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 15:42:20 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-cc5e960a-a0ff-4739-b258-a2801a5d2291 tempest-ProjectReaderTests-140075233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ecda87b-afaa-4b40-9bd4-4401a361408b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d35ac62-629a-4ec0-be87-ce077fc3d564', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:42:20 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-cc5e960a-a0ff-4739-b258-a2801a5d2291 tempest-ProjectReaderTests-140075233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81263cb3-cb3b-4658-bcad-e8a864a70e67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:42:20 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d5b4a18-66a1-451a-a5fa-73b192766f61]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:42:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-777613ea-26bb-499d-9bc3-924104993f0c tempest-ProjectMemberTests-2050864699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-956e52d7-5a9f-4bc1-8d2e-c206aa7b38e9 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:20 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-cc5e960a-a0ff-4739-b258-a2801a5d2291 tempest-ProjectReaderTests-140075233 None] Volume volume-1d35ac62-629a-4ec0-be87-ce077fc3d564 (1d35ac62-629a-4ec0-be87-ce077fc3d564): created successfully Nov 06 15:42:20 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-cc5e960a-a0ff-4739-b258-a2801a5d2291 tempest-ProjectReaderTests-140075233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81263cb3-cb3b-4658-bcad-e8a864a70e67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:42:20 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-cc5e960a-a0ff-4739-b258-a2801a5d2291 tempest-ProjectReaderTests-140075233 None] Flow 'volume_create_manager' (a1e4b2e7-1837-4f29-98a3-1be9aaece970) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:42:20 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-cc5e960a-a0ff-4739-b258-a2801a5d2291 tempest-ProjectReaderTests-140075233 None] Created volume successfully. Nov 06 15:42:21 devstack sudo[108487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-956e52d7-5a9f-4bc1-8d2e-c206aa7b38e9 Nov 06 15:42:21 devstack sudo[108487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:21 devstack sudo[108484]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-08094925-09ca-40c0-a1c4-e0a36e5718e3 tempest-ProjectReaderTests-90568800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-9bc63350-0440-4334-9786-9292fb04d496" returned: 0 in 0.301s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:21 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-08094925-09ca-40c0-a1c4-e0a36e5718e3 tempest-ProjectReaderTests-90568800 None] Lock "cinder-quobyte-9bc63350-0440-4334-9786-9292fb04d496" released by "delete_volume" :: held 0.867s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:42:21 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-08094925-09ca-40c0-a1c4-e0a36e5718e3 tempest-ProjectReaderTests-90568800 None] Created reservations ['8b5125e6-726e-4fd4-86fc-ba273c395071', '17647419-1c94-4c68-a5f5-1867dc96392f', 'ac5b454c-8095-4b12-9f20-e8ed90cf757f', '448f437f-a517-48b9-8799-b877f19eedac'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:42:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-08094925-09ca-40c0-a1c4-e0a36e5718e3 tempest-ProjectReaderTests-90568800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:42:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-08094925-09ca-40c0-a1c4-e0a36e5718e3 tempest-ProjectReaderTests-90568800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:42:21 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-08094925-09ca-40c0-a1c4-e0a36e5718e3 tempest-ProjectReaderTests-90568800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:42:21 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-08094925-09ca-40c0-a1c4-e0a36e5718e3 tempest-ProjectReaderTests-90568800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:42:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-08094925-09ca-40c0-a1c4-e0a36e5718e3 tempest-ProjectReaderTests-90568800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:42:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-08094925-09ca-40c0-a1c4-e0a36e5718e3 tempest-ProjectReaderTests-90568800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:21 devstack sudo[108490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:42:21 devstack sudo[108490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:21 devstack sudo[108487]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-777613ea-26bb-499d-9bc3-924104993f0c tempest-ProjectMemberTests-2050864699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-956e52d7-5a9f-4bc1-8d2e-c206aa7b38e9" returned: 0 in 0.494s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-777613ea-26bb-499d-9bc3-924104993f0c tempest-ProjectMemberTests-2050864699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-956e52d7-5a9f-4bc1-8d2e-c206aa7b38e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-956e52d7-5a9f-4bc1-8d2e-c206aa7b38e9.9a46e622-56be-44fa-883c-6925ef620598 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:21 devstack sudo[108496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-956e52d7-5a9f-4bc1-8d2e-c206aa7b38e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-956e52d7-5a9f-4bc1-8d2e-c206aa7b38e9.9a46e622-56be-44fa-883c-6925ef620598 1G Nov 06 15:42:21 devstack sudo[108496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:21 devstack sudo[108490]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-08094925-09ca-40c0-a1c4-e0a36e5718e3 tempest-ProjectReaderTests-90568800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.307s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:21 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-08094925-09ca-40c0-a1c4-e0a36e5718e3 tempest-ProjectReaderTests-90568800 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:42:21 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-08094925-09ca-40c0-a1c4-e0a36e5718e3 tempest-ProjectReaderTests-90568800 None] Deleted volume successfully. Nov 06 15:42:21 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-08094925-09ca-40c0-a1c4-e0a36e5718e3 tempest-ProjectReaderTests-90568800 None] Lock "cinder-9bc63350-0440-4334-9786-9292fb04d496-delete_volume" released by "delete_volume" :: held 1.435s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:42:21 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6faba50-982a-46da-80f4-e0630734e953 tempest-ProjectReaderTests-90568800 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:42:21 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f6faba50-982a-46da-80f4-e0630734e953 tempest-ProjectReaderTests-90568800 None] Flow 'volume_create_manager' (3b428c45-1d11-4983-838d-ec4e9ebfeebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:42:21 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f6faba50-982a-46da-80f4-e0630734e953 tempest-ProjectReaderTests-90568800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d0619a6-9ee5-445d-8331-f007013750d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:42:21 devstack sudo[108496]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:21 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f6faba50-982a-46da-80f4-e0630734e953 tempest-ProjectReaderTests-90568800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d0619a6-9ee5-445d-8331-f007013750d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:42:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-586563959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4e686f1-8ae2-4ee0-bf32-f0acb8136abf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa0e5fb1579d44329b27513f0572ba4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:42:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:42:22Z,use_quota=True,user_id='8f151b147eaa443a8d1a0ac4f9b0c7fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:42:21 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f6faba50-982a-46da-80f4-e0630734e953 tempest-ProjectReaderTests-90568800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (302b0436-70be-48e9-9e58-88445628a48f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:42:21 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f6faba50-982a-46da-80f4-e0630734e953 tempest-ProjectReaderTests-90568800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (302b0436-70be-48e9-9e58-88445628a48f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:42:21 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f6faba50-982a-46da-80f4-e0630734e953 tempest-ProjectReaderTests-90568800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66f5d3b1-191c-4199-9e2c-2ef9e59897c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:42:21 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f6faba50-982a-46da-80f4-e0630734e953 tempest-ProjectReaderTests-90568800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66f5d3b1-191c-4199-9e2c-2ef9e59897c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4e686f1-8ae2-4ee0-bf32-f0acb8136abf', 'volume_name': 'volume-b4e686f1-8ae2-4ee0-bf32-f0acb8136abf', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:42:21 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f6faba50-982a-46da-80f4-e0630734e953 tempest-ProjectReaderTests-90568800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d4411cf-c992-439c-acde-1fe1475e3ecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:42:21 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f6faba50-982a-46da-80f4-e0630734e953 tempest-ProjectReaderTests-90568800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d4411cf-c992-439c-acde-1fe1475e3ecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:42:21 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f6faba50-982a-46da-80f4-e0630734e953 tempest-ProjectReaderTests-90568800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af82f625-3503-40cb-a3ce-f5c19fb5ca93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:42:21 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-f6faba50-982a-46da-80f4-e0630734e953 tempest-ProjectReaderTests-90568800 None] Volume b4e686f1-8ae2-4ee0-bf32-f0acb8136abf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4e686f1-8ae2-4ee0-bf32-f0acb8136abf', 'volume_size': 1} Nov 06 15:42:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f6faba50-982a-46da-80f4-e0630734e953 tempest-ProjectReaderTests-90568800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:42:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-777613ea-26bb-499d-9bc3-924104993f0c tempest-ProjectMemberTests-2050864699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-956e52d7-5a9f-4bc1-8d2e-c206aa7b38e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-956e52d7-5a9f-4bc1-8d2e-c206aa7b38e9.9a46e622-56be-44fa-883c-6925ef620598 1G" returned: 0 in 0.552s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-777613ea-26bb-499d-9bc3-924104993f0c tempest-ProjectMemberTests-2050864699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-956e52d7-5a9f-4bc1-8d2e-c206aa7b38e9 -F qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-956e52d7-5a9f-4bc1-8d2e-c206aa7b38e9.9a46e622-56be-44fa-883c-6925ef620598 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:21 devstack sudo[108503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-956e52d7-5a9f-4bc1-8d2e-c206aa7b38e9 -F qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-956e52d7-5a9f-4bc1-8d2e-c206aa7b38e9.9a46e622-56be-44fa-883c-6925ef620598 Nov 06 15:42:21 devstack sudo[108503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:21 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-bb7ec706-23bf-43e9-aab6-7ee9f638fc5b tempest-ProjectReaderTests-140075233 None] Acquiring lock "cinder-1d35ac62-629a-4ec0-be87-ce077fc3d564-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:42:21 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-bb7ec706-23bf-43e9-aab6-7ee9f638fc5b tempest-ProjectReaderTests-140075233 None] Lock "cinder-1d35ac62-629a-4ec0-be87-ce077fc3d564-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:42:22 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-bb7ec706-23bf-43e9-aab6-7ee9f638fc5b tempest-ProjectReaderTests-140075233 None] Acquiring lock "cinder-quobyte-1d35ac62-629a-4ec0-be87-ce077fc3d564" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:42:22 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-bb7ec706-23bf-43e9-aab6-7ee9f638fc5b tempest-ProjectReaderTests-140075233 None] Lock "cinder-quobyte-1d35ac62-629a-4ec0-be87-ce077fc3d564" acquired by "delete_volume" :: waited 0.024s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:42:22 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b444eaa-5282-46c2-8f3d-148656353d7d]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:42:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bb7ec706-23bf-43e9-aab6-7ee9f638fc5b tempest-ProjectReaderTests-140075233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-1d35ac62-629a-4ec0-be87-ce077fc3d564 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:22 devstack sudo[108505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-1d35ac62-629a-4ec0-be87-ce077fc3d564 Nov 06 15:42:22 devstack sudo[108505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:22 devstack sudo[108503]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-777613ea-26bb-499d-9bc3-924104993f0c tempest-ProjectMemberTests-2050864699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-956e52d7-5a9f-4bc1-8d2e-c206aa7b38e9 -F qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-956e52d7-5a9f-4bc1-8d2e-c206aa7b38e9.9a46e622-56be-44fa-883c-6925ef620598" returned: 0 in 0.339s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:22 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-777613ea-26bb-499d-9bc3-924104993f0c tempest-ProjectMemberTests-2050864699 None] /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-956e52d7-5a9f-4bc1-8d2e-c206aa7b38e9.9a46e622-56be-44fa-883c-6925ef620598 is being set with open permissions: ugo+rw Nov 06 15:42:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-777613ea-26bb-499d-9bc3-924104993f0c tempest-ProjectMemberTests-2050864699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-956e52d7-5a9f-4bc1-8d2e-c206aa7b38e9.9a46e622-56be-44fa-883c-6925ef620598 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:22 devstack sudo[108510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-956e52d7-5a9f-4bc1-8d2e-c206aa7b38e9.9a46e622-56be-44fa-883c-6925ef620598 Nov 06 15:42:22 devstack sudo[108510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:22 devstack sudo[108505]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bb7ec706-23bf-43e9-aab6-7ee9f638fc5b tempest-ProjectReaderTests-140075233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-1d35ac62-629a-4ec0-be87-ce077fc3d564" returned: 0 in 0.380s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bb7ec706-23bf-43e9-aab6-7ee9f638fc5b tempest-ProjectReaderTests-140075233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-1d35ac62-629a-4ec0-be87-ce077fc3d564 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:22 devstack sudo[108515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-1d35ac62-629a-4ec0-be87-ce077fc3d564 Nov 06 15:42:22 devstack sudo[108515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:22 devstack sudo[108510]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-777613ea-26bb-499d-9bc3-924104993f0c tempest-ProjectMemberTests-2050864699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-956e52d7-5a9f-4bc1-8d2e-c206aa7b38e9.9a46e622-56be-44fa-883c-6925ef620598" returned: 0 in 0.258s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-777613ea-26bb-499d-9bc3-924104993f0c tempest-ProjectMemberTests-2050864699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-956e52d7-5a9f-4bc1-8d2e-c206aa7b38e9.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:22 devstack sudo[108518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-956e52d7-5a9f-4bc1-8d2e-c206aa7b38e9.info Nov 06 15:42:22 devstack sudo[108518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:22 devstack sudo[108515]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bb7ec706-23bf-43e9-aab6-7ee9f638fc5b tempest-ProjectReaderTests-140075233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-1d35ac62-629a-4ec0-be87-ce077fc3d564" returned: 0 in 0.261s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:22 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-bb7ec706-23bf-43e9-aab6-7ee9f638fc5b tempest-ProjectReaderTests-140075233 None] Lock "cinder-quobyte-1d35ac62-629a-4ec0-be87-ce077fc3d564" released by "delete_volume" :: held 0.687s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:42:22 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-bb7ec706-23bf-43e9-aab6-7ee9f638fc5b tempest-ProjectReaderTests-140075233 None] Created reservations ['2cbc5433-6359-4d43-b952-75604331ff84', '934fccd0-bea2-4860-8caf-da547144fce6', '8b550c1f-eef0-47d8-940b-3ca6a81b4bd6', 'd6ce960a-43e7-4fdb-a6bd-707cdc11485f'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:42:22 devstack sudo[108518]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-777613ea-26bb-499d-9bc3-924104993f0c tempest-ProjectMemberTests-2050864699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-956e52d7-5a9f-4bc1-8d2e-c206aa7b38e9.info" returned: 0 in 0.276s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:22 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-777613ea-26bb-499d-9bc3-924104993f0c tempest-ProjectMemberTests-2050864699 None] /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-956e52d7-5a9f-4bc1-8d2e-c206aa7b38e9.info is being set with open permissions: ugo+rw Nov 06 15:42:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-777613ea-26bb-499d-9bc3-924104993f0c tempest-ProjectMemberTests-2050864699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-956e52d7-5a9f-4bc1-8d2e-c206aa7b38e9.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:22 devstack sudo[108522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-956e52d7-5a9f-4bc1-8d2e-c206aa7b38e9.info Nov 06 15:42:22 devstack sudo[108522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-bb7ec706-23bf-43e9-aab6-7ee9f638fc5b tempest-ProjectReaderTests-140075233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:42:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-bb7ec706-23bf-43e9-aab6-7ee9f638fc5b tempest-ProjectReaderTests-140075233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:42:22 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-bb7ec706-23bf-43e9-aab6-7ee9f638fc5b tempest-ProjectReaderTests-140075233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:42:22 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-bb7ec706-23bf-43e9-aab6-7ee9f638fc5b tempest-ProjectReaderTests-140075233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:42:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-bb7ec706-23bf-43e9-aab6-7ee9f638fc5b tempest-ProjectReaderTests-140075233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:42:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bb7ec706-23bf-43e9-aab6-7ee9f638fc5b tempest-ProjectReaderTests-140075233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:22 devstack sudo[108524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:42:22 devstack sudo[108524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:23 devstack sudo[108522]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-777613ea-26bb-499d-9bc3-924104993f0c tempest-ProjectMemberTests-2050864699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-956e52d7-5a9f-4bc1-8d2e-c206aa7b38e9.info" returned: 0 in 0.251s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-777613ea-26bb-499d-9bc3-924104993f0c tempest-ProjectMemberTests-2050864699 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.275s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:42:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f6faba50-982a-46da-80f4-e0630734e953 tempest-ProjectReaderTests-90568800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.187s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:42:23 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-f6faba50-982a-46da-80f4-e0630734e953 tempest-ProjectReaderTests-90568800 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:42:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-586563959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4e686f1-8ae2-4ee0-bf32-f0acb8136abf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa0e5fb1579d44329b27513f0572ba4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:42:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:42:22Z,use_quota=True,user_id='8f151b147eaa443a8d1a0ac4f9b0c7fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:42:23 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-f6faba50-982a-46da-80f4-e0630734e953 tempest-ProjectReaderTests-90568800 None] Creating volume b4e686f1-8ae2-4ee0-bf32-f0acb8136abf {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:42:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f6faba50-982a-46da-80f4-e0630734e953 tempest-ProjectReaderTests-90568800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:42:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f6faba50-982a-46da-80f4-e0630734e953 tempest-ProjectReaderTests-90568800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:42:23 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-f6faba50-982a-46da-80f4-e0630734e953 tempest-ProjectReaderTests-90568800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:42:23 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-f6faba50-982a-46da-80f4-e0630734e953 tempest-ProjectReaderTests-90568800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:42:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f6faba50-982a-46da-80f4-e0630734e953 tempest-ProjectReaderTests-90568800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:42:23 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-f6faba50-982a-46da-80f4-e0630734e953 tempest-ProjectReaderTests-90568800 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:42:23 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-f6faba50-982a-46da-80f4-e0630734e953 tempest-ProjectReaderTests-90568800 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:42:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f6faba50-982a-46da-80f4-e0630734e953 tempest-ProjectReaderTests-90568800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b4e686f1-8ae2-4ee0-bf32-f0acb8136abf 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:23 devstack sudo[108524]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bb7ec706-23bf-43e9-aab6-7ee9f638fc5b tempest-ProjectReaderTests-140075233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.264s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:23 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-bb7ec706-23bf-43e9-aab6-7ee9f638fc5b tempest-ProjectReaderTests-140075233 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:42:23 devstack sudo[108528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b4e686f1-8ae2-4ee0-bf32-f0acb8136abf 1073741824 Nov 06 15:42:23 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-bb7ec706-23bf-43e9-aab6-7ee9f638fc5b tempest-ProjectReaderTests-140075233 None] Deleted volume successfully. Nov 06 15:42:23 devstack sudo[108528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:23 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-777613ea-26bb-499d-9bc3-924104993f0c tempest-ProjectMemberTests-2050864699 None] Create snapshot completed successfully Nov 06 15:42:23 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-bb7ec706-23bf-43e9-aab6-7ee9f638fc5b tempest-ProjectReaderTests-140075233 None] Lock "cinder-1d35ac62-629a-4ec0-be87-ce077fc3d564-delete_volume" released by "delete_volume" :: held 1.196s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:42:23 devstack sudo[108528]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f6faba50-982a-46da-80f4-e0630734e953 tempest-ProjectReaderTests-90568800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b4e686f1-8ae2-4ee0-bf32-f0acb8136abf 1073741824" returned: 0 in 0.474s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:23 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-c286b5ef-3b91-43d3-87df-83c20aed749c tempest-ProjectReaderTests-140075233 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:42:23 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c286b5ef-3b91-43d3-87df-83c20aed749c tempest-ProjectReaderTests-140075233 None] Flow 'volume_create_manager' (4d0e71dd-d194-40a1-8bd7-e1446502f850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:42:23 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c286b5ef-3b91-43d3-87df-83c20aed749c tempest-ProjectReaderTests-140075233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05c15887-914b-4be2-951c-ff0dc5bb266e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:42:23 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c286b5ef-3b91-43d3-87df-83c20aed749c tempest-ProjectReaderTests-140075233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05c15887-914b-4be2-951c-ff0dc5bb266e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:42:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-697059260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b15d32e0-a466-432a-b91e-0df1056989f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac9d16e12dfb4ef9893478823bf36158',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:42:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:42:24Z,use_quota=True,user_id='c627485c382a4cc6aecab8442ba4f552',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:42:23 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c286b5ef-3b91-43d3-87df-83c20aed749c tempest-ProjectReaderTests-140075233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35820123-9171-4638-9949-71a94f6354fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:42:23 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c286b5ef-3b91-43d3-87df-83c20aed749c tempest-ProjectReaderTests-140075233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35820123-9171-4638-9949-71a94f6354fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:42:23 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c286b5ef-3b91-43d3-87df-83c20aed749c tempest-ProjectReaderTests-140075233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (526b61ec-b931-4d15-b993-8e7485eb8a54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:42:23 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c286b5ef-3b91-43d3-87df-83c20aed749c tempest-ProjectReaderTests-140075233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (526b61ec-b931-4d15-b993-8e7485eb8a54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b15d32e0-a466-432a-b91e-0df1056989f8', 'volume_name': 'volume-b15d32e0-a466-432a-b91e-0df1056989f8', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:42:23 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c286b5ef-3b91-43d3-87df-83c20aed749c tempest-ProjectReaderTests-140075233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26d5a45a-2034-4f13-ac6b-ebedad8a29fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:42:23 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c286b5ef-3b91-43d3-87df-83c20aed749c tempest-ProjectReaderTests-140075233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26d5a45a-2034-4f13-ac6b-ebedad8a29fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:42:23 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c286b5ef-3b91-43d3-87df-83c20aed749c tempest-ProjectReaderTests-140075233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab576bd0-b9e3-4d8b-9075-423370a40c9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:42:23 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-c286b5ef-3b91-43d3-87df-83c20aed749c tempest-ProjectReaderTests-140075233 None] Volume b15d32e0-a466-432a-b91e-0df1056989f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b15d32e0-a466-432a-b91e-0df1056989f8', 'volume_size': 1} Nov 06 15:42:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c286b5ef-3b91-43d3-87df-83c20aed749c tempest-ProjectReaderTests-140075233 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:42:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f6faba50-982a-46da-80f4-e0630734e953 tempest-ProjectReaderTests-90568800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b4e686f1-8ae2-4ee0-bf32-f0acb8136abf {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:23 devstack sudo[108533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b4e686f1-8ae2-4ee0-bf32-f0acb8136abf Nov 06 15:42:23 devstack sudo[108533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:23 devstack sudo[108533]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f6faba50-982a-46da-80f4-e0630734e953 tempest-ProjectReaderTests-90568800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b4e686f1-8ae2-4ee0-bf32-f0acb8136abf" returned: 0 in 0.253s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:23 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-f6faba50-982a-46da-80f4-e0630734e953 tempest-ProjectReaderTests-90568800 None] <== create_volume: return (845ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:42:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f6faba50-982a-46da-80f4-e0630734e953 tempest-ProjectReaderTests-90568800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.851s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:42:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c286b5ef-3b91-43d3-87df-83c20aed749c tempest-ProjectReaderTests-140075233 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.266s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:42:23 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c286b5ef-3b91-43d3-87df-83c20aed749c tempest-ProjectReaderTests-140075233 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:42:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-697059260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b15d32e0-a466-432a-b91e-0df1056989f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac9d16e12dfb4ef9893478823bf36158',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:42:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:42:24Z,use_quota=True,user_id='c627485c382a4cc6aecab8442ba4f552',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:42:23 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-c286b5ef-3b91-43d3-87df-83c20aed749c tempest-ProjectReaderTests-140075233 None] Creating volume b15d32e0-a466-432a-b91e-0df1056989f8 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:42:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c286b5ef-3b91-43d3-87df-83c20aed749c tempest-ProjectReaderTests-140075233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:42:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c286b5ef-3b91-43d3-87df-83c20aed749c tempest-ProjectReaderTests-140075233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:42:23 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c286b5ef-3b91-43d3-87df-83c20aed749c tempest-ProjectReaderTests-140075233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:42:23 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c286b5ef-3b91-43d3-87df-83c20aed749c tempest-ProjectReaderTests-140075233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:42:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c286b5ef-3b91-43d3-87df-83c20aed749c tempest-ProjectReaderTests-140075233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:42:23 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c286b5ef-3b91-43d3-87df-83c20aed749c tempest-ProjectReaderTests-140075233 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:42:23 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-c286b5ef-3b91-43d3-87df-83c20aed749c tempest-ProjectReaderTests-140075233 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:42:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c286b5ef-3b91-43d3-87df-83c20aed749c tempest-ProjectReaderTests-140075233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b15d32e0-a466-432a-b91e-0df1056989f8 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:23 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f6faba50-982a-46da-80f4-e0630734e953 tempest-ProjectReaderTests-90568800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af82f625-3503-40cb-a3ce-f5c19fb5ca93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4e686f1-8ae2-4ee0-bf32-f0acb8136abf', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:42:23 devstack sudo[108536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b15d32e0-a466-432a-b91e-0df1056989f8 1073741824 Nov 06 15:42:23 devstack sudo[108536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:23 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f6faba50-982a-46da-80f4-e0630734e953 tempest-ProjectReaderTests-90568800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d48b0fb-9006-4aaf-bf2d-bdd342304fec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:42:24 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-f6faba50-982a-46da-80f4-e0630734e953 tempest-ProjectReaderTests-90568800 None] Volume volume-b4e686f1-8ae2-4ee0-bf32-f0acb8136abf (b4e686f1-8ae2-4ee0-bf32-f0acb8136abf): created successfully Nov 06 15:42:24 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f6faba50-982a-46da-80f4-e0630734e953 tempest-ProjectReaderTests-90568800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d48b0fb-9006-4aaf-bf2d-bdd342304fec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:42:24 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f6faba50-982a-46da-80f4-e0630734e953 tempest-ProjectReaderTests-90568800 None] Flow 'volume_create_manager' (3b428c45-1d11-4983-838d-ec4e9ebfeebb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:42:24 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-f6faba50-982a-46da-80f4-e0630734e953 tempest-ProjectReaderTests-90568800 None] Created volume successfully. Nov 06 15:42:24 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-4823de9d-4fe4-47d5-ada1-f411a125f973 tempest-ProjectMemberTests-2050864699 None] Acquiring lock "cinder-9a46e622-56be-44fa-883c-6925ef620598-delete_snapshot" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:42:24 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-4823de9d-4fe4-47d5-ada1-f411a125f973 tempest-ProjectMemberTests-2050864699 None] Lock "cinder-9a46e622-56be-44fa-883c-6925ef620598-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:42:24 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-4823de9d-4fe4-47d5-ada1-f411a125f973 tempest-ProjectMemberTests-2050864699 None] Acquiring lock "cinder-quobyte-956e52d7-5a9f-4bc1-8d2e-c206aa7b38e9" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:42:24 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-4823de9d-4fe4-47d5-ada1-f411a125f973 tempest-ProjectMemberTests-2050864699 None] Lock "cinder-quobyte-956e52d7-5a9f-4bc1-8d2e-c206aa7b38e9" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:42:24 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-4823de9d-4fe4-47d5-ada1-f411a125f973 tempest-ProjectMemberTests-2050864699 None] Acquiring lock "cinder-quobyte-9a46e622-56be-44fa-883c-6925ef620598" by "_delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:42:24 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-4823de9d-4fe4-47d5-ada1-f411a125f973 tempest-ProjectMemberTests-2050864699 None] Lock "cinder-quobyte-9a46e622-56be-44fa-883c-6925ef620598" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:42:24 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-4823de9d-4fe4-47d5-ada1-f411a125f973 tempest-ProjectMemberTests-2050864699 None] Deleting offline snapshot 9a46e622-56be-44fa-883c-6925ef620598 of volume 956e52d7-5a9f-4bc1-8d2e-c206aa7b38e9 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 15:42:24 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-4823de9d-4fe4-47d5-ada1-f411a125f973 tempest-ProjectMemberTests-2050864699 None] snapshot_file for this snap is: volume-956e52d7-5a9f-4bc1-8d2e-c206aa7b38e9.9a46e622-56be-44fa-883c-6925ef620598 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 15:42:24 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[d962d6e0-70cb-4520-aec8-ef1cfb68efa0]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:42:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4823de9d-4fe4-47d5-ada1-f411a125f973 tempest-ProjectMemberTests-2050864699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-956e52d7-5a9f-4bc1-8d2e-c206aa7b38e9.9a46e622-56be-44fa-883c-6925ef620598 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:24 devstack sudo[108541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-956e52d7-5a9f-4bc1-8d2e-c206aa7b38e9.9a46e622-56be-44fa-883c-6925ef620598 Nov 06 15:42:24 devstack sudo[108541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:24 devstack sudo[108536]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c286b5ef-3b91-43d3-87df-83c20aed749c tempest-ProjectReaderTests-140075233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b15d32e0-a466-432a-b91e-0df1056989f8 1073741824" returned: 0 in 0.460s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c286b5ef-3b91-43d3-87df-83c20aed749c tempest-ProjectReaderTests-140075233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b15d32e0-a466-432a-b91e-0df1056989f8 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:24 devstack sudo[108543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b15d32e0-a466-432a-b91e-0df1056989f8 Nov 06 15:42:24 devstack sudo[108543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:24 devstack sudo[108541]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4823de9d-4fe4-47d5-ada1-f411a125f973 tempest-ProjectMemberTests-2050864699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-956e52d7-5a9f-4bc1-8d2e-c206aa7b38e9.9a46e622-56be-44fa-883c-6925ef620598" returned: 0 in 0.369s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:24 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-4823de9d-4fe4-47d5-ada1-f411a125f973 tempest-ProjectMemberTests-2050864699 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-956e52d7-5a9f-4bc1-8d2e-c206aa7b38e9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 15:42:24 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[44e3ee66-37aa-4a33-8da4-b9938ee7a7e5]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:42:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4823de9d-4fe4-47d5-ada1-f411a125f973 tempest-ProjectMemberTests-2050864699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-956e52d7-5a9f-4bc1-8d2e-c206aa7b38e9 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:24 devstack sudo[108543]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c286b5ef-3b91-43d3-87df-83c20aed749c tempest-ProjectReaderTests-140075233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b15d32e0-a466-432a-b91e-0df1056989f8" returned: 0 in 0.278s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:24 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c286b5ef-3b91-43d3-87df-83c20aed749c tempest-ProjectReaderTests-140075233 None] <== create_volume: return (777ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:42:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c286b5ef-3b91-43d3-87df-83c20aed749c tempest-ProjectReaderTests-140075233 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.779s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:42:24 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c286b5ef-3b91-43d3-87df-83c20aed749c tempest-ProjectReaderTests-140075233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab576bd0-b9e3-4d8b-9075-423370a40c9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b15d32e0-a466-432a-b91e-0df1056989f8', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:42:24 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c286b5ef-3b91-43d3-87df-83c20aed749c tempest-ProjectReaderTests-140075233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0baa0f7f-50fd-4fff-b0bf-a16aa0ffed45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:42:24 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-c286b5ef-3b91-43d3-87df-83c20aed749c tempest-ProjectReaderTests-140075233 None] Volume volume-b15d32e0-a466-432a-b91e-0df1056989f8 (b15d32e0-a466-432a-b91e-0df1056989f8): created successfully Nov 06 15:42:24 devstack sudo[108548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-956e52d7-5a9f-4bc1-8d2e-c206aa7b38e9 Nov 06 15:42:24 devstack sudo[108548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:24 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c286b5ef-3b91-43d3-87df-83c20aed749c tempest-ProjectReaderTests-140075233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0baa0f7f-50fd-4fff-b0bf-a16aa0ffed45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:42:24 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c286b5ef-3b91-43d3-87df-83c20aed749c tempest-ProjectReaderTests-140075233 None] Flow 'volume_create_manager' (4d0e71dd-d194-40a1-8bd7-e1446502f850) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:42:24 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-c286b5ef-3b91-43d3-87df-83c20aed749c tempest-ProjectReaderTests-140075233 None] Created volume successfully. Nov 06 15:42:25 devstack sudo[108548]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4823de9d-4fe4-47d5-ada1-f411a125f973 tempest-ProjectMemberTests-2050864699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-956e52d7-5a9f-4bc1-8d2e-c206aa7b38e9" returned: 0 in 0.391s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4823de9d-4fe4-47d5-ada1-f411a125f973 tempest-ProjectMemberTests-2050864699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-956e52d7-5a9f-4bc1-8d2e-c206aa7b38e9.9a46e622-56be-44fa-883c-6925ef620598 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-37389c6d-a147-40a0-a199-fe1aad8c0ef3 tempest-ProjectReaderTests-90568800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:42:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-37389c6d-a147-40a0-a199-fe1aad8c0ef3 tempest-ProjectReaderTests-90568800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:42:25 devstack sudo[108554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-956e52d7-5a9f-4bc1-8d2e-c206aa7b38e9.9a46e622-56be-44fa-883c-6925ef620598 Nov 06 15:42:25 devstack sudo[108554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:25 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-37389c6d-a147-40a0-a199-fe1aad8c0ef3 tempest-ProjectReaderTests-90568800 None] Creating offline snapshot 58817e95-c119-41cd-abe4-835e992b903d of volume b4e686f1-8ae2-4ee0-bf32-f0acb8136abf {{(pid=87132) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 15:42:25 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce9e0d62-83f5-4748-ab19-4c1254f86f84]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:42:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-37389c6d-a147-40a0-a199-fe1aad8c0ef3 tempest-ProjectReaderTests-90568800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b4e686f1-8ae2-4ee0-bf32-f0acb8136abf {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:25 devstack sudo[108556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b4e686f1-8ae2-4ee0-bf32-f0acb8136abf Nov 06 15:42:25 devstack sudo[108556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:25 devstack sudo[108554]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4823de9d-4fe4-47d5-ada1-f411a125f973 tempest-ProjectMemberTests-2050864699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-956e52d7-5a9f-4bc1-8d2e-c206aa7b38e9.9a46e622-56be-44fa-883c-6925ef620598" returned: 0 in 0.343s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4823de9d-4fe4-47d5-ada1-f411a125f973 tempest-ProjectMemberTests-2050864699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-956e52d7-5a9f-4bc1-8d2e-c206aa7b38e9.9a46e622-56be-44fa-883c-6925ef620598 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:25 devstack sudo[108561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-956e52d7-5a9f-4bc1-8d2e-c206aa7b38e9.9a46e622-56be-44fa-883c-6925ef620598 Nov 06 15:42:25 devstack sudo[108561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:25 devstack sudo[108556]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-37389c6d-a147-40a0-a199-fe1aad8c0ef3 tempest-ProjectReaderTests-90568800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b4e686f1-8ae2-4ee0-bf32-f0acb8136abf" returned: 0 in 0.386s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-37389c6d-a147-40a0-a199-fe1aad8c0ef3 tempest-ProjectReaderTests-90568800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b4e686f1-8ae2-4ee0-bf32-f0acb8136abf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b4e686f1-8ae2-4ee0-bf32-f0acb8136abf.58817e95-c119-41cd-abe4-835e992b903d 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:25 devstack sudo[108566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b4e686f1-8ae2-4ee0-bf32-f0acb8136abf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b4e686f1-8ae2-4ee0-bf32-f0acb8136abf.58817e95-c119-41cd-abe4-835e992b903d 1G Nov 06 15:42:25 devstack sudo[108566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:25 devstack sudo[108561]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4823de9d-4fe4-47d5-ada1-f411a125f973 tempest-ProjectMemberTests-2050864699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-956e52d7-5a9f-4bc1-8d2e-c206aa7b38e9.9a46e622-56be-44fa-883c-6925ef620598" returned: 0 in 0.261s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:25 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-4823de9d-4fe4-47d5-ada1-f411a125f973 tempest-ProjectMemberTests-2050864699 None] Lock "cinder-quobyte-9a46e622-56be-44fa-883c-6925ef620598" released by "_delete_snapshot" :: held 1.469s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:42:25 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-4823de9d-4fe4-47d5-ada1-f411a125f973 tempest-ProjectMemberTests-2050864699 None] Lock "cinder-quobyte-956e52d7-5a9f-4bc1-8d2e-c206aa7b38e9" released by "delete_snapshot" :: held 1.498s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:42:25 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-22873635-4678-41f3-8410-d8a1158f6cfe tempest-ProjectReaderTests-140075233 None] Acquiring lock "cinder-b15d32e0-a466-432a-b91e-0df1056989f8-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:42:25 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-22873635-4678-41f3-8410-d8a1158f6cfe tempest-ProjectReaderTests-140075233 None] Lock "cinder-b15d32e0-a466-432a-b91e-0df1056989f8-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:42:25 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-22873635-4678-41f3-8410-d8a1158f6cfe tempest-ProjectReaderTests-140075233 None] Acquiring lock "cinder-quobyte-b15d32e0-a466-432a-b91e-0df1056989f8" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:42:25 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-22873635-4678-41f3-8410-d8a1158f6cfe tempest-ProjectReaderTests-140075233 None] Lock "cinder-quobyte-b15d32e0-a466-432a-b91e-0df1056989f8" acquired by "delete_volume" :: waited 0.027s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:42:25 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-4823de9d-4fe4-47d5-ada1-f411a125f973 tempest-ProjectMemberTests-2050864699 None] Created reservations ['88794456-de9b-4f11-a7a8-639b3c224e4f', 'a9158948-3175-48b4-a536-39084d8cd731', '9d47ef77-738c-4852-9475-23539768a3ee', 'ca911d5b-0515-43c3-ab91-d6aa1ae5d96b'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:42:25 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[a83d2c87-1bb9-452d-aabc-2bae41743d0a]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:42:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-22873635-4678-41f3-8410-d8a1158f6cfe tempest-ProjectReaderTests-140075233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b15d32e0-a466-432a-b91e-0df1056989f8 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:25 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-4823de9d-4fe4-47d5-ada1-f411a125f973 tempest-ProjectMemberTests-2050864699 None] Delete snapshot completed successfully. Nov 06 15:42:25 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-4823de9d-4fe4-47d5-ada1-f411a125f973 tempest-ProjectMemberTests-2050864699 None] Lock "cinder-9a46e622-56be-44fa-883c-6925ef620598-delete_snapshot" released by "delete_snapshot" :: held 1.744s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:42:25 devstack sudo[108566]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-37389c6d-a147-40a0-a199-fe1aad8c0ef3 tempest-ProjectReaderTests-90568800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b4e686f1-8ae2-4ee0-bf32-f0acb8136abf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b4e686f1-8ae2-4ee0-bf32-f0acb8136abf.58817e95-c119-41cd-abe4-835e992b903d 1G" returned: 0 in 0.495s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-37389c6d-a147-40a0-a199-fe1aad8c0ef3 tempest-ProjectReaderTests-90568800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4e686f1-8ae2-4ee0-bf32-f0acb8136abf -F qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b4e686f1-8ae2-4ee0-bf32-f0acb8136abf.58817e95-c119-41cd-abe4-835e992b903d {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:25 devstack sudo[108573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b15d32e0-a466-432a-b91e-0df1056989f8 Nov 06 15:42:25 devstack sudo[108573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:26 devstack sudo[108577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4e686f1-8ae2-4ee0-bf32-f0acb8136abf -F qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b4e686f1-8ae2-4ee0-bf32-f0acb8136abf.58817e95-c119-41cd-abe4-835e992b903d Nov 06 15:42:26 devstack sudo[108577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:26 devstack sudo[108573]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-22873635-4678-41f3-8410-d8a1158f6cfe tempest-ProjectReaderTests-140075233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b15d32e0-a466-432a-b91e-0df1056989f8" returned: 0 in 0.406s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-22873635-4678-41f3-8410-d8a1158f6cfe tempest-ProjectReaderTests-140075233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b15d32e0-a466-432a-b91e-0df1056989f8 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:26 devstack sudo[108577]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-37389c6d-a147-40a0-a199-fe1aad8c0ef3 tempest-ProjectReaderTests-90568800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4e686f1-8ae2-4ee0-bf32-f0acb8136abf -F qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b4e686f1-8ae2-4ee0-bf32-f0acb8136abf.58817e95-c119-41cd-abe4-835e992b903d" returned: 0 in 0.310s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:26 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-37389c6d-a147-40a0-a199-fe1aad8c0ef3 tempest-ProjectReaderTests-90568800 None] /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b4e686f1-8ae2-4ee0-bf32-f0acb8136abf.58817e95-c119-41cd-abe4-835e992b903d is being set with open permissions: ugo+rw Nov 06 15:42:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-37389c6d-a147-40a0-a199-fe1aad8c0ef3 tempest-ProjectReaderTests-90568800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b4e686f1-8ae2-4ee0-bf32-f0acb8136abf.58817e95-c119-41cd-abe4-835e992b903d {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:26 devstack sudo[108585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b15d32e0-a466-432a-b91e-0df1056989f8 Nov 06 15:42:26 devstack sudo[108585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:26 devstack sudo[108587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b4e686f1-8ae2-4ee0-bf32-f0acb8136abf.58817e95-c119-41cd-abe4-835e992b903d Nov 06 15:42:26 devstack sudo[108587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:26 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-2f124889-2afb-4bc8-b6b5-c578c618bcc1 tempest-ProjectMemberTests-2050864699 None] Acquiring lock "cinder-956e52d7-5a9f-4bc1-8d2e-c206aa7b38e9-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:42:26 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-2f124889-2afb-4bc8-b6b5-c578c618bcc1 tempest-ProjectMemberTests-2050864699 None] Lock "cinder-956e52d7-5a9f-4bc1-8d2e-c206aa7b38e9-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:42:26 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-2f124889-2afb-4bc8-b6b5-c578c618bcc1 tempest-ProjectMemberTests-2050864699 None] Acquiring lock "cinder-quobyte-956e52d7-5a9f-4bc1-8d2e-c206aa7b38e9" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:42:26 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-2f124889-2afb-4bc8-b6b5-c578c618bcc1 tempest-ProjectMemberTests-2050864699 None] Lock "cinder-quobyte-956e52d7-5a9f-4bc1-8d2e-c206aa7b38e9" acquired by "delete_volume" :: waited 0.019s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:42:26 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[90612e78-41e2-41bf-b7e1-7de988b9bdf2]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:42:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2f124889-2afb-4bc8-b6b5-c578c618bcc1 tempest-ProjectMemberTests-2050864699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-956e52d7-5a9f-4bc1-8d2e-c206aa7b38e9 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:26 devstack sudo[108585]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-22873635-4678-41f3-8410-d8a1158f6cfe tempest-ProjectReaderTests-140075233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b15d32e0-a466-432a-b91e-0df1056989f8" returned: 0 in 0.275s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:26 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-22873635-4678-41f3-8410-d8a1158f6cfe tempest-ProjectReaderTests-140075233 None] Lock "cinder-quobyte-b15d32e0-a466-432a-b91e-0df1056989f8" released by "delete_volume" :: held 0.735s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:42:26 devstack sudo[108587]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-37389c6d-a147-40a0-a199-fe1aad8c0ef3 tempest-ProjectReaderTests-90568800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b4e686f1-8ae2-4ee0-bf32-f0acb8136abf.58817e95-c119-41cd-abe4-835e992b903d" returned: 0 in 0.285s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:26 devstack sudo[108589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-956e52d7-5a9f-4bc1-8d2e-c206aa7b38e9 Nov 06 15:42:26 devstack sudo[108589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-37389c6d-a147-40a0-a199-fe1aad8c0ef3 tempest-ProjectReaderTests-90568800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b4e686f1-8ae2-4ee0-bf32-f0acb8136abf.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:26 devstack sudo[108593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b4e686f1-8ae2-4ee0-bf32-f0acb8136abf.info Nov 06 15:42:26 devstack sudo[108593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:26 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-22873635-4678-41f3-8410-d8a1158f6cfe tempest-ProjectReaderTests-140075233 None] Created reservations ['548b9503-a5e4-4068-9e77-7e6b19226de8', '672b179b-079f-4613-b60c-aa5e3fb12200', '518c8a57-306f-4319-91ff-7a288fd9f799', 'e38fc0e4-9031-4d7c-959f-20a880dcb68a'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:42:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-22873635-4678-41f3-8410-d8a1158f6cfe tempest-ProjectReaderTests-140075233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:42:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-22873635-4678-41f3-8410-d8a1158f6cfe tempest-ProjectReaderTests-140075233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:42:26 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-22873635-4678-41f3-8410-d8a1158f6cfe tempest-ProjectReaderTests-140075233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:42:26 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-22873635-4678-41f3-8410-d8a1158f6cfe tempest-ProjectReaderTests-140075233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:42:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-22873635-4678-41f3-8410-d8a1158f6cfe tempest-ProjectReaderTests-140075233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:42:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-22873635-4678-41f3-8410-d8a1158f6cfe tempest-ProjectReaderTests-140075233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:26 devstack sudo[108595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:42:26 devstack sudo[108595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:26 devstack sudo[108593]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-37389c6d-a147-40a0-a199-fe1aad8c0ef3 tempest-ProjectReaderTests-90568800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b4e686f1-8ae2-4ee0-bf32-f0acb8136abf.info" returned: 0 in 0.286s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:26 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-37389c6d-a147-40a0-a199-fe1aad8c0ef3 tempest-ProjectReaderTests-90568800 None] /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b4e686f1-8ae2-4ee0-bf32-f0acb8136abf.info is being set with open permissions: ugo+rw Nov 06 15:42:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-37389c6d-a147-40a0-a199-fe1aad8c0ef3 tempest-ProjectReaderTests-90568800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b4e686f1-8ae2-4ee0-bf32-f0acb8136abf.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:26 devstack sudo[108589]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2f124889-2afb-4bc8-b6b5-c578c618bcc1 tempest-ProjectMemberTests-2050864699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-956e52d7-5a9f-4bc1-8d2e-c206aa7b38e9" returned: 0 in 0.426s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2f124889-2afb-4bc8-b6b5-c578c618bcc1 tempest-ProjectMemberTests-2050864699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-956e52d7-5a9f-4bc1-8d2e-c206aa7b38e9 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:26 devstack sudo[108601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b4e686f1-8ae2-4ee0-bf32-f0acb8136abf.info Nov 06 15:42:26 devstack sudo[108601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:26 devstack sudo[108602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-956e52d7-5a9f-4bc1-8d2e-c206aa7b38e9 Nov 06 15:42:26 devstack sudo[108602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:27 devstack sudo[108595]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-22873635-4678-41f3-8410-d8a1158f6cfe tempest-ProjectReaderTests-140075233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.290s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:27 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-22873635-4678-41f3-8410-d8a1158f6cfe tempest-ProjectReaderTests-140075233 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:42:27 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-22873635-4678-41f3-8410-d8a1158f6cfe tempest-ProjectReaderTests-140075233 None] Deleted volume successfully. Nov 06 15:42:27 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-22873635-4678-41f3-8410-d8a1158f6cfe tempest-ProjectReaderTests-140075233 None] Lock "cinder-b15d32e0-a466-432a-b91e-0df1056989f8-delete_volume" released by "delete_volume" :: held 1.292s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:42:27 devstack sudo[108601]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-37389c6d-a147-40a0-a199-fe1aad8c0ef3 tempest-ProjectReaderTests-90568800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b4e686f1-8ae2-4ee0-bf32-f0acb8136abf.info" returned: 0 in 0.282s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-37389c6d-a147-40a0-a199-fe1aad8c0ef3 tempest-ProjectReaderTests-90568800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.131s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:42:27 devstack sudo[108602]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2f124889-2afb-4bc8-b6b5-c578c618bcc1 tempest-ProjectMemberTests-2050864699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-956e52d7-5a9f-4bc1-8d2e-c206aa7b38e9" returned: 0 in 0.298s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:27 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-2f124889-2afb-4bc8-b6b5-c578c618bcc1 tempest-ProjectMemberTests-2050864699 None] Lock "cinder-quobyte-956e52d7-5a9f-4bc1-8d2e-c206aa7b38e9" released by "delete_volume" :: held 0.801s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:42:27 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-37389c6d-a147-40a0-a199-fe1aad8c0ef3 tempest-ProjectReaderTests-90568800 None] Create snapshot completed successfully Nov 06 15:42:27 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-2f124889-2afb-4bc8-b6b5-c578c618bcc1 tempest-ProjectMemberTests-2050864699 None] Created reservations ['fe3ad429-6a79-49b9-ae3d-9c55a2ab60c9', 'bf8bd580-e5a3-4767-9008-20dcf5b09816', '724162ac-4a0a-4f70-993d-2e9952736e47', '1cb3721f-c5d0-4e99-9a93-1b7685b1e169'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:42:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-2f124889-2afb-4bc8-b6b5-c578c618bcc1 tempest-ProjectMemberTests-2050864699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:42:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-2f124889-2afb-4bc8-b6b5-c578c618bcc1 tempest-ProjectMemberTests-2050864699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:42:27 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-2f124889-2afb-4bc8-b6b5-c578c618bcc1 tempest-ProjectMemberTests-2050864699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:42:27 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-2f124889-2afb-4bc8-b6b5-c578c618bcc1 tempest-ProjectMemberTests-2050864699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:42:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-2f124889-2afb-4bc8-b6b5-c578c618bcc1 tempest-ProjectMemberTests-2050864699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:42:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2f124889-2afb-4bc8-b6b5-c578c618bcc1 tempest-ProjectMemberTests-2050864699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:27 devstack sudo[108608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:42:27 devstack sudo[108608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:27 devstack sudo[108608]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2f124889-2afb-4bc8-b6b5-c578c618bcc1 tempest-ProjectMemberTests-2050864699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.275s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:27 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-2f124889-2afb-4bc8-b6b5-c578c618bcc1 tempest-ProjectMemberTests-2050864699 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:42:27 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-2f124889-2afb-4bc8-b6b5-c578c618bcc1 tempest-ProjectMemberTests-2050864699 None] Deleted volume successfully. Nov 06 15:42:27 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-2f124889-2afb-4bc8-b6b5-c578c618bcc1 tempest-ProjectMemberTests-2050864699 None] Lock "cinder-956e52d7-5a9f-4bc1-8d2e-c206aa7b38e9-delete_volume" released by "delete_volume" :: held 1.295s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:42:28 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-eace932e-a090-4119-9332-8075754b6f47 tempest-ProjectMemberTests-2050864699 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:42:28 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-eace932e-a090-4119-9332-8075754b6f47 tempest-ProjectMemberTests-2050864699 None] Flow 'volume_create_manager' (4bb74337-0802-4c7c-bf8e-860a4443d9f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:42:28 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-eace932e-a090-4119-9332-8075754b6f47 tempest-ProjectMemberTests-2050864699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c920aa23-28de-4052-a7d4-d83f3912f9c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:42:28 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-eace932e-a090-4119-9332-8075754b6f47 tempest-ProjectMemberTests-2050864699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c920aa23-28de-4052-a7d4-d83f3912f9c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:42:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-721200133',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74282aec-5713-43d0-bb5a-9d7d39164b28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='631b1acb2fe74ff38bf682df0fb94c26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:42:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:42:28Z,use_quota=True,user_id='c2ab5a7c9b61494492f0f3bd6193ebdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:42:28 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-eace932e-a090-4119-9332-8075754b6f47 tempest-ProjectMemberTests-2050864699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed5f979e-1237-4833-93b5-f23ea00dbe38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:42:28 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-eace932e-a090-4119-9332-8075754b6f47 tempest-ProjectMemberTests-2050864699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed5f979e-1237-4833-93b5-f23ea00dbe38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:42:28 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-eace932e-a090-4119-9332-8075754b6f47 tempest-ProjectMemberTests-2050864699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d63a1f0-add5-47fa-a030-a7e3cbf960cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:42:28 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-eace932e-a090-4119-9332-8075754b6f47 tempest-ProjectMemberTests-2050864699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d63a1f0-add5-47fa-a030-a7e3cbf960cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74282aec-5713-43d0-bb5a-9d7d39164b28', 'volume_name': 'volume-74282aec-5713-43d0-bb5a-9d7d39164b28', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:42:28 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-eace932e-a090-4119-9332-8075754b6f47 tempest-ProjectMemberTests-2050864699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c27fe7ce-a187-4019-9794-3532c11eb796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:42:28 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-eace932e-a090-4119-9332-8075754b6f47 tempest-ProjectMemberTests-2050864699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c27fe7ce-a187-4019-9794-3532c11eb796) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:42:28 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-eace932e-a090-4119-9332-8075754b6f47 tempest-ProjectMemberTests-2050864699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6969246f-c166-478f-8cce-90ce163df034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:42:28 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-eace932e-a090-4119-9332-8075754b6f47 tempest-ProjectMemberTests-2050864699 None] Volume 74282aec-5713-43d0-bb5a-9d7d39164b28: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74282aec-5713-43d0-bb5a-9d7d39164b28', 'volume_size': 1} Nov 06 15:42:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-eace932e-a090-4119-9332-8075754b6f47 tempest-ProjectMemberTests-2050864699 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:42:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-eace932e-a090-4119-9332-8075754b6f47 tempest-ProjectMemberTests-2050864699 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:42:28 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-eace932e-a090-4119-9332-8075754b6f47 tempest-ProjectMemberTests-2050864699 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:42:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-721200133',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74282aec-5713-43d0-bb5a-9d7d39164b28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='631b1acb2fe74ff38bf682df0fb94c26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:42:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:42:28Z,use_quota=True,user_id='c2ab5a7c9b61494492f0f3bd6193ebdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:42:28 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-eace932e-a090-4119-9332-8075754b6f47 tempest-ProjectMemberTests-2050864699 None] Creating volume 74282aec-5713-43d0-bb5a-9d7d39164b28 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:42:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-eace932e-a090-4119-9332-8075754b6f47 tempest-ProjectMemberTests-2050864699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:42:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-eace932e-a090-4119-9332-8075754b6f47 tempest-ProjectMemberTests-2050864699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:42:28 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-eace932e-a090-4119-9332-8075754b6f47 tempest-ProjectMemberTests-2050864699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:42:28 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-eace932e-a090-4119-9332-8075754b6f47 tempest-ProjectMemberTests-2050864699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:42:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-eace932e-a090-4119-9332-8075754b6f47 tempest-ProjectMemberTests-2050864699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:42:28 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-eace932e-a090-4119-9332-8075754b6f47 tempest-ProjectMemberTests-2050864699 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:42:28 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-eace932e-a090-4119-9332-8075754b6f47 tempest-ProjectMemberTests-2050864699 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:42:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-eace932e-a090-4119-9332-8075754b6f47 tempest-ProjectMemberTests-2050864699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-74282aec-5713-43d0-bb5a-9d7d39164b28 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:28 devstack sudo[108611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-74282aec-5713-43d0-bb5a-9d7d39164b28 1073741824 Nov 06 15:42:28 devstack sudo[108611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:28 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-069cc8df-741d-4a27-920b-3074909635d5 tempest-ProjectReaderTests-90568800 None] Acquiring lock "cinder-58817e95-c119-41cd-abe4-835e992b903d-delete_snapshot" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:42:28 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-069cc8df-741d-4a27-920b-3074909635d5 tempest-ProjectReaderTests-90568800 None] Lock "cinder-58817e95-c119-41cd-abe4-835e992b903d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:42:28 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-069cc8df-741d-4a27-920b-3074909635d5 tempest-ProjectReaderTests-90568800 None] Acquiring lock "cinder-quobyte-b4e686f1-8ae2-4ee0-bf32-f0acb8136abf" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:42:28 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-069cc8df-741d-4a27-920b-3074909635d5 tempest-ProjectReaderTests-90568800 None] Lock "cinder-quobyte-b4e686f1-8ae2-4ee0-bf32-f0acb8136abf" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:42:28 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-069cc8df-741d-4a27-920b-3074909635d5 tempest-ProjectReaderTests-90568800 None] Acquiring lock "cinder-quobyte-58817e95-c119-41cd-abe4-835e992b903d" by "_delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:42:28 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-069cc8df-741d-4a27-920b-3074909635d5 tempest-ProjectReaderTests-90568800 None] Lock "cinder-quobyte-58817e95-c119-41cd-abe4-835e992b903d" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:42:28 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-069cc8df-741d-4a27-920b-3074909635d5 tempest-ProjectReaderTests-90568800 None] Deleting offline snapshot 58817e95-c119-41cd-abe4-835e992b903d of volume b4e686f1-8ae2-4ee0-bf32-f0acb8136abf {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 15:42:28 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-069cc8df-741d-4a27-920b-3074909635d5 tempest-ProjectReaderTests-90568800 None] snapshot_file for this snap is: volume-b4e686f1-8ae2-4ee0-bf32-f0acb8136abf.58817e95-c119-41cd-abe4-835e992b903d {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 15:42:28 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d9a70e0-95ea-4ffb-920c-62b9df16bfaf]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:42:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-069cc8df-741d-4a27-920b-3074909635d5 tempest-ProjectReaderTests-90568800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b4e686f1-8ae2-4ee0-bf32-f0acb8136abf.58817e95-c119-41cd-abe4-835e992b903d {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:28 devstack sudo[108613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b4e686f1-8ae2-4ee0-bf32-f0acb8136abf.58817e95-c119-41cd-abe4-835e992b903d Nov 06 15:42:28 devstack sudo[108613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:28 devstack sudo[108611]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-eace932e-a090-4119-9332-8075754b6f47 tempest-ProjectMemberTests-2050864699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-74282aec-5713-43d0-bb5a-9d7d39164b28 1073741824" returned: 0 in 0.556s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-eace932e-a090-4119-9332-8075754b6f47 tempest-ProjectMemberTests-2050864699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-74282aec-5713-43d0-bb5a-9d7d39164b28 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:28 devstack sudo[108622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-74282aec-5713-43d0-bb5a-9d7d39164b28 Nov 06 15:42:28 devstack sudo[108622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:28 devstack sudo[108613]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-069cc8df-741d-4a27-920b-3074909635d5 tempest-ProjectReaderTests-90568800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b4e686f1-8ae2-4ee0-bf32-f0acb8136abf.58817e95-c119-41cd-abe4-835e992b903d" returned: 0 in 0.459s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:28 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-069cc8df-741d-4a27-920b-3074909635d5 tempest-ProjectReaderTests-90568800 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b4e686f1-8ae2-4ee0-bf32-f0acb8136abf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 15:42:28 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[9258c492-39d1-4f1d-9e6a-a5fcc1d7b6f3]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:42:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-069cc8df-741d-4a27-920b-3074909635d5 tempest-ProjectReaderTests-90568800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b4e686f1-8ae2-4ee0-bf32-f0acb8136abf {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:28 devstack sudo[108624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b4e686f1-8ae2-4ee0-bf32-f0acb8136abf Nov 06 15:42:28 devstack sudo[108624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:29 devstack sudo[108622]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-eace932e-a090-4119-9332-8075754b6f47 tempest-ProjectMemberTests-2050864699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-74282aec-5713-43d0-bb5a-9d7d39164b28" returned: 0 in 0.295s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:29 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-eace932e-a090-4119-9332-8075754b6f47 tempest-ProjectMemberTests-2050864699 None] <== create_volume: return (929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:42:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-eace932e-a090-4119-9332-8075754b6f47 tempest-ProjectMemberTests-2050864699 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.933s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:42:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-eace932e-a090-4119-9332-8075754b6f47 tempest-ProjectMemberTests-2050864699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6969246f-c166-478f-8cce-90ce163df034) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74282aec-5713-43d0-bb5a-9d7d39164b28', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:42:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-eace932e-a090-4119-9332-8075754b6f47 tempest-ProjectMemberTests-2050864699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a206f750-c008-43a8-ad3f-16b03fad641a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:42:29 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-eace932e-a090-4119-9332-8075754b6f47 tempest-ProjectMemberTests-2050864699 None] Volume volume-74282aec-5713-43d0-bb5a-9d7d39164b28 (74282aec-5713-43d0-bb5a-9d7d39164b28): created successfully Nov 06 15:42:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-eace932e-a090-4119-9332-8075754b6f47 tempest-ProjectMemberTests-2050864699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a206f750-c008-43a8-ad3f-16b03fad641a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:42:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-eace932e-a090-4119-9332-8075754b6f47 tempest-ProjectMemberTests-2050864699 None] Flow 'volume_create_manager' (4bb74337-0802-4c7c-bf8e-860a4443d9f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:42:29 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-eace932e-a090-4119-9332-8075754b6f47 tempest-ProjectMemberTests-2050864699 None] Created volume successfully. Nov 06 15:42:29 devstack sudo[108624]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-069cc8df-741d-4a27-920b-3074909635d5 tempest-ProjectReaderTests-90568800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b4e686f1-8ae2-4ee0-bf32-f0acb8136abf" returned: 0 in 0.418s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-069cc8df-741d-4a27-920b-3074909635d5 tempest-ProjectReaderTests-90568800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b4e686f1-8ae2-4ee0-bf32-f0acb8136abf.58817e95-c119-41cd-abe4-835e992b903d {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:29 devstack sudo[108630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b4e686f1-8ae2-4ee0-bf32-f0acb8136abf.58817e95-c119-41cd-abe4-835e992b903d Nov 06 15:42:29 devstack sudo[108630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:29 devstack sudo[108630]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-069cc8df-741d-4a27-920b-3074909635d5 tempest-ProjectReaderTests-90568800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b4e686f1-8ae2-4ee0-bf32-f0acb8136abf.58817e95-c119-41cd-abe4-835e992b903d" returned: 0 in 0.327s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-069cc8df-741d-4a27-920b-3074909635d5 tempest-ProjectReaderTests-90568800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b4e686f1-8ae2-4ee0-bf32-f0acb8136abf.58817e95-c119-41cd-abe4-835e992b903d {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:29 devstack sudo[108635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b4e686f1-8ae2-4ee0-bf32-f0acb8136abf.58817e95-c119-41cd-abe4-835e992b903d Nov 06 15:42:29 devstack sudo[108635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:29 devstack sudo[108635]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-069cc8df-741d-4a27-920b-3074909635d5 tempest-ProjectReaderTests-90568800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b4e686f1-8ae2-4ee0-bf32-f0acb8136abf.58817e95-c119-41cd-abe4-835e992b903d" returned: 0 in 0.238s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:29 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-069cc8df-741d-4a27-920b-3074909635d5 tempest-ProjectReaderTests-90568800 None] Lock "cinder-quobyte-58817e95-c119-41cd-abe4-835e992b903d" released by "_delete_snapshot" :: held 1.564s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:42:29 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-069cc8df-741d-4a27-920b-3074909635d5 tempest-ProjectReaderTests-90568800 None] Lock "cinder-quobyte-b4e686f1-8ae2-4ee0-bf32-f0acb8136abf" released by "delete_snapshot" :: held 1.588s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:42:29 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-069cc8df-741d-4a27-920b-3074909635d5 tempest-ProjectReaderTests-90568800 None] Created reservations ['720a9acc-3776-462d-88bc-29ade79316a2', 'efbae3e5-0469-4c11-b279-cccaa93b45bf', 'ebb61402-a44b-43a6-bfda-88399275bab2', 'f5773fcc-5b5e-4fdc-bc1b-b5c93531ed08'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:42:29 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-069cc8df-741d-4a27-920b-3074909635d5 tempest-ProjectReaderTests-90568800 None] Delete snapshot completed successfully. Nov 06 15:42:29 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-069cc8df-741d-4a27-920b-3074909635d5 tempest-ProjectReaderTests-90568800 None] Lock "cinder-58817e95-c119-41cd-abe4-835e992b903d-delete_snapshot" released by "delete_snapshot" :: held 1.729s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:42:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4d18d049-af8c-4928-8f6e-51b8a86575db tempest-ProjectMemberTests-2050864699 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:42:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4d18d049-af8c-4928-8f6e-51b8a86575db tempest-ProjectMemberTests-2050864699 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:42:30 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-4d18d049-af8c-4928-8f6e-51b8a86575db tempest-ProjectMemberTests-2050864699 None] Creating offline snapshot afa3d481-a86d-4cfc-93a3-1707fb2610f6 of volume 74282aec-5713-43d0-bb5a-9d7d39164b28 {{(pid=87132) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 15:42:30 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[744f4cd3-9328-4667-be75-031a24056023]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:42:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4d18d049-af8c-4928-8f6e-51b8a86575db tempest-ProjectMemberTests-2050864699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-74282aec-5713-43d0-bb5a-9d7d39164b28 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:30 devstack sudo[108638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-74282aec-5713-43d0-bb5a-9d7d39164b28 Nov 06 15:42:30 devstack sudo[108638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:30 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-4c2bf4ab-96db-4fc8-9252-f79ae7892b78 tempest-ProjectReaderTests-90568800 None] Acquiring lock "cinder-b4e686f1-8ae2-4ee0-bf32-f0acb8136abf-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:42:30 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-4c2bf4ab-96db-4fc8-9252-f79ae7892b78 tempest-ProjectReaderTests-90568800 None] Lock "cinder-b4e686f1-8ae2-4ee0-bf32-f0acb8136abf-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:42:30 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-4c2bf4ab-96db-4fc8-9252-f79ae7892b78 tempest-ProjectReaderTests-90568800 None] Acquiring lock "cinder-quobyte-b4e686f1-8ae2-4ee0-bf32-f0acb8136abf" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:42:30 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-4c2bf4ab-96db-4fc8-9252-f79ae7892b78 tempest-ProjectReaderTests-90568800 None] Lock "cinder-quobyte-b4e686f1-8ae2-4ee0-bf32-f0acb8136abf" acquired by "delete_volume" :: waited 0.014s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:42:30 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[665a940e-ffd9-4c56-a653-3f0df30cdff3]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:42:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4c2bf4ab-96db-4fc8-9252-f79ae7892b78 tempest-ProjectReaderTests-90568800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b4e686f1-8ae2-4ee0-bf32-f0acb8136abf {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:30 devstack sudo[108638]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4d18d049-af8c-4928-8f6e-51b8a86575db tempest-ProjectMemberTests-2050864699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-74282aec-5713-43d0-bb5a-9d7d39164b28" returned: 0 in 0.382s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4d18d049-af8c-4928-8f6e-51b8a86575db tempest-ProjectMemberTests-2050864699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-74282aec-5713-43d0-bb5a-9d7d39164b28,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-74282aec-5713-43d0-bb5a-9d7d39164b28.afa3d481-a86d-4cfc-93a3-1707fb2610f6 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:30 devstack sudo[108640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b4e686f1-8ae2-4ee0-bf32-f0acb8136abf Nov 06 15:42:30 devstack sudo[108640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:30 devstack sudo[108644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-74282aec-5713-43d0-bb5a-9d7d39164b28,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-74282aec-5713-43d0-bb5a-9d7d39164b28.afa3d481-a86d-4cfc-93a3-1707fb2610f6 1G Nov 06 15:42:30 devstack sudo[108644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:30 devstack sudo[108640]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4c2bf4ab-96db-4fc8-9252-f79ae7892b78 tempest-ProjectReaderTests-90568800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b4e686f1-8ae2-4ee0-bf32-f0acb8136abf" returned: 0 in 0.381s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4c2bf4ab-96db-4fc8-9252-f79ae7892b78 tempest-ProjectReaderTests-90568800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b4e686f1-8ae2-4ee0-bf32-f0acb8136abf {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:30 devstack sudo[108654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b4e686f1-8ae2-4ee0-bf32-f0acb8136abf Nov 06 15:42:30 devstack sudo[108654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:31 devstack sudo[108644]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4d18d049-af8c-4928-8f6e-51b8a86575db tempest-ProjectMemberTests-2050864699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-74282aec-5713-43d0-bb5a-9d7d39164b28,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-74282aec-5713-43d0-bb5a-9d7d39164b28.afa3d481-a86d-4cfc-93a3-1707fb2610f6 1G" returned: 0 in 0.393s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4d18d049-af8c-4928-8f6e-51b8a86575db tempest-ProjectMemberTests-2050864699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74282aec-5713-43d0-bb5a-9d7d39164b28 -F qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-74282aec-5713-43d0-bb5a-9d7d39164b28.afa3d481-a86d-4cfc-93a3-1707fb2610f6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:31 devstack sudo[108656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74282aec-5713-43d0-bb5a-9d7d39164b28 -F qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-74282aec-5713-43d0-bb5a-9d7d39164b28.afa3d481-a86d-4cfc-93a3-1707fb2610f6 Nov 06 15:42:31 devstack sudo[108656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:31 devstack sudo[108654]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4c2bf4ab-96db-4fc8-9252-f79ae7892b78 tempest-ProjectReaderTests-90568800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-b4e686f1-8ae2-4ee0-bf32-f0acb8136abf" returned: 0 in 0.255s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:31 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-4c2bf4ab-96db-4fc8-9252-f79ae7892b78 tempest-ProjectReaderTests-90568800 None] Lock "cinder-quobyte-b4e686f1-8ae2-4ee0-bf32-f0acb8136abf" released by "delete_volume" :: held 0.709s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:42:31 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-4c2bf4ab-96db-4fc8-9252-f79ae7892b78 tempest-ProjectReaderTests-90568800 None] Created reservations ['c7f3e323-9d08-4cd2-8f81-6bda65f5fb82', 'c7135ebe-a8e0-412b-80bd-d0155240c04f', '4be6e1ce-f27c-4c13-8afd-30e536422994', 'a631f608-19aa-44c6-a5b6-3aa7f4356409'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:42:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4c2bf4ab-96db-4fc8-9252-f79ae7892b78 tempest-ProjectReaderTests-90568800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:42:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4c2bf4ab-96db-4fc8-9252-f79ae7892b78 tempest-ProjectReaderTests-90568800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:42:31 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-4c2bf4ab-96db-4fc8-9252-f79ae7892b78 tempest-ProjectReaderTests-90568800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:42:31 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-4c2bf4ab-96db-4fc8-9252-f79ae7892b78 tempest-ProjectReaderTests-90568800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:42:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4c2bf4ab-96db-4fc8-9252-f79ae7892b78 tempest-ProjectReaderTests-90568800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:42:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4c2bf4ab-96db-4fc8-9252-f79ae7892b78 tempest-ProjectReaderTests-90568800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:31 devstack sudo[108662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:42:31 devstack sudo[108656]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:31 devstack sudo[108662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4d18d049-af8c-4928-8f6e-51b8a86575db tempest-ProjectMemberTests-2050864699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74282aec-5713-43d0-bb5a-9d7d39164b28 -F qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-74282aec-5713-43d0-bb5a-9d7d39164b28.afa3d481-a86d-4cfc-93a3-1707fb2610f6" returned: 0 in 0.308s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:31 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-4d18d049-af8c-4928-8f6e-51b8a86575db tempest-ProjectMemberTests-2050864699 None] /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-74282aec-5713-43d0-bb5a-9d7d39164b28.afa3d481-a86d-4cfc-93a3-1707fb2610f6 is being set with open permissions: ugo+rw Nov 06 15:42:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4d18d049-af8c-4928-8f6e-51b8a86575db tempest-ProjectMemberTests-2050864699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-74282aec-5713-43d0-bb5a-9d7d39164b28.afa3d481-a86d-4cfc-93a3-1707fb2610f6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:31 devstack sudo[108664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-74282aec-5713-43d0-bb5a-9d7d39164b28.afa3d481-a86d-4cfc-93a3-1707fb2610f6 Nov 06 15:42:31 devstack sudo[108664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:31 devstack sudo[108662]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4c2bf4ab-96db-4fc8-9252-f79ae7892b78 tempest-ProjectReaderTests-90568800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.258s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:31 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-4c2bf4ab-96db-4fc8-9252-f79ae7892b78 tempest-ProjectReaderTests-90568800 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:42:31 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-4c2bf4ab-96db-4fc8-9252-f79ae7892b78 tempest-ProjectReaderTests-90568800 None] Deleted volume successfully. Nov 06 15:42:31 devstack sudo[108664]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4d18d049-af8c-4928-8f6e-51b8a86575db tempest-ProjectMemberTests-2050864699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-74282aec-5713-43d0-bb5a-9d7d39164b28.afa3d481-a86d-4cfc-93a3-1707fb2610f6" returned: 0 in 0.260s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:31 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-4c2bf4ab-96db-4fc8-9252-f79ae7892b78 tempest-ProjectReaderTests-90568800 None] Lock "cinder-b4e686f1-8ae2-4ee0-bf32-f0acb8136abf-delete_volume" released by "delete_volume" :: held 1.193s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:42:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4d18d049-af8c-4928-8f6e-51b8a86575db tempest-ProjectMemberTests-2050864699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-74282aec-5713-43d0-bb5a-9d7d39164b28.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:31 devstack sudo[108668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-74282aec-5713-43d0-bb5a-9d7d39164b28.info Nov 06 15:42:31 devstack sudo[108668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:31 devstack sudo[108668]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4d18d049-af8c-4928-8f6e-51b8a86575db tempest-ProjectMemberTests-2050864699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-74282aec-5713-43d0-bb5a-9d7d39164b28.info" returned: 0 in 0.271s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:31 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-4d18d049-af8c-4928-8f6e-51b8a86575db tempest-ProjectMemberTests-2050864699 None] /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-74282aec-5713-43d0-bb5a-9d7d39164b28.info is being set with open permissions: ugo+rw Nov 06 15:42:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4d18d049-af8c-4928-8f6e-51b8a86575db tempest-ProjectMemberTests-2050864699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-74282aec-5713-43d0-bb5a-9d7d39164b28.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:31 devstack sudo[108671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-74282aec-5713-43d0-bb5a-9d7d39164b28.info Nov 06 15:42:31 devstack sudo[108671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:32 devstack sudo[108671]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4d18d049-af8c-4928-8f6e-51b8a86575db tempest-ProjectMemberTests-2050864699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-74282aec-5713-43d0-bb5a-9d7d39164b28.info" returned: 0 in 0.256s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4d18d049-af8c-4928-8f6e-51b8a86575db tempest-ProjectMemberTests-2050864699 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.961s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:42:32 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-4d18d049-af8c-4928-8f6e-51b8a86575db tempest-ProjectMemberTests-2050864699 None] Create snapshot completed successfully Nov 06 15:42:32 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-88e171b1-061e-413c-816a-3f8f18b633cd tempest-ProjectMemberTests-2050864699 None] Acquiring lock "cinder-afa3d481-a86d-4cfc-93a3-1707fb2610f6-delete_snapshot" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:42:32 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-88e171b1-061e-413c-816a-3f8f18b633cd tempest-ProjectMemberTests-2050864699 None] Lock "cinder-afa3d481-a86d-4cfc-93a3-1707fb2610f6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:42:32 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-88e171b1-061e-413c-816a-3f8f18b633cd tempest-ProjectMemberTests-2050864699 None] Acquiring lock "cinder-quobyte-74282aec-5713-43d0-bb5a-9d7d39164b28" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:42:32 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-88e171b1-061e-413c-816a-3f8f18b633cd tempest-ProjectMemberTests-2050864699 None] Lock "cinder-quobyte-74282aec-5713-43d0-bb5a-9d7d39164b28" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:42:32 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-88e171b1-061e-413c-816a-3f8f18b633cd tempest-ProjectMemberTests-2050864699 None] Acquiring lock "cinder-quobyte-afa3d481-a86d-4cfc-93a3-1707fb2610f6" by "_delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:42:32 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-88e171b1-061e-413c-816a-3f8f18b633cd tempest-ProjectMemberTests-2050864699 None] Lock "cinder-quobyte-afa3d481-a86d-4cfc-93a3-1707fb2610f6" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:42:32 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-88e171b1-061e-413c-816a-3f8f18b633cd tempest-ProjectMemberTests-2050864699 None] Deleting offline snapshot afa3d481-a86d-4cfc-93a3-1707fb2610f6 of volume 74282aec-5713-43d0-bb5a-9d7d39164b28 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 15:42:32 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-88e171b1-061e-413c-816a-3f8f18b633cd tempest-ProjectMemberTests-2050864699 None] snapshot_file for this snap is: volume-74282aec-5713-43d0-bb5a-9d7d39164b28.afa3d481-a86d-4cfc-93a3-1707fb2610f6 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 15:42:32 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[319d9cb2-5cdd-447c-a7ad-6f0d231ebd6a]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:42:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-88e171b1-061e-413c-816a-3f8f18b633cd tempest-ProjectMemberTests-2050864699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-74282aec-5713-43d0-bb5a-9d7d39164b28.afa3d481-a86d-4cfc-93a3-1707fb2610f6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:32 devstack sudo[108674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-74282aec-5713-43d0-bb5a-9d7d39164b28.afa3d481-a86d-4cfc-93a3-1707fb2610f6 Nov 06 15:42:32 devstack sudo[108674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:32 devstack sudo[108674]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-88e171b1-061e-413c-816a-3f8f18b633cd tempest-ProjectMemberTests-2050864699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-74282aec-5713-43d0-bb5a-9d7d39164b28.afa3d481-a86d-4cfc-93a3-1707fb2610f6" returned: 0 in 0.393s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:32 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-88e171b1-061e-413c-816a-3f8f18b633cd tempest-ProjectMemberTests-2050864699 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-74282aec-5713-43d0-bb5a-9d7d39164b28(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 15:42:32 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[10bc1010-38d0-48c5-89c6-6010c084ac54]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:42:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-88e171b1-061e-413c-816a-3f8f18b633cd tempest-ProjectMemberTests-2050864699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-74282aec-5713-43d0-bb5a-9d7d39164b28 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:33 devstack sudo[108679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-74282aec-5713-43d0-bb5a-9d7d39164b28 Nov 06 15:42:33 devstack sudo[108679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:33 devstack sudo[108679]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-88e171b1-061e-413c-816a-3f8f18b633cd tempest-ProjectMemberTests-2050864699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-74282aec-5713-43d0-bb5a-9d7d39164b28" returned: 0 in 0.391s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-88e171b1-061e-413c-816a-3f8f18b633cd tempest-ProjectMemberTests-2050864699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-74282aec-5713-43d0-bb5a-9d7d39164b28.afa3d481-a86d-4cfc-93a3-1707fb2610f6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:33 devstack sudo[108684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-74282aec-5713-43d0-bb5a-9d7d39164b28.afa3d481-a86d-4cfc-93a3-1707fb2610f6 Nov 06 15:42:33 devstack sudo[108684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:33 devstack sudo[108684]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-88e171b1-061e-413c-816a-3f8f18b633cd tempest-ProjectMemberTests-2050864699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-74282aec-5713-43d0-bb5a-9d7d39164b28.afa3d481-a86d-4cfc-93a3-1707fb2610f6" returned: 0 in 0.354s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-88e171b1-061e-413c-816a-3f8f18b633cd tempest-ProjectMemberTests-2050864699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-74282aec-5713-43d0-bb5a-9d7d39164b28.afa3d481-a86d-4cfc-93a3-1707fb2610f6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:33 devstack sudo[108690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-74282aec-5713-43d0-bb5a-9d7d39164b28.afa3d481-a86d-4cfc-93a3-1707fb2610f6 Nov 06 15:42:33 devstack sudo[108690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:33 devstack sudo[108690]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-88e171b1-061e-413c-816a-3f8f18b633cd tempest-ProjectMemberTests-2050864699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-74282aec-5713-43d0-bb5a-9d7d39164b28.afa3d481-a86d-4cfc-93a3-1707fb2610f6" returned: 0 in 0.265s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:33 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-88e171b1-061e-413c-816a-3f8f18b633cd tempest-ProjectMemberTests-2050864699 None] Lock "cinder-quobyte-afa3d481-a86d-4cfc-93a3-1707fb2610f6" released by "_delete_snapshot" :: held 1.540s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:42:33 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-88e171b1-061e-413c-816a-3f8f18b633cd tempest-ProjectMemberTests-2050864699 None] Lock "cinder-quobyte-74282aec-5713-43d0-bb5a-9d7d39164b28" released by "delete_snapshot" :: held 1.564s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:42:34 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-88e171b1-061e-413c-816a-3f8f18b633cd tempest-ProjectMemberTests-2050864699 None] Created reservations ['94856b11-97f0-4f16-b906-a895917f4723', '86137657-7517-403f-9b91-dbc2e70ee988', '82b29336-c315-446e-b628-674f26d7d652', '55e41fdc-787e-4e72-bd76-1d1fe0abf44a'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:42:34 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-88e171b1-061e-413c-816a-3f8f18b633cd tempest-ProjectMemberTests-2050864699 None] Delete snapshot completed successfully. Nov 06 15:42:34 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-88e171b1-061e-413c-816a-3f8f18b633cd tempest-ProjectMemberTests-2050864699 None] Lock "cinder-afa3d481-a86d-4cfc-93a3-1707fb2610f6-delete_snapshot" released by "delete_snapshot" :: held 1.706s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:42:34 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d3e1590b-4fb5-44d0-8ed1-286f37e3a424 tempest-ProjectMemberTests-2050864699 None] Acquiring lock "cinder-74282aec-5713-43d0-bb5a-9d7d39164b28-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:42:34 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d3e1590b-4fb5-44d0-8ed1-286f37e3a424 tempest-ProjectMemberTests-2050864699 None] Lock "cinder-74282aec-5713-43d0-bb5a-9d7d39164b28-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:42:34 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d3e1590b-4fb5-44d0-8ed1-286f37e3a424 tempest-ProjectMemberTests-2050864699 None] Acquiring lock "cinder-quobyte-74282aec-5713-43d0-bb5a-9d7d39164b28" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:42:34 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d3e1590b-4fb5-44d0-8ed1-286f37e3a424 tempest-ProjectMemberTests-2050864699 None] Lock "cinder-quobyte-74282aec-5713-43d0-bb5a-9d7d39164b28" acquired by "delete_volume" :: waited 0.021s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:42:34 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ef87eef-03c2-4c47-997a-76f8234054b5]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:42:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d3e1590b-4fb5-44d0-8ed1-286f37e3a424 tempest-ProjectMemberTests-2050864699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-74282aec-5713-43d0-bb5a-9d7d39164b28 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:34 devstack sudo[108693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-74282aec-5713-43d0-bb5a-9d7d39164b28 Nov 06 15:42:34 devstack sudo[108693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:35 devstack sudo[108693]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d3e1590b-4fb5-44d0-8ed1-286f37e3a424 tempest-ProjectMemberTests-2050864699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-74282aec-5713-43d0-bb5a-9d7d39164b28" returned: 0 in 0.382s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d3e1590b-4fb5-44d0-8ed1-286f37e3a424 tempest-ProjectMemberTests-2050864699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-74282aec-5713-43d0-bb5a-9d7d39164b28 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:35 devstack sudo[108698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-74282aec-5713-43d0-bb5a-9d7d39164b28 Nov 06 15:42:35 devstack sudo[108698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:35 devstack sudo[108698]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d3e1590b-4fb5-44d0-8ed1-286f37e3a424 tempest-ProjectMemberTests-2050864699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-74282aec-5713-43d0-bb5a-9d7d39164b28" returned: 0 in 0.275s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:35 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd781b80-aefb-4170-8be9-66b1daa444ac tempest-ProjectReaderTests-1199396164 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:42:35 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fd781b80-aefb-4170-8be9-66b1daa444ac tempest-ProjectReaderTests-1199396164 None] Flow 'volume_create_manager' (0a344355-3cf5-4b02-ac36-4f4300671d0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:42:35 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fd781b80-aefb-4170-8be9-66b1daa444ac tempest-ProjectReaderTests-1199396164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1951a35b-6b32-42fa-9c4e-44973cd40276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:42:35 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d3e1590b-4fb5-44d0-8ed1-286f37e3a424 tempest-ProjectMemberTests-2050864699 None] Lock "cinder-quobyte-74282aec-5713-43d0-bb5a-9d7d39164b28" released by "delete_volume" :: held 0.773s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:42:35 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fd781b80-aefb-4170-8be9-66b1daa444ac tempest-ProjectReaderTests-1199396164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1951a35b-6b32-42fa-9c4e-44973cd40276) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:42:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1002268914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7dd75060-cc60-4e42-a2a5-45c8e7748300,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a15ba4fbd1f143069407ec14dd90261e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:42:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:42:35Z,use_quota=True,user_id='99c650aea30241018dc22dac9240097c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:42:35 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fd781b80-aefb-4170-8be9-66b1daa444ac tempest-ProjectReaderTests-1199396164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a8f3893-cdad-44ca-81d8-33dc6baa3b0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:42:35 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fd781b80-aefb-4170-8be9-66b1daa444ac tempest-ProjectReaderTests-1199396164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a8f3893-cdad-44ca-81d8-33dc6baa3b0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:42:35 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fd781b80-aefb-4170-8be9-66b1daa444ac tempest-ProjectReaderTests-1199396164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (daa6fcd7-a026-4762-af07-d3a313c65a2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:42:35 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fd781b80-aefb-4170-8be9-66b1daa444ac tempest-ProjectReaderTests-1199396164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (daa6fcd7-a026-4762-af07-d3a313c65a2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7dd75060-cc60-4e42-a2a5-45c8e7748300', 'volume_name': 'volume-7dd75060-cc60-4e42-a2a5-45c8e7748300', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:42:35 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fd781b80-aefb-4170-8be9-66b1daa444ac tempest-ProjectReaderTests-1199396164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93be7359-28a1-4e73-b843-921f33251562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:42:35 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fd781b80-aefb-4170-8be9-66b1daa444ac tempest-ProjectReaderTests-1199396164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93be7359-28a1-4e73-b843-921f33251562) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:42:35 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fd781b80-aefb-4170-8be9-66b1daa444ac tempest-ProjectReaderTests-1199396164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0fb5bae-79c9-4b4d-a815-41ca02a064ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:42:35 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-fd781b80-aefb-4170-8be9-66b1daa444ac tempest-ProjectReaderTests-1199396164 None] Volume 7dd75060-cc60-4e42-a2a5-45c8e7748300: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7dd75060-cc60-4e42-a2a5-45c8e7748300', 'volume_size': 1} Nov 06 15:42:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-fd781b80-aefb-4170-8be9-66b1daa444ac tempest-ProjectReaderTests-1199396164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:42:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-fd781b80-aefb-4170-8be9-66b1daa444ac tempest-ProjectReaderTests-1199396164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:42:35 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-fd781b80-aefb-4170-8be9-66b1daa444ac tempest-ProjectReaderTests-1199396164 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:42:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1002268914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7dd75060-cc60-4e42-a2a5-45c8e7748300,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a15ba4fbd1f143069407ec14dd90261e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:42:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:42:35Z,use_quota=True,user_id='99c650aea30241018dc22dac9240097c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:42:35 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-fd781b80-aefb-4170-8be9-66b1daa444ac tempest-ProjectReaderTests-1199396164 None] Creating volume 7dd75060-cc60-4e42-a2a5-45c8e7748300 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:42:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-fd781b80-aefb-4170-8be9-66b1daa444ac tempest-ProjectReaderTests-1199396164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:42:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-fd781b80-aefb-4170-8be9-66b1daa444ac tempest-ProjectReaderTests-1199396164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:42:35 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-fd781b80-aefb-4170-8be9-66b1daa444ac tempest-ProjectReaderTests-1199396164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:42:35 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-fd781b80-aefb-4170-8be9-66b1daa444ac tempest-ProjectReaderTests-1199396164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:42:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-fd781b80-aefb-4170-8be9-66b1daa444ac tempest-ProjectReaderTests-1199396164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:42:35 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-fd781b80-aefb-4170-8be9-66b1daa444ac tempest-ProjectReaderTests-1199396164 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:42:35 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-fd781b80-aefb-4170-8be9-66b1daa444ac tempest-ProjectReaderTests-1199396164 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:42:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-fd781b80-aefb-4170-8be9-66b1daa444ac tempest-ProjectReaderTests-1199396164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-7dd75060-cc60-4e42-a2a5-45c8e7748300 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:35 devstack sudo[108701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-7dd75060-cc60-4e42-a2a5-45c8e7748300 1073741824 Nov 06 15:42:35 devstack sudo[108701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:35 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-d3e1590b-4fb5-44d0-8ed1-286f37e3a424 tempest-ProjectMemberTests-2050864699 None] Created reservations ['6a436aa5-3eb6-40f9-ab9b-d02a242acf8b', '307960c6-7e71-4d2a-96e0-b8759a509ff9', '1db12e0f-2191-4953-8e49-57ba8519cab8', 'bcf641f6-8c97-4941-9065-9edc11d89e5e'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:42:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-d3e1590b-4fb5-44d0-8ed1-286f37e3a424 tempest-ProjectMemberTests-2050864699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:42:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-d3e1590b-4fb5-44d0-8ed1-286f37e3a424 tempest-ProjectMemberTests-2050864699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:42:35 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-d3e1590b-4fb5-44d0-8ed1-286f37e3a424 tempest-ProjectMemberTests-2050864699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:42:35 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-d3e1590b-4fb5-44d0-8ed1-286f37e3a424 tempest-ProjectMemberTests-2050864699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:42:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-d3e1590b-4fb5-44d0-8ed1-286f37e3a424 tempest-ProjectMemberTests-2050864699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:42:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d3e1590b-4fb5-44d0-8ed1-286f37e3a424 tempest-ProjectMemberTests-2050864699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:35 devstack sudo[108703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:42:35 devstack sudo[108703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:35 devstack sudo[108703]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d3e1590b-4fb5-44d0-8ed1-286f37e3a424 tempest-ProjectMemberTests-2050864699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.287s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:35 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-d3e1590b-4fb5-44d0-8ed1-286f37e3a424 tempest-ProjectMemberTests-2050864699 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:42:35 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-d3e1590b-4fb5-44d0-8ed1-286f37e3a424 tempest-ProjectMemberTests-2050864699 None] Deleted volume successfully. Nov 06 15:42:35 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d3e1590b-4fb5-44d0-8ed1-286f37e3a424 tempest-ProjectMemberTests-2050864699 None] Lock "cinder-74282aec-5713-43d0-bb5a-9d7d39164b28-delete_volume" released by "delete_volume" :: held 1.335s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:42:35 devstack sudo[108701]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-fd781b80-aefb-4170-8be9-66b1daa444ac tempest-ProjectReaderTests-1199396164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-7dd75060-cc60-4e42-a2a5-45c8e7748300 1073741824" returned: 0 in 0.485s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-fd781b80-aefb-4170-8be9-66b1daa444ac tempest-ProjectReaderTests-1199396164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-7dd75060-cc60-4e42-a2a5-45c8e7748300 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:36 devstack sudo[108710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-7dd75060-cc60-4e42-a2a5-45c8e7748300 Nov 06 15:42:36 devstack sudo[108710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:36 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-bebda82a-fa00-4d4a-bdd7-5360c8db4a6c tempest-ProjectMemberTests-2050864699 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:42:36 devstack sudo[108710]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-bebda82a-fa00-4d4a-bdd7-5360c8db4a6c tempest-ProjectMemberTests-2050864699 None] Flow 'volume_create_manager' (6327ec95-f264-41d1-bf46-1e7b74639503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:42:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-bebda82a-fa00-4d4a-bdd7-5360c8db4a6c tempest-ProjectMemberTests-2050864699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c59fb70b-b2a5-4a2e-b2ad-f5325f2ab838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:42:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-fd781b80-aefb-4170-8be9-66b1daa444ac tempest-ProjectReaderTests-1199396164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-7dd75060-cc60-4e42-a2a5-45c8e7748300" returned: 0 in 0.281s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:36 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-fd781b80-aefb-4170-8be9-66b1daa444ac tempest-ProjectReaderTests-1199396164 None] <== create_volume: return (809ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:42:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-fd781b80-aefb-4170-8be9-66b1daa444ac tempest-ProjectReaderTests-1199396164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.812s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:42:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-bebda82a-fa00-4d4a-bdd7-5360c8db4a6c tempest-ProjectMemberTests-2050864699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c59fb70b-b2a5-4a2e-b2ad-f5325f2ab838) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:42:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-167134856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0cf8ce6-36e9-4fed-ad09-125ad598bc9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='631b1acb2fe74ff38bf682df0fb94c26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:42:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:42:36Z,use_quota=True,user_id='c2ab5a7c9b61494492f0f3bd6193ebdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:42:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-bebda82a-fa00-4d4a-bdd7-5360c8db4a6c tempest-ProjectMemberTests-2050864699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21b4910b-28ef-474f-bd59-9125f43a79c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:42:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-bebda82a-fa00-4d4a-bdd7-5360c8db4a6c tempest-ProjectMemberTests-2050864699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21b4910b-28ef-474f-bd59-9125f43a79c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:42:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-bebda82a-fa00-4d4a-bdd7-5360c8db4a6c tempest-ProjectMemberTests-2050864699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ed39d99-9804-4b72-8cec-e052001c58e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:42:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-bebda82a-fa00-4d4a-bdd7-5360c8db4a6c tempest-ProjectMemberTests-2050864699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ed39d99-9804-4b72-8cec-e052001c58e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0cf8ce6-36e9-4fed-ad09-125ad598bc9c', 'volume_name': 'volume-f0cf8ce6-36e9-4fed-ad09-125ad598bc9c', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:42:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-bebda82a-fa00-4d4a-bdd7-5360c8db4a6c tempest-ProjectMemberTests-2050864699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80c369cf-3421-4a75-aeb6-ba87ded6b87b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:42:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-bebda82a-fa00-4d4a-bdd7-5360c8db4a6c tempest-ProjectMemberTests-2050864699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80c369cf-3421-4a75-aeb6-ba87ded6b87b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:42:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-bebda82a-fa00-4d4a-bdd7-5360c8db4a6c tempest-ProjectMemberTests-2050864699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2a3250d-37d6-4c2d-98fa-d94c8f60fab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:42:36 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-bebda82a-fa00-4d4a-bdd7-5360c8db4a6c tempest-ProjectMemberTests-2050864699 None] Volume f0cf8ce6-36e9-4fed-ad09-125ad598bc9c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0cf8ce6-36e9-4fed-ad09-125ad598bc9c', 'volume_size': 1} Nov 06 15:42:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-bebda82a-fa00-4d4a-bdd7-5360c8db4a6c tempest-ProjectMemberTests-2050864699 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:42:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-bebda82a-fa00-4d4a-bdd7-5360c8db4a6c tempest-ProjectMemberTests-2050864699 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:42:36 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-bebda82a-fa00-4d4a-bdd7-5360c8db4a6c tempest-ProjectMemberTests-2050864699 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:42:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-167134856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0cf8ce6-36e9-4fed-ad09-125ad598bc9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='631b1acb2fe74ff38bf682df0fb94c26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:42:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:42:36Z,use_quota=True,user_id='c2ab5a7c9b61494492f0f3bd6193ebdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:42:36 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-bebda82a-fa00-4d4a-bdd7-5360c8db4a6c tempest-ProjectMemberTests-2050864699 None] Creating volume f0cf8ce6-36e9-4fed-ad09-125ad598bc9c {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:42:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-bebda82a-fa00-4d4a-bdd7-5360c8db4a6c tempest-ProjectMemberTests-2050864699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:42:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-bebda82a-fa00-4d4a-bdd7-5360c8db4a6c tempest-ProjectMemberTests-2050864699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:42:36 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-bebda82a-fa00-4d4a-bdd7-5360c8db4a6c tempest-ProjectMemberTests-2050864699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:42:36 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-bebda82a-fa00-4d4a-bdd7-5360c8db4a6c tempest-ProjectMemberTests-2050864699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:42:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-bebda82a-fa00-4d4a-bdd7-5360c8db4a6c tempest-ProjectMemberTests-2050864699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:42:36 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-bebda82a-fa00-4d4a-bdd7-5360c8db4a6c tempest-ProjectMemberTests-2050864699 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:42:36 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-bebda82a-fa00-4d4a-bdd7-5360c8db4a6c tempest-ProjectMemberTests-2050864699 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:42:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bebda82a-fa00-4d4a-bdd7-5360c8db4a6c tempest-ProjectMemberTests-2050864699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f0cf8ce6-36e9-4fed-ad09-125ad598bc9c 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fd781b80-aefb-4170-8be9-66b1daa444ac tempest-ProjectReaderTests-1199396164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0fb5bae-79c9-4b4d-a815-41ca02a064ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7dd75060-cc60-4e42-a2a5-45c8e7748300', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:42:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fd781b80-aefb-4170-8be9-66b1daa444ac tempest-ProjectReaderTests-1199396164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e731c02-9c99-450f-b429-e308fd8b5f37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:42:36 devstack sudo[108713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f0cf8ce6-36e9-4fed-ad09-125ad598bc9c 1073741824 Nov 06 15:42:36 devstack sudo[108713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:36 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-fd781b80-aefb-4170-8be9-66b1daa444ac tempest-ProjectReaderTests-1199396164 None] Volume volume-7dd75060-cc60-4e42-a2a5-45c8e7748300 (7dd75060-cc60-4e42-a2a5-45c8e7748300): created successfully Nov 06 15:42:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fd781b80-aefb-4170-8be9-66b1daa444ac tempest-ProjectReaderTests-1199396164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e731c02-9c99-450f-b429-e308fd8b5f37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:42:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fd781b80-aefb-4170-8be9-66b1daa444ac tempest-ProjectReaderTests-1199396164 None] Flow 'volume_create_manager' (0a344355-3cf5-4b02-ac36-4f4300671d0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:42:36 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-fd781b80-aefb-4170-8be9-66b1daa444ac tempest-ProjectReaderTests-1199396164 None] Created volume successfully. Nov 06 15:42:36 devstack sudo[108713]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bebda82a-fa00-4d4a-bdd7-5360c8db4a6c tempest-ProjectMemberTests-2050864699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f0cf8ce6-36e9-4fed-ad09-125ad598bc9c 1073741824" returned: 0 in 0.415s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bebda82a-fa00-4d4a-bdd7-5360c8db4a6c tempest-ProjectMemberTests-2050864699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f0cf8ce6-36e9-4fed-ad09-125ad598bc9c {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:36 devstack sudo[108720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f0cf8ce6-36e9-4fed-ad09-125ad598bc9c Nov 06 15:42:36 devstack sudo[108720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:37 devstack sudo[108720]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bebda82a-fa00-4d4a-bdd7-5360c8db4a6c tempest-ProjectMemberTests-2050864699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f0cf8ce6-36e9-4fed-ad09-125ad598bc9c" returned: 0 in 0.249s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:37 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-bebda82a-fa00-4d4a-bdd7-5360c8db4a6c tempest-ProjectMemberTests-2050864699 None] <== create_volume: return (699ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:42:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-bebda82a-fa00-4d4a-bdd7-5360c8db4a6c tempest-ProjectMemberTests-2050864699 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.702s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:42:37 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-bebda82a-fa00-4d4a-bdd7-5360c8db4a6c tempest-ProjectMemberTests-2050864699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2a3250d-37d6-4c2d-98fa-d94c8f60fab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0cf8ce6-36e9-4fed-ad09-125ad598bc9c', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:42:37 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-bebda82a-fa00-4d4a-bdd7-5360c8db4a6c tempest-ProjectMemberTests-2050864699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29b5560e-f407-4ef7-b107-8b06d7d54e50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:42:37 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-bebda82a-fa00-4d4a-bdd7-5360c8db4a6c tempest-ProjectMemberTests-2050864699 None] Volume volume-f0cf8ce6-36e9-4fed-ad09-125ad598bc9c (f0cf8ce6-36e9-4fed-ad09-125ad598bc9c): created successfully Nov 06 15:42:37 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-bebda82a-fa00-4d4a-bdd7-5360c8db4a6c tempest-ProjectMemberTests-2050864699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29b5560e-f407-4ef7-b107-8b06d7d54e50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:42:37 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-bebda82a-fa00-4d4a-bdd7-5360c8db4a6c tempest-ProjectMemberTests-2050864699 None] Flow 'volume_create_manager' (6327ec95-f264-41d1-bf46-1e7b74639503) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:42:37 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-bebda82a-fa00-4d4a-bdd7-5360c8db4a6c tempest-ProjectMemberTests-2050864699 None] Created volume successfully. Nov 06 15:42:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-2a7a0aaa-297a-4069-9add-c667a7754110 tempest-ProjectMemberTests-2050864699 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:42:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-2a7a0aaa-297a-4069-9add-c667a7754110 tempest-ProjectMemberTests-2050864699 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:42:37 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-2a7a0aaa-297a-4069-9add-c667a7754110 tempest-ProjectMemberTests-2050864699 None] Creating offline snapshot 40f21451-2aa4-4039-a466-597ca8d851be of volume f0cf8ce6-36e9-4fed-ad09-125ad598bc9c {{(pid=87132) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 15:42:37 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb652c5d-7a79-4568-b94c-e0bd6870159e]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:42:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2a7a0aaa-297a-4069-9add-c667a7754110 tempest-ProjectMemberTests-2050864699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f0cf8ce6-36e9-4fed-ad09-125ad598bc9c {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:37 devstack sudo[108723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f0cf8ce6-36e9-4fed-ad09-125ad598bc9c Nov 06 15:42:37 devstack sudo[108723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:37 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-53ae171f-6f8d-459c-a12a-deed69ea99ca tempest-ProjectReaderTests-1199396164 None] Acquiring lock "cinder-7dd75060-cc60-4e42-a2a5-45c8e7748300-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:42:37 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-53ae171f-6f8d-459c-a12a-deed69ea99ca tempest-ProjectReaderTests-1199396164 None] Lock "cinder-7dd75060-cc60-4e42-a2a5-45c8e7748300-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:42:37 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-53ae171f-6f8d-459c-a12a-deed69ea99ca tempest-ProjectReaderTests-1199396164 None] Acquiring lock "cinder-quobyte-7dd75060-cc60-4e42-a2a5-45c8e7748300" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:42:37 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-53ae171f-6f8d-459c-a12a-deed69ea99ca tempest-ProjectReaderTests-1199396164 None] Lock "cinder-quobyte-7dd75060-cc60-4e42-a2a5-45c8e7748300" acquired by "delete_volume" :: waited 0.014s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:42:37 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fad8967-030a-4d9a-9beb-0a66f85512af]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:42:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-53ae171f-6f8d-459c-a12a-deed69ea99ca tempest-ProjectReaderTests-1199396164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-7dd75060-cc60-4e42-a2a5-45c8e7748300 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:37 devstack sudo[108723]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2a7a0aaa-297a-4069-9add-c667a7754110 tempest-ProjectMemberTests-2050864699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f0cf8ce6-36e9-4fed-ad09-125ad598bc9c" returned: 0 in 0.404s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2a7a0aaa-297a-4069-9add-c667a7754110 tempest-ProjectMemberTests-2050864699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f0cf8ce6-36e9-4fed-ad09-125ad598bc9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f0cf8ce6-36e9-4fed-ad09-125ad598bc9c.40f21451-2aa4-4039-a466-597ca8d851be 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:37 devstack sudo[108725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-7dd75060-cc60-4e42-a2a5-45c8e7748300 Nov 06 15:42:37 devstack sudo[108725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:37 devstack sudo[108729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f0cf8ce6-36e9-4fed-ad09-125ad598bc9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f0cf8ce6-36e9-4fed-ad09-125ad598bc9c.40f21451-2aa4-4039-a466-597ca8d851be 1G Nov 06 15:42:37 devstack sudo[108729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:38 devstack sudo[108725]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-53ae171f-6f8d-459c-a12a-deed69ea99ca tempest-ProjectReaderTests-1199396164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-7dd75060-cc60-4e42-a2a5-45c8e7748300" returned: 0 in 0.384s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-53ae171f-6f8d-459c-a12a-deed69ea99ca tempest-ProjectReaderTests-1199396164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-7dd75060-cc60-4e42-a2a5-45c8e7748300 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:38 devstack sudo[108738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-7dd75060-cc60-4e42-a2a5-45c8e7748300 Nov 06 15:42:38 devstack sudo[108738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:38 devstack sudo[108729]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2a7a0aaa-297a-4069-9add-c667a7754110 tempest-ProjectMemberTests-2050864699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f0cf8ce6-36e9-4fed-ad09-125ad598bc9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f0cf8ce6-36e9-4fed-ad09-125ad598bc9c.40f21451-2aa4-4039-a466-597ca8d851be 1G" returned: 0 in 0.415s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2a7a0aaa-297a-4069-9add-c667a7754110 tempest-ProjectMemberTests-2050864699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0cf8ce6-36e9-4fed-ad09-125ad598bc9c -F qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f0cf8ce6-36e9-4fed-ad09-125ad598bc9c.40f21451-2aa4-4039-a466-597ca8d851be {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:38 devstack sudo[108741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0cf8ce6-36e9-4fed-ad09-125ad598bc9c -F qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f0cf8ce6-36e9-4fed-ad09-125ad598bc9c.40f21451-2aa4-4039-a466-597ca8d851be Nov 06 15:42:38 devstack sudo[108741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:38 devstack sudo[108738]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-53ae171f-6f8d-459c-a12a-deed69ea99ca tempest-ProjectReaderTests-1199396164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-7dd75060-cc60-4e42-a2a5-45c8e7748300" returned: 0 in 0.257s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:38 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-53ae171f-6f8d-459c-a12a-deed69ea99ca tempest-ProjectReaderTests-1199396164 None] Lock "cinder-quobyte-7dd75060-cc60-4e42-a2a5-45c8e7748300" released by "delete_volume" :: held 0.697s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:42:38 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-53ae171f-6f8d-459c-a12a-deed69ea99ca tempest-ProjectReaderTests-1199396164 None] Created reservations ['bba5ed62-9aa1-4898-8ef5-c976c80fcdf9', 'd5e27824-2e93-4958-8b92-e5ad8ca53cac', 'cc716ec4-da4f-4e5d-86dd-956ae19f0c85', 'cfd87b74-35d4-4889-9f9a-e2a5c7fe4fc3'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:42:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-53ae171f-6f8d-459c-a12a-deed69ea99ca tempest-ProjectReaderTests-1199396164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:42:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-53ae171f-6f8d-459c-a12a-deed69ea99ca tempest-ProjectReaderTests-1199396164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:42:38 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-53ae171f-6f8d-459c-a12a-deed69ea99ca tempest-ProjectReaderTests-1199396164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:42:38 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-53ae171f-6f8d-459c-a12a-deed69ea99ca tempest-ProjectReaderTests-1199396164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:42:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-53ae171f-6f8d-459c-a12a-deed69ea99ca tempest-ProjectReaderTests-1199396164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:42:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-53ae171f-6f8d-459c-a12a-deed69ea99ca tempest-ProjectReaderTests-1199396164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:38 devstack sudo[108741]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2a7a0aaa-297a-4069-9add-c667a7754110 tempest-ProjectMemberTests-2050864699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0cf8ce6-36e9-4fed-ad09-125ad598bc9c -F qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f0cf8ce6-36e9-4fed-ad09-125ad598bc9c.40f21451-2aa4-4039-a466-597ca8d851be" returned: 0 in 0.302s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:38 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-2a7a0aaa-297a-4069-9add-c667a7754110 tempest-ProjectMemberTests-2050864699 None] /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f0cf8ce6-36e9-4fed-ad09-125ad598bc9c.40f21451-2aa4-4039-a466-597ca8d851be is being set with open permissions: ugo+rw Nov 06 15:42:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2a7a0aaa-297a-4069-9add-c667a7754110 tempest-ProjectMemberTests-2050864699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f0cf8ce6-36e9-4fed-ad09-125ad598bc9c.40f21451-2aa4-4039-a466-597ca8d851be {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:38 devstack sudo[108749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:42:38 devstack sudo[108749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:38 devstack sudo[108751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f0cf8ce6-36e9-4fed-ad09-125ad598bc9c.40f21451-2aa4-4039-a466-597ca8d851be Nov 06 15:42:38 devstack sudo[108751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:38 devstack sudo[108749]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-53ae171f-6f8d-459c-a12a-deed69ea99ca tempest-ProjectReaderTests-1199396164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.245s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:38 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-53ae171f-6f8d-459c-a12a-deed69ea99ca tempest-ProjectReaderTests-1199396164 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:42:38 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-53ae171f-6f8d-459c-a12a-deed69ea99ca tempest-ProjectReaderTests-1199396164 None] Deleted volume successfully. Nov 06 15:42:38 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-53ae171f-6f8d-459c-a12a-deed69ea99ca tempest-ProjectReaderTests-1199396164 None] Lock "cinder-7dd75060-cc60-4e42-a2a5-45c8e7748300-delete_volume" released by "delete_volume" :: held 1.157s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:42:38 devstack sudo[108751]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2a7a0aaa-297a-4069-9add-c667a7754110 tempest-ProjectMemberTests-2050864699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f0cf8ce6-36e9-4fed-ad09-125ad598bc9c.40f21451-2aa4-4039-a466-597ca8d851be" returned: 0 in 0.273s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2a7a0aaa-297a-4069-9add-c667a7754110 tempest-ProjectMemberTests-2050864699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f0cf8ce6-36e9-4fed-ad09-125ad598bc9c.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:38 devstack sudo[108755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f0cf8ce6-36e9-4fed-ad09-125ad598bc9c.info Nov 06 15:42:38 devstack sudo[108755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:39 devstack sudo[108755]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2a7a0aaa-297a-4069-9add-c667a7754110 tempest-ProjectMemberTests-2050864699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f0cf8ce6-36e9-4fed-ad09-125ad598bc9c.info" returned: 0 in 0.269s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:39 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-2a7a0aaa-297a-4069-9add-c667a7754110 tempest-ProjectMemberTests-2050864699 None] /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f0cf8ce6-36e9-4fed-ad09-125ad598bc9c.info is being set with open permissions: ugo+rw Nov 06 15:42:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2a7a0aaa-297a-4069-9add-c667a7754110 tempest-ProjectMemberTests-2050864699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f0cf8ce6-36e9-4fed-ad09-125ad598bc9c.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:39 devstack sudo[108758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f0cf8ce6-36e9-4fed-ad09-125ad598bc9c.info Nov 06 15:42:39 devstack sudo[108758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:39 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-98922a51-d927-43d3-9455-e629e2908997 tempest-ProjectReaderTests-1199396164 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:42:39 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-98922a51-d927-43d3-9455-e629e2908997 tempest-ProjectReaderTests-1199396164 None] Flow 'volume_create_manager' (e3c0b5a7-7658-4476-86dc-b72a2e78938f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:42:39 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-98922a51-d927-43d3-9455-e629e2908997 tempest-ProjectReaderTests-1199396164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f982e36e-3aa5-4b3c-a640-ddb7cec9f902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:42:39 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-98922a51-d927-43d3-9455-e629e2908997 tempest-ProjectReaderTests-1199396164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f982e36e-3aa5-4b3c-a640-ddb7cec9f902) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:42:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1306537830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d38eb72-ad11-45e0-b475-970519c5bd9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a15ba4fbd1f143069407ec14dd90261e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:42:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:42:39Z,use_quota=True,user_id='99c650aea30241018dc22dac9240097c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:42:39 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-98922a51-d927-43d3-9455-e629e2908997 tempest-ProjectReaderTests-1199396164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23d97686-e589-4159-8b0e-723261b2afa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:42:39 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-98922a51-d927-43d3-9455-e629e2908997 tempest-ProjectReaderTests-1199396164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23d97686-e589-4159-8b0e-723261b2afa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:42:39 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-98922a51-d927-43d3-9455-e629e2908997 tempest-ProjectReaderTests-1199396164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b2210b5-eebf-4cd7-b2bf-b0ed302f3bb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:42:39 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-98922a51-d927-43d3-9455-e629e2908997 tempest-ProjectReaderTests-1199396164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b2210b5-eebf-4cd7-b2bf-b0ed302f3bb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d38eb72-ad11-45e0-b475-970519c5bd9d', 'volume_name': 'volume-7d38eb72-ad11-45e0-b475-970519c5bd9d', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:42:39 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-98922a51-d927-43d3-9455-e629e2908997 tempest-ProjectReaderTests-1199396164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e4deb08-f532-4e21-87f7-0c6e1968d21f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:42:39 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-98922a51-d927-43d3-9455-e629e2908997 tempest-ProjectReaderTests-1199396164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e4deb08-f532-4e21-87f7-0c6e1968d21f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:42:39 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-98922a51-d927-43d3-9455-e629e2908997 tempest-ProjectReaderTests-1199396164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d1e5426-851d-4722-8a7a-5f3660c41c6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:42:39 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-98922a51-d927-43d3-9455-e629e2908997 tempest-ProjectReaderTests-1199396164 None] Volume 7d38eb72-ad11-45e0-b475-970519c5bd9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d38eb72-ad11-45e0-b475-970519c5bd9d', 'volume_size': 1} Nov 06 15:42:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-98922a51-d927-43d3-9455-e629e2908997 tempest-ProjectReaderTests-1199396164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:42:39 devstack sudo[108758]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2a7a0aaa-297a-4069-9add-c667a7754110 tempest-ProjectMemberTests-2050864699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f0cf8ce6-36e9-4fed-ad09-125ad598bc9c.info" returned: 0 in 0.253s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-2a7a0aaa-297a-4069-9add-c667a7754110 tempest-ProjectMemberTests-2050864699 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.999s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:42:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-98922a51-d927-43d3-9455-e629e2908997 tempest-ProjectReaderTests-1199396164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.058s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:42:39 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-98922a51-d927-43d3-9455-e629e2908997 tempest-ProjectReaderTests-1199396164 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:42:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1306537830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d38eb72-ad11-45e0-b475-970519c5bd9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a15ba4fbd1f143069407ec14dd90261e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:42:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:42:39Z,use_quota=True,user_id='99c650aea30241018dc22dac9240097c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:42:39 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-98922a51-d927-43d3-9455-e629e2908997 tempest-ProjectReaderTests-1199396164 None] Creating volume 7d38eb72-ad11-45e0-b475-970519c5bd9d {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:42:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-98922a51-d927-43d3-9455-e629e2908997 tempest-ProjectReaderTests-1199396164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:42:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-98922a51-d927-43d3-9455-e629e2908997 tempest-ProjectReaderTests-1199396164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:42:39 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-98922a51-d927-43d3-9455-e629e2908997 tempest-ProjectReaderTests-1199396164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:42:39 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-98922a51-d927-43d3-9455-e629e2908997 tempest-ProjectReaderTests-1199396164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:42:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-98922a51-d927-43d3-9455-e629e2908997 tempest-ProjectReaderTests-1199396164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:42:39 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-98922a51-d927-43d3-9455-e629e2908997 tempest-ProjectReaderTests-1199396164 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:42:39 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-98922a51-d927-43d3-9455-e629e2908997 tempest-ProjectReaderTests-1199396164 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:42:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-98922a51-d927-43d3-9455-e629e2908997 tempest-ProjectReaderTests-1199396164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-7d38eb72-ad11-45e0-b475-970519c5bd9d 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:39 devstack sudo[108761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-7d38eb72-ad11-45e0-b475-970519c5bd9d 1073741824 Nov 06 15:42:39 devstack sudo[108761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:39 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-2a7a0aaa-297a-4069-9add-c667a7754110 tempest-ProjectMemberTests-2050864699 None] Create snapshot completed successfully Nov 06 15:42:39 devstack sudo[108761]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-98922a51-d927-43d3-9455-e629e2908997 tempest-ProjectReaderTests-1199396164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-7d38eb72-ad11-45e0-b475-970519c5bd9d 1073741824" returned: 0 in 0.421s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-98922a51-d927-43d3-9455-e629e2908997 tempest-ProjectReaderTests-1199396164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-7d38eb72-ad11-45e0-b475-970519c5bd9d {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:39 devstack sudo[108766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-7d38eb72-ad11-45e0-b475-970519c5bd9d Nov 06 15:42:39 devstack sudo[108766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:40 devstack sudo[108766]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-98922a51-d927-43d3-9455-e629e2908997 tempest-ProjectReaderTests-1199396164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-7d38eb72-ad11-45e0-b475-970519c5bd9d" returned: 0 in 0.241s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:40 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-98922a51-d927-43d3-9455-e629e2908997 tempest-ProjectReaderTests-1199396164 None] <== create_volume: return (701ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:42:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-98922a51-d927-43d3-9455-e629e2908997 tempest-ProjectReaderTests-1199396164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.704s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:42:40 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-98922a51-d927-43d3-9455-e629e2908997 tempest-ProjectReaderTests-1199396164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d1e5426-851d-4722-8a7a-5f3660c41c6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d38eb72-ad11-45e0-b475-970519c5bd9d', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:42:40 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-98922a51-d927-43d3-9455-e629e2908997 tempest-ProjectReaderTests-1199396164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4e1cd04-4c6b-474e-b86c-9821ca55242f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:42:40 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-98922a51-d927-43d3-9455-e629e2908997 tempest-ProjectReaderTests-1199396164 None] Volume volume-7d38eb72-ad11-45e0-b475-970519c5bd9d (7d38eb72-ad11-45e0-b475-970519c5bd9d): created successfully Nov 06 15:42:40 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-98922a51-d927-43d3-9455-e629e2908997 tempest-ProjectReaderTests-1199396164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4e1cd04-4c6b-474e-b86c-9821ca55242f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:42:40 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-98922a51-d927-43d3-9455-e629e2908997 tempest-ProjectReaderTests-1199396164 None] Flow 'volume_create_manager' (e3c0b5a7-7658-4476-86dc-b72a2e78938f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:42:40 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-98922a51-d927-43d3-9455-e629e2908997 tempest-ProjectReaderTests-1199396164 None] Created volume successfully. Nov 06 15:42:40 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-acdbe3ca-5e5c-4f90-86c9-1f19c2c4fdb7 tempest-ProjectReaderTests-1199396164 None] Acquiring lock "cinder-7d38eb72-ad11-45e0-b475-970519c5bd9d-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:42:40 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-acdbe3ca-5e5c-4f90-86c9-1f19c2c4fdb7 tempest-ProjectReaderTests-1199396164 None] Lock "cinder-7d38eb72-ad11-45e0-b475-970519c5bd9d-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:42:40 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-acdbe3ca-5e5c-4f90-86c9-1f19c2c4fdb7 tempest-ProjectReaderTests-1199396164 None] Acquiring lock "cinder-quobyte-7d38eb72-ad11-45e0-b475-970519c5bd9d" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:42:40 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-acdbe3ca-5e5c-4f90-86c9-1f19c2c4fdb7 tempest-ProjectReaderTests-1199396164 None] Lock "cinder-quobyte-7d38eb72-ad11-45e0-b475-970519c5bd9d" acquired by "delete_volume" :: waited 0.015s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:42:40 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[a70f16c8-c6d3-4d4c-acb8-5fd7333a4ce7]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:42:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-acdbe3ca-5e5c-4f90-86c9-1f19c2c4fdb7 tempest-ProjectReaderTests-1199396164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-7d38eb72-ad11-45e0-b475-970519c5bd9d {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:40 devstack sudo[108769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-7d38eb72-ad11-45e0-b475-970519c5bd9d Nov 06 15:42:40 devstack sudo[108769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:40 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b6bbeea4-e96e-4064-8d5f-e121d2843a33 tempest-ProjectMemberTests-2050864699 None] Acquiring lock "cinder-40f21451-2aa4-4039-a466-597ca8d851be-delete_snapshot" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:42:40 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b6bbeea4-e96e-4064-8d5f-e121d2843a33 tempest-ProjectMemberTests-2050864699 None] Lock "cinder-40f21451-2aa4-4039-a466-597ca8d851be-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:42:40 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b6bbeea4-e96e-4064-8d5f-e121d2843a33 tempest-ProjectMemberTests-2050864699 None] Acquiring lock "cinder-quobyte-f0cf8ce6-36e9-4fed-ad09-125ad598bc9c" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:42:40 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b6bbeea4-e96e-4064-8d5f-e121d2843a33 tempest-ProjectMemberTests-2050864699 None] Lock "cinder-quobyte-f0cf8ce6-36e9-4fed-ad09-125ad598bc9c" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:42:40 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b6bbeea4-e96e-4064-8d5f-e121d2843a33 tempest-ProjectMemberTests-2050864699 None] Acquiring lock "cinder-quobyte-40f21451-2aa4-4039-a466-597ca8d851be" by "_delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:42:40 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b6bbeea4-e96e-4064-8d5f-e121d2843a33 tempest-ProjectMemberTests-2050864699 None] Lock "cinder-quobyte-40f21451-2aa4-4039-a466-597ca8d851be" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:42:40 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-b6bbeea4-e96e-4064-8d5f-e121d2843a33 tempest-ProjectMemberTests-2050864699 None] Deleting offline snapshot 40f21451-2aa4-4039-a466-597ca8d851be of volume f0cf8ce6-36e9-4fed-ad09-125ad598bc9c {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 15:42:40 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-b6bbeea4-e96e-4064-8d5f-e121d2843a33 tempest-ProjectMemberTests-2050864699 None] snapshot_file for this snap is: volume-f0cf8ce6-36e9-4fed-ad09-125ad598bc9c.40f21451-2aa4-4039-a466-597ca8d851be {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 15:42:40 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[8945a3b6-62ba-498d-b900-3794cad41552]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:42:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b6bbeea4-e96e-4064-8d5f-e121d2843a33 tempest-ProjectMemberTests-2050864699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f0cf8ce6-36e9-4fed-ad09-125ad598bc9c.40f21451-2aa4-4039-a466-597ca8d851be {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:40 devstack sudo[108771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f0cf8ce6-36e9-4fed-ad09-125ad598bc9c.40f21451-2aa4-4039-a466-597ca8d851be Nov 06 15:42:40 devstack sudo[108771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:40 devstack sudo[108769]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-acdbe3ca-5e5c-4f90-86c9-1f19c2c4fdb7 tempest-ProjectReaderTests-1199396164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-7d38eb72-ad11-45e0-b475-970519c5bd9d" returned: 0 in 0.386s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-acdbe3ca-5e5c-4f90-86c9-1f19c2c4fdb7 tempest-ProjectReaderTests-1199396164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-7d38eb72-ad11-45e0-b475-970519c5bd9d {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:40 devstack sudo[108776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-7d38eb72-ad11-45e0-b475-970519c5bd9d Nov 06 15:42:40 devstack sudo[108776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:41 devstack sudo[108771]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b6bbeea4-e96e-4064-8d5f-e121d2843a33 tempest-ProjectMemberTests-2050864699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f0cf8ce6-36e9-4fed-ad09-125ad598bc9c.40f21451-2aa4-4039-a466-597ca8d851be" returned: 0 in 0.366s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:41 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-b6bbeea4-e96e-4064-8d5f-e121d2843a33 tempest-ProjectMemberTests-2050864699 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f0cf8ce6-36e9-4fed-ad09-125ad598bc9c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 15:42:41 devstack sudo[108776]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-acdbe3ca-5e5c-4f90-86c9-1f19c2c4fdb7 tempest-ProjectReaderTests-1199396164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-7d38eb72-ad11-45e0-b475-970519c5bd9d" returned: 0 in 0.267s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:41 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[77e0829b-dbba-41c5-bd57-3a6e79e6aaca]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:42:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b6bbeea4-e96e-4064-8d5f-e121d2843a33 tempest-ProjectMemberTests-2050864699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f0cf8ce6-36e9-4fed-ad09-125ad598bc9c {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:41 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-acdbe3ca-5e5c-4f90-86c9-1f19c2c4fdb7 tempest-ProjectReaderTests-1199396164 None] Lock "cinder-quobyte-7d38eb72-ad11-45e0-b475-970519c5bd9d" released by "delete_volume" :: held 0.703s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:42:41 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-acdbe3ca-5e5c-4f90-86c9-1f19c2c4fdb7 tempest-ProjectReaderTests-1199396164 None] Created reservations ['ce5e508c-e7cf-4ef6-8b44-27d317ec64bc', 'eaa8edae-6108-4e63-b163-f40df411aa7f', '7c5af716-c79d-48f9-9faa-3229baee5a2f', '718f1e64-d0bb-4cbf-921d-11739bb5b302'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:42:41 devstack sudo[108782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f0cf8ce6-36e9-4fed-ad09-125ad598bc9c Nov 06 15:42:41 devstack sudo[108782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-acdbe3ca-5e5c-4f90-86c9-1f19c2c4fdb7 tempest-ProjectReaderTests-1199396164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:42:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-acdbe3ca-5e5c-4f90-86c9-1f19c2c4fdb7 tempest-ProjectReaderTests-1199396164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:42:41 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-acdbe3ca-5e5c-4f90-86c9-1f19c2c4fdb7 tempest-ProjectReaderTests-1199396164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:42:41 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-acdbe3ca-5e5c-4f90-86c9-1f19c2c4fdb7 tempest-ProjectReaderTests-1199396164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:42:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-acdbe3ca-5e5c-4f90-86c9-1f19c2c4fdb7 tempest-ProjectReaderTests-1199396164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:42:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-acdbe3ca-5e5c-4f90-86c9-1f19c2c4fdb7 tempest-ProjectReaderTests-1199396164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:41 devstack sudo[108784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:42:41 devstack sudo[108784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:41 devstack sudo[108782]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b6bbeea4-e96e-4064-8d5f-e121d2843a33 tempest-ProjectMemberTests-2050864699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f0cf8ce6-36e9-4fed-ad09-125ad598bc9c" returned: 0 in 0.387s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b6bbeea4-e96e-4064-8d5f-e121d2843a33 tempest-ProjectMemberTests-2050864699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f0cf8ce6-36e9-4fed-ad09-125ad598bc9c.40f21451-2aa4-4039-a466-597ca8d851be {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:41 devstack sudo[108790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f0cf8ce6-36e9-4fed-ad09-125ad598bc9c.40f21451-2aa4-4039-a466-597ca8d851be Nov 06 15:42:41 devstack sudo[108790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:41 devstack sudo[108784]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-acdbe3ca-5e5c-4f90-86c9-1f19c2c4fdb7 tempest-ProjectReaderTests-1199396164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.268s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:41 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-acdbe3ca-5e5c-4f90-86c9-1f19c2c4fdb7 tempest-ProjectReaderTests-1199396164 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:42:41 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-acdbe3ca-5e5c-4f90-86c9-1f19c2c4fdb7 tempest-ProjectReaderTests-1199396164 None] Deleted volume successfully. Nov 06 15:42:41 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-acdbe3ca-5e5c-4f90-86c9-1f19c2c4fdb7 tempest-ProjectReaderTests-1199396164 None] Lock "cinder-7d38eb72-ad11-45e0-b475-970519c5bd9d-delete_volume" released by "delete_volume" :: held 1.220s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:42:41 devstack sudo[108790]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b6bbeea4-e96e-4064-8d5f-e121d2843a33 tempest-ProjectMemberTests-2050864699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f0cf8ce6-36e9-4fed-ad09-125ad598bc9c.40f21451-2aa4-4039-a466-597ca8d851be" returned: 0 in 0.362s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b6bbeea4-e96e-4064-8d5f-e121d2843a33 tempest-ProjectMemberTests-2050864699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f0cf8ce6-36e9-4fed-ad09-125ad598bc9c.40f21451-2aa4-4039-a466-597ca8d851be {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:41 devstack sudo[108796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f0cf8ce6-36e9-4fed-ad09-125ad598bc9c.40f21451-2aa4-4039-a466-597ca8d851be Nov 06 15:42:41 devstack sudo[108796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:42 devstack sudo[108796]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b6bbeea4-e96e-4064-8d5f-e121d2843a33 tempest-ProjectMemberTests-2050864699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f0cf8ce6-36e9-4fed-ad09-125ad598bc9c.40f21451-2aa4-4039-a466-597ca8d851be" returned: 0 in 0.262s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:42 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b6bbeea4-e96e-4064-8d5f-e121d2843a33 tempest-ProjectMemberTests-2050864699 None] Lock "cinder-quobyte-40f21451-2aa4-4039-a466-597ca8d851be" released by "_delete_snapshot" :: held 1.480s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:42:42 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b6bbeea4-e96e-4064-8d5f-e121d2843a33 tempest-ProjectMemberTests-2050864699 None] Lock "cinder-quobyte-f0cf8ce6-36e9-4fed-ad09-125ad598bc9c" released by "delete_snapshot" :: held 1.500s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:42:42 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-b6bbeea4-e96e-4064-8d5f-e121d2843a33 tempest-ProjectMemberTests-2050864699 None] Created reservations ['1f7a5ba0-face-4731-8742-4b2d0b591f5a', '97b35dd8-c615-4462-9903-d3c31c012345', 'f7bd96b8-6237-4fbc-a2ec-fda79caab52c', '2b491c1f-ca06-48c4-93c9-393a16e038e3'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:42:42 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-b6bbeea4-e96e-4064-8d5f-e121d2843a33 tempest-ProjectMemberTests-2050864699 None] Delete snapshot completed successfully. Nov 06 15:42:42 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b6bbeea4-e96e-4064-8d5f-e121d2843a33 tempest-ProjectMemberTests-2050864699 None] Lock "cinder-40f21451-2aa4-4039-a466-597ca8d851be-delete_snapshot" released by "delete_snapshot" :: held 1.632s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:42:42 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-2db8495d-bd39-4d4c-9456-5004ba8897f3 tempest-ProjectMemberTests-2050864699 None] Acquiring lock "cinder-f0cf8ce6-36e9-4fed-ad09-125ad598bc9c-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:42:42 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-2db8495d-bd39-4d4c-9456-5004ba8897f3 tempest-ProjectMemberTests-2050864699 None] Lock "cinder-f0cf8ce6-36e9-4fed-ad09-125ad598bc9c-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:42:42 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-2db8495d-bd39-4d4c-9456-5004ba8897f3 tempest-ProjectMemberTests-2050864699 None] Acquiring lock "cinder-quobyte-f0cf8ce6-36e9-4fed-ad09-125ad598bc9c" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:42:42 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-2db8495d-bd39-4d4c-9456-5004ba8897f3 tempest-ProjectMemberTests-2050864699 None] Lock "cinder-quobyte-f0cf8ce6-36e9-4fed-ad09-125ad598bc9c" acquired by "delete_volume" :: waited 0.022s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:42:42 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec7aecbc-b403-4f14-b353-40f9a9a5ba4e]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:42:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2db8495d-bd39-4d4c-9456-5004ba8897f3 tempest-ProjectMemberTests-2050864699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f0cf8ce6-36e9-4fed-ad09-125ad598bc9c {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:43 devstack sudo[108799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f0cf8ce6-36e9-4fed-ad09-125ad598bc9c Nov 06 15:42:43 devstack sudo[108799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:43 devstack sudo[108799]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2db8495d-bd39-4d4c-9456-5004ba8897f3 tempest-ProjectMemberTests-2050864699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f0cf8ce6-36e9-4fed-ad09-125ad598bc9c" returned: 0 in 0.382s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2db8495d-bd39-4d4c-9456-5004ba8897f3 tempest-ProjectMemberTests-2050864699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f0cf8ce6-36e9-4fed-ad09-125ad598bc9c {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:43 devstack sudo[108804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f0cf8ce6-36e9-4fed-ad09-125ad598bc9c Nov 06 15:42:43 devstack sudo[108804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:43 devstack sudo[108804]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2db8495d-bd39-4d4c-9456-5004ba8897f3 tempest-ProjectMemberTests-2050864699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-f0cf8ce6-36e9-4fed-ad09-125ad598bc9c" returned: 0 in 0.250s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:43 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-2db8495d-bd39-4d4c-9456-5004ba8897f3 tempest-ProjectMemberTests-2050864699 None] Lock "cinder-quobyte-f0cf8ce6-36e9-4fed-ad09-125ad598bc9c" released by "delete_volume" :: held 0.707s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:42:43 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-2db8495d-bd39-4d4c-9456-5004ba8897f3 tempest-ProjectMemberTests-2050864699 None] Created reservations ['765284ac-d1ec-4ea3-b54d-1a7eb57a3a38', '46a9725f-76d5-4306-baa1-6e7c4c82ea20', '275e54ed-d67a-4925-9be0-b4fd1790a95c', 'c739bac2-f147-4dc1-bccc-6cb7ba7195d2'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:42:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-2db8495d-bd39-4d4c-9456-5004ba8897f3 tempest-ProjectMemberTests-2050864699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:42:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-2db8495d-bd39-4d4c-9456-5004ba8897f3 tempest-ProjectMemberTests-2050864699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:42:43 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-2db8495d-bd39-4d4c-9456-5004ba8897f3 tempest-ProjectMemberTests-2050864699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:42:43 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-2db8495d-bd39-4d4c-9456-5004ba8897f3 tempest-ProjectMemberTests-2050864699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:42:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-2db8495d-bd39-4d4c-9456-5004ba8897f3 tempest-ProjectMemberTests-2050864699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:42:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2db8495d-bd39-4d4c-9456-5004ba8897f3 tempest-ProjectMemberTests-2050864699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:43 devstack sudo[108807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:42:43 devstack sudo[108807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:43 devstack sudo[108807]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2db8495d-bd39-4d4c-9456-5004ba8897f3 tempest-ProjectMemberTests-2050864699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.252s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:43 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-2db8495d-bd39-4d4c-9456-5004ba8897f3 tempest-ProjectMemberTests-2050864699 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:42:43 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-2db8495d-bd39-4d4c-9456-5004ba8897f3 tempest-ProjectMemberTests-2050864699 None] Deleted volume successfully. Nov 06 15:42:44 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-2db8495d-bd39-4d4c-9456-5004ba8897f3 tempest-ProjectMemberTests-2050864699 None] Lock "cinder-f0cf8ce6-36e9-4fed-ad09-125ad598bc9c-delete_volume" released by "delete_volume" :: held 1.226s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:42:44 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-3bfad459-9ca8-417f-b738-77f666626bdc tempest-ProjectMemberTests-2050864699 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:42:44 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3bfad459-9ca8-417f-b738-77f666626bdc tempest-ProjectMemberTests-2050864699 None] Flow 'volume_create_manager' (6124c61a-6585-4fa2-a161-8ed7f7145d10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:42:44 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3bfad459-9ca8-417f-b738-77f666626bdc tempest-ProjectMemberTests-2050864699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62810b4d-e1d6-45ab-af50-81ae78c77ea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:42:44 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3bfad459-9ca8-417f-b738-77f666626bdc tempest-ProjectMemberTests-2050864699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62810b4d-e1d6-45ab-af50-81ae78c77ea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:42:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2058479552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbc6db68-02c7-4d1b-92b9-73c804ffe3c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='631b1acb2fe74ff38bf682df0fb94c26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:42:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:42:44Z,use_quota=True,user_id='c2ab5a7c9b61494492f0f3bd6193ebdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:42:44 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3bfad459-9ca8-417f-b738-77f666626bdc tempest-ProjectMemberTests-2050864699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0acc1591-1713-4030-b95f-3bc839b6ce3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:42:44 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3bfad459-9ca8-417f-b738-77f666626bdc tempest-ProjectMemberTests-2050864699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0acc1591-1713-4030-b95f-3bc839b6ce3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:42:44 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3bfad459-9ca8-417f-b738-77f666626bdc tempest-ProjectMemberTests-2050864699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22b0fc3c-f46a-4fde-92bd-5b4521d7d415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:42:44 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3bfad459-9ca8-417f-b738-77f666626bdc tempest-ProjectMemberTests-2050864699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22b0fc3c-f46a-4fde-92bd-5b4521d7d415) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dbc6db68-02c7-4d1b-92b9-73c804ffe3c7', 'volume_name': 'volume-dbc6db68-02c7-4d1b-92b9-73c804ffe3c7', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:42:44 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3bfad459-9ca8-417f-b738-77f666626bdc tempest-ProjectMemberTests-2050864699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfe73d70-71cb-475e-9d0f-963a07c93666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:42:44 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3bfad459-9ca8-417f-b738-77f666626bdc tempest-ProjectMemberTests-2050864699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfe73d70-71cb-475e-9d0f-963a07c93666) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:42:44 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3bfad459-9ca8-417f-b738-77f666626bdc tempest-ProjectMemberTests-2050864699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (917acad0-0dba-4a9d-b7df-499bc29cd5a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:42:44 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-3bfad459-9ca8-417f-b738-77f666626bdc tempest-ProjectMemberTests-2050864699 None] Volume dbc6db68-02c7-4d1b-92b9-73c804ffe3c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dbc6db68-02c7-4d1b-92b9-73c804ffe3c7', 'volume_size': 1} Nov 06 15:42:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3bfad459-9ca8-417f-b738-77f666626bdc tempest-ProjectMemberTests-2050864699 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:42:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3bfad459-9ca8-417f-b738-77f666626bdc tempest-ProjectMemberTests-2050864699 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:42:44 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3bfad459-9ca8-417f-b738-77f666626bdc tempest-ProjectMemberTests-2050864699 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:42:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2058479552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbc6db68-02c7-4d1b-92b9-73c804ffe3c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='631b1acb2fe74ff38bf682df0fb94c26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:42:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:42:44Z,use_quota=True,user_id='c2ab5a7c9b61494492f0f3bd6193ebdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:42:44 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-3bfad459-9ca8-417f-b738-77f666626bdc tempest-ProjectMemberTests-2050864699 None] Creating volume dbc6db68-02c7-4d1b-92b9-73c804ffe3c7 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:42:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3bfad459-9ca8-417f-b738-77f666626bdc tempest-ProjectMemberTests-2050864699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:42:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3bfad459-9ca8-417f-b738-77f666626bdc tempest-ProjectMemberTests-2050864699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:42:44 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3bfad459-9ca8-417f-b738-77f666626bdc tempest-ProjectMemberTests-2050864699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:42:44 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3bfad459-9ca8-417f-b738-77f666626bdc tempest-ProjectMemberTests-2050864699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:42:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3bfad459-9ca8-417f-b738-77f666626bdc tempest-ProjectMemberTests-2050864699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:42:44 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3bfad459-9ca8-417f-b738-77f666626bdc tempest-ProjectMemberTests-2050864699 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:42:44 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-3bfad459-9ca8-417f-b738-77f666626bdc tempest-ProjectMemberTests-2050864699 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:42:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3bfad459-9ca8-417f-b738-77f666626bdc tempest-ProjectMemberTests-2050864699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-dbc6db68-02c7-4d1b-92b9-73c804ffe3c7 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:44 devstack sudo[108810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-dbc6db68-02c7-4d1b-92b9-73c804ffe3c7 1073741824 Nov 06 15:42:44 devstack sudo[108810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:44 devstack sudo[108810]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3bfad459-9ca8-417f-b738-77f666626bdc tempest-ProjectMemberTests-2050864699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-dbc6db68-02c7-4d1b-92b9-73c804ffe3c7 1073741824" returned: 0 in 0.456s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3bfad459-9ca8-417f-b738-77f666626bdc tempest-ProjectMemberTests-2050864699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-dbc6db68-02c7-4d1b-92b9-73c804ffe3c7 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:45 devstack sudo[108816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-dbc6db68-02c7-4d1b-92b9-73c804ffe3c7 Nov 06 15:42:45 devstack sudo[108816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:45 devstack sudo[108816]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3bfad459-9ca8-417f-b738-77f666626bdc tempest-ProjectMemberTests-2050864699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-dbc6db68-02c7-4d1b-92b9-73c804ffe3c7" returned: 0 in 0.268s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:45 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3bfad459-9ca8-417f-b738-77f666626bdc tempest-ProjectMemberTests-2050864699 None] <== create_volume: return (771ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:42:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3bfad459-9ca8-417f-b738-77f666626bdc tempest-ProjectMemberTests-2050864699 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.773s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:42:45 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3bfad459-9ca8-417f-b738-77f666626bdc tempest-ProjectMemberTests-2050864699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (917acad0-0dba-4a9d-b7df-499bc29cd5a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dbc6db68-02c7-4d1b-92b9-73c804ffe3c7', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:42:45 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3bfad459-9ca8-417f-b738-77f666626bdc tempest-ProjectMemberTests-2050864699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa4f81aa-2d56-4246-bb86-a84ff3a8a5e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:42:45 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-3bfad459-9ca8-417f-b738-77f666626bdc tempest-ProjectMemberTests-2050864699 None] Volume volume-dbc6db68-02c7-4d1b-92b9-73c804ffe3c7 (dbc6db68-02c7-4d1b-92b9-73c804ffe3c7): created successfully Nov 06 15:42:45 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3bfad459-9ca8-417f-b738-77f666626bdc tempest-ProjectMemberTests-2050864699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa4f81aa-2d56-4246-bb86-a84ff3a8a5e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:42:45 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3bfad459-9ca8-417f-b738-77f666626bdc tempest-ProjectMemberTests-2050864699 None] Flow 'volume_create_manager' (6124c61a-6585-4fa2-a161-8ed7f7145d10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:42:45 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-3bfad459-9ca8-417f-b738-77f666626bdc tempest-ProjectMemberTests-2050864699 None] Created volume successfully. Nov 06 15:42:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3fbda460-7b32-478c-9437-6440ff43018a tempest-ProjectMemberTests-2050864699 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:42:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3fbda460-7b32-478c-9437-6440ff43018a tempest-ProjectMemberTests-2050864699 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:42:45 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-3fbda460-7b32-478c-9437-6440ff43018a tempest-ProjectMemberTests-2050864699 None] Creating offline snapshot 705dbcb1-ad65-48e0-ab92-bcd57b201a6c of volume dbc6db68-02c7-4d1b-92b9-73c804ffe3c7 {{(pid=87132) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 15:42:45 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce34b5c1-7f6b-4c56-bb9e-e53c3f60e40b]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:42:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3fbda460-7b32-478c-9437-6440ff43018a tempest-ProjectMemberTests-2050864699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-dbc6db68-02c7-4d1b-92b9-73c804ffe3c7 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:45 devstack sudo[108819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-dbc6db68-02c7-4d1b-92b9-73c804ffe3c7 Nov 06 15:42:45 devstack sudo[108819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:45 devstack sudo[108819]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3fbda460-7b32-478c-9437-6440ff43018a tempest-ProjectMemberTests-2050864699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-dbc6db68-02c7-4d1b-92b9-73c804ffe3c7" returned: 0 in 0.375s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3fbda460-7b32-478c-9437-6440ff43018a tempest-ProjectMemberTests-2050864699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-dbc6db68-02c7-4d1b-92b9-73c804ffe3c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-dbc6db68-02c7-4d1b-92b9-73c804ffe3c7.705dbcb1-ad65-48e0-ab92-bcd57b201a6c 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:46 devstack sudo[108825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-dbc6db68-02c7-4d1b-92b9-73c804ffe3c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-dbc6db68-02c7-4d1b-92b9-73c804ffe3c7.705dbcb1-ad65-48e0-ab92-bcd57b201a6c 1G Nov 06 15:42:46 devstack sudo[108825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:46 devstack sudo[108825]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3fbda460-7b32-478c-9437-6440ff43018a tempest-ProjectMemberTests-2050864699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-dbc6db68-02c7-4d1b-92b9-73c804ffe3c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-dbc6db68-02c7-4d1b-92b9-73c804ffe3c7.705dbcb1-ad65-48e0-ab92-bcd57b201a6c 1G" returned: 0 in 0.417s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3fbda460-7b32-478c-9437-6440ff43018a tempest-ProjectMemberTests-2050864699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dbc6db68-02c7-4d1b-92b9-73c804ffe3c7 -F qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-dbc6db68-02c7-4d1b-92b9-73c804ffe3c7.705dbcb1-ad65-48e0-ab92-bcd57b201a6c {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:46 devstack sudo[108831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dbc6db68-02c7-4d1b-92b9-73c804ffe3c7 -F qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-dbc6db68-02c7-4d1b-92b9-73c804ffe3c7.705dbcb1-ad65-48e0-ab92-bcd57b201a6c Nov 06 15:42:46 devstack sudo[108831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:46 devstack sudo[108831]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3fbda460-7b32-478c-9437-6440ff43018a tempest-ProjectMemberTests-2050864699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dbc6db68-02c7-4d1b-92b9-73c804ffe3c7 -F qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-dbc6db68-02c7-4d1b-92b9-73c804ffe3c7.705dbcb1-ad65-48e0-ab92-bcd57b201a6c" returned: 0 in 0.314s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:46 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-3fbda460-7b32-478c-9437-6440ff43018a tempest-ProjectMemberTests-2050864699 None] /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-dbc6db68-02c7-4d1b-92b9-73c804ffe3c7.705dbcb1-ad65-48e0-ab92-bcd57b201a6c is being set with open permissions: ugo+rw Nov 06 15:42:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3fbda460-7b32-478c-9437-6440ff43018a tempest-ProjectMemberTests-2050864699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-dbc6db68-02c7-4d1b-92b9-73c804ffe3c7.705dbcb1-ad65-48e0-ab92-bcd57b201a6c {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:46 devstack sudo[108836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-dbc6db68-02c7-4d1b-92b9-73c804ffe3c7.705dbcb1-ad65-48e0-ab92-bcd57b201a6c Nov 06 15:42:46 devstack sudo[108836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:46 devstack sudo[108836]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3fbda460-7b32-478c-9437-6440ff43018a tempest-ProjectMemberTests-2050864699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-dbc6db68-02c7-4d1b-92b9-73c804ffe3c7.705dbcb1-ad65-48e0-ab92-bcd57b201a6c" returned: 0 in 0.258s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3fbda460-7b32-478c-9437-6440ff43018a tempest-ProjectMemberTests-2050864699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-dbc6db68-02c7-4d1b-92b9-73c804ffe3c7.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:47 devstack sudo[108839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-dbc6db68-02c7-4d1b-92b9-73c804ffe3c7.info Nov 06 15:42:47 devstack sudo[108839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:47 devstack sudo[108839]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3fbda460-7b32-478c-9437-6440ff43018a tempest-ProjectMemberTests-2050864699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-dbc6db68-02c7-4d1b-92b9-73c804ffe3c7.info" returned: 0 in 0.295s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:47 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-3fbda460-7b32-478c-9437-6440ff43018a tempest-ProjectMemberTests-2050864699 None] /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-dbc6db68-02c7-4d1b-92b9-73c804ffe3c7.info is being set with open permissions: ugo+rw Nov 06 15:42:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3fbda460-7b32-478c-9437-6440ff43018a tempest-ProjectMemberTests-2050864699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-dbc6db68-02c7-4d1b-92b9-73c804ffe3c7.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:47 devstack sudo[108842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-dbc6db68-02c7-4d1b-92b9-73c804ffe3c7.info Nov 06 15:42:47 devstack sudo[108842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:47 devstack sudo[108842]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3fbda460-7b32-478c-9437-6440ff43018a tempest-ProjectMemberTests-2050864699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-dbc6db68-02c7-4d1b-92b9-73c804ffe3c7.info" returned: 0 in 0.246s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3fbda460-7b32-478c-9437-6440ff43018a tempest-ProjectMemberTests-2050864699 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.994s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:42:47 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-3fbda460-7b32-478c-9437-6440ff43018a tempest-ProjectMemberTests-2050864699 None] Create snapshot completed successfully Nov 06 15:42:47 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-f85e2974-446c-48d2-abaf-50f27ff13ad5 tempest-ProjectMemberTests-2050864699 None] Acquiring lock "cinder-705dbcb1-ad65-48e0-ab92-bcd57b201a6c-delete_snapshot" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:42:47 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-f85e2974-446c-48d2-abaf-50f27ff13ad5 tempest-ProjectMemberTests-2050864699 None] Lock "cinder-705dbcb1-ad65-48e0-ab92-bcd57b201a6c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:42:47 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-f85e2974-446c-48d2-abaf-50f27ff13ad5 tempest-ProjectMemberTests-2050864699 None] Acquiring lock "cinder-quobyte-dbc6db68-02c7-4d1b-92b9-73c804ffe3c7" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:42:47 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-f85e2974-446c-48d2-abaf-50f27ff13ad5 tempest-ProjectMemberTests-2050864699 None] Lock "cinder-quobyte-dbc6db68-02c7-4d1b-92b9-73c804ffe3c7" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:42:47 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-f85e2974-446c-48d2-abaf-50f27ff13ad5 tempest-ProjectMemberTests-2050864699 None] Acquiring lock "cinder-quobyte-705dbcb1-ad65-48e0-ab92-bcd57b201a6c" by "_delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:42:47 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-f85e2974-446c-48d2-abaf-50f27ff13ad5 tempest-ProjectMemberTests-2050864699 None] Lock "cinder-quobyte-705dbcb1-ad65-48e0-ab92-bcd57b201a6c" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:42:47 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-f85e2974-446c-48d2-abaf-50f27ff13ad5 tempest-ProjectMemberTests-2050864699 None] Deleting offline snapshot 705dbcb1-ad65-48e0-ab92-bcd57b201a6c of volume dbc6db68-02c7-4d1b-92b9-73c804ffe3c7 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 15:42:47 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-f85e2974-446c-48d2-abaf-50f27ff13ad5 tempest-ProjectMemberTests-2050864699 None] snapshot_file for this snap is: volume-dbc6db68-02c7-4d1b-92b9-73c804ffe3c7.705dbcb1-ad65-48e0-ab92-bcd57b201a6c {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 15:42:47 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[37d33c53-4d77-41a9-b148-13a4a4985886]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:42:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f85e2974-446c-48d2-abaf-50f27ff13ad5 tempest-ProjectMemberTests-2050864699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-dbc6db68-02c7-4d1b-92b9-73c804ffe3c7.705dbcb1-ad65-48e0-ab92-bcd57b201a6c {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:47 devstack sudo[108845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-dbc6db68-02c7-4d1b-92b9-73c804ffe3c7.705dbcb1-ad65-48e0-ab92-bcd57b201a6c Nov 06 15:42:47 devstack sudo[108845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:48 devstack sudo[108845]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f85e2974-446c-48d2-abaf-50f27ff13ad5 tempest-ProjectMemberTests-2050864699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-dbc6db68-02c7-4d1b-92b9-73c804ffe3c7.705dbcb1-ad65-48e0-ab92-bcd57b201a6c" returned: 0 in 0.355s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:48 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-f85e2974-446c-48d2-abaf-50f27ff13ad5 tempest-ProjectMemberTests-2050864699 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dbc6db68-02c7-4d1b-92b9-73c804ffe3c7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 15:42:48 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad676cd4-eddd-46a6-a91e-c1f83e82d770]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:42:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f85e2974-446c-48d2-abaf-50f27ff13ad5 tempest-ProjectMemberTests-2050864699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-dbc6db68-02c7-4d1b-92b9-73c804ffe3c7 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:48 devstack sudo[108850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-dbc6db68-02c7-4d1b-92b9-73c804ffe3c7 Nov 06 15:42:48 devstack sudo[108850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:48 devstack sudo[108850]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f85e2974-446c-48d2-abaf-50f27ff13ad5 tempest-ProjectMemberTests-2050864699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-dbc6db68-02c7-4d1b-92b9-73c804ffe3c7" returned: 0 in 0.340s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f85e2974-446c-48d2-abaf-50f27ff13ad5 tempest-ProjectMemberTests-2050864699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-dbc6db68-02c7-4d1b-92b9-73c804ffe3c7.705dbcb1-ad65-48e0-ab92-bcd57b201a6c {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:48 devstack sudo[108855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-dbc6db68-02c7-4d1b-92b9-73c804ffe3c7.705dbcb1-ad65-48e0-ab92-bcd57b201a6c Nov 06 15:42:48 devstack sudo[108855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:48 devstack sudo[108855]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f85e2974-446c-48d2-abaf-50f27ff13ad5 tempest-ProjectMemberTests-2050864699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-dbc6db68-02c7-4d1b-92b9-73c804ffe3c7.705dbcb1-ad65-48e0-ab92-bcd57b201a6c" returned: 0 in 0.325s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f85e2974-446c-48d2-abaf-50f27ff13ad5 tempest-ProjectMemberTests-2050864699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-dbc6db68-02c7-4d1b-92b9-73c804ffe3c7.705dbcb1-ad65-48e0-ab92-bcd57b201a6c {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:48 devstack sudo[108861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-dbc6db68-02c7-4d1b-92b9-73c804ffe3c7.705dbcb1-ad65-48e0-ab92-bcd57b201a6c Nov 06 15:42:48 devstack sudo[108861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:49 devstack sudo[108861]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f85e2974-446c-48d2-abaf-50f27ff13ad5 tempest-ProjectMemberTests-2050864699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-dbc6db68-02c7-4d1b-92b9-73c804ffe3c7.705dbcb1-ad65-48e0-ab92-bcd57b201a6c" returned: 0 in 0.237s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:49 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-f85e2974-446c-48d2-abaf-50f27ff13ad5 tempest-ProjectMemberTests-2050864699 None] Lock "cinder-quobyte-705dbcb1-ad65-48e0-ab92-bcd57b201a6c" released by "_delete_snapshot" :: held 1.346s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:42:49 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-f85e2974-446c-48d2-abaf-50f27ff13ad5 tempest-ProjectMemberTests-2050864699 None] Lock "cinder-quobyte-dbc6db68-02c7-4d1b-92b9-73c804ffe3c7" released by "delete_snapshot" :: held 1.368s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:42:49 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-f85e2974-446c-48d2-abaf-50f27ff13ad5 tempest-ProjectMemberTests-2050864699 None] Created reservations ['14981920-c24b-4dfd-ac7f-aa2eab621b06', '06c57b8e-0610-449a-8d1b-8813f53533e4', '53f8d0b5-a111-4b0b-99fd-48d25be0ffeb', '15e53d34-1289-4d30-ac49-4ccf820f915b'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:42:49 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-f85e2974-446c-48d2-abaf-50f27ff13ad5 tempest-ProjectMemberTests-2050864699 None] Delete snapshot completed successfully. Nov 06 15:42:49 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-f85e2974-446c-48d2-abaf-50f27ff13ad5 tempest-ProjectMemberTests-2050864699 None] Lock "cinder-705dbcb1-ad65-48e0-ab92-bcd57b201a6c-delete_snapshot" released by "delete_snapshot" :: held 1.502s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:42:49 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-3f483c0b-9c0c-43e9-a08a-7ecffcdb069c tempest-ProjectMemberTests-2050864699 None] Acquiring lock "cinder-dbc6db68-02c7-4d1b-92b9-73c804ffe3c7-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:42:49 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-3f483c0b-9c0c-43e9-a08a-7ecffcdb069c tempest-ProjectMemberTests-2050864699 None] Lock "cinder-dbc6db68-02c7-4d1b-92b9-73c804ffe3c7-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:42:49 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-3f483c0b-9c0c-43e9-a08a-7ecffcdb069c tempest-ProjectMemberTests-2050864699 None] Acquiring lock "cinder-quobyte-dbc6db68-02c7-4d1b-92b9-73c804ffe3c7" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:42:49 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-3f483c0b-9c0c-43e9-a08a-7ecffcdb069c tempest-ProjectMemberTests-2050864699 None] Lock "cinder-quobyte-dbc6db68-02c7-4d1b-92b9-73c804ffe3c7" acquired by "delete_volume" :: waited 0.013s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:42:49 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[505acdee-459e-45ae-a78f-2c7e263c647b]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:42:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3f483c0b-9c0c-43e9-a08a-7ecffcdb069c tempest-ProjectMemberTests-2050864699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-dbc6db68-02c7-4d1b-92b9-73c804ffe3c7 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:50 devstack sudo[108865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-dbc6db68-02c7-4d1b-92b9-73c804ffe3c7 Nov 06 15:42:50 devstack sudo[108865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:50 devstack sudo[108865]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3f483c0b-9c0c-43e9-a08a-7ecffcdb069c tempest-ProjectMemberTests-2050864699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-dbc6db68-02c7-4d1b-92b9-73c804ffe3c7" returned: 0 in 0.341s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3f483c0b-9c0c-43e9-a08a-7ecffcdb069c tempest-ProjectMemberTests-2050864699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-dbc6db68-02c7-4d1b-92b9-73c804ffe3c7 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:50 devstack sudo[108870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-dbc6db68-02c7-4d1b-92b9-73c804ffe3c7 Nov 06 15:42:50 devstack sudo[108870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:50 devstack sudo[108870]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3f483c0b-9c0c-43e9-a08a-7ecffcdb069c tempest-ProjectMemberTests-2050864699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-dbc6db68-02c7-4d1b-92b9-73c804ffe3c7" returned: 0 in 0.238s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:50 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-3f483c0b-9c0c-43e9-a08a-7ecffcdb069c tempest-ProjectMemberTests-2050864699 None] Lock "cinder-quobyte-dbc6db68-02c7-4d1b-92b9-73c804ffe3c7" released by "delete_volume" :: held 0.637s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:42:50 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-3f483c0b-9c0c-43e9-a08a-7ecffcdb069c tempest-ProjectMemberTests-2050864699 None] Created reservations ['50c8a3e5-54dc-402f-ab18-182e554636c7', 'dd5d3285-90c9-40dc-ae56-b2e40b08db73', '7cf02cfb-3c7a-41ff-85b3-8f58adc3be86', '5afb7447-70ec-41e2-853a-29829ec1def3'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:42:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3f483c0b-9c0c-43e9-a08a-7ecffcdb069c tempest-ProjectMemberTests-2050864699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:42:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3f483c0b-9c0c-43e9-a08a-7ecffcdb069c tempest-ProjectMemberTests-2050864699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:42:50 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3f483c0b-9c0c-43e9-a08a-7ecffcdb069c tempest-ProjectMemberTests-2050864699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:42:50 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3f483c0b-9c0c-43e9-a08a-7ecffcdb069c tempest-ProjectMemberTests-2050864699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:42:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3f483c0b-9c0c-43e9-a08a-7ecffcdb069c tempest-ProjectMemberTests-2050864699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:42:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3f483c0b-9c0c-43e9-a08a-7ecffcdb069c tempest-ProjectMemberTests-2050864699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:50 devstack sudo[108873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:42:50 devstack sudo[108873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:50 devstack sudo[108873]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3f483c0b-9c0c-43e9-a08a-7ecffcdb069c tempest-ProjectMemberTests-2050864699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.234s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:50 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-3f483c0b-9c0c-43e9-a08a-7ecffcdb069c tempest-ProjectMemberTests-2050864699 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:42:50 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-3f483c0b-9c0c-43e9-a08a-7ecffcdb069c tempest-ProjectMemberTests-2050864699 None] Deleted volume successfully. Nov 06 15:42:50 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-3f483c0b-9c0c-43e9-a08a-7ecffcdb069c tempest-ProjectMemberTests-2050864699 None] Lock "cinder-dbc6db68-02c7-4d1b-92b9-73c804ffe3c7-delete_volume" released by "delete_volume" :: held 1.055s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:42:51 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-a286543c-d8b5-4b81-a12b-d3ba6446f70e tempest-ProjectMemberTests-2050864699 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:42:51 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a286543c-d8b5-4b81-a12b-d3ba6446f70e tempest-ProjectMemberTests-2050864699 None] Flow 'volume_create_manager' (19c1d2b9-e505-4b82-aa82-09c4e0566cf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:42:51 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a286543c-d8b5-4b81-a12b-d3ba6446f70e tempest-ProjectMemberTests-2050864699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2810e491-cafc-41d5-93a8-f118c04dee5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:42:51 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a286543c-d8b5-4b81-a12b-d3ba6446f70e tempest-ProjectMemberTests-2050864699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2810e491-cafc-41d5-93a8-f118c04dee5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:42:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1314565203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=622d3323-dbc1-451e-8df5-fcd83b38fd80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='631b1acb2fe74ff38bf682df0fb94c26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:42:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:42:51Z,use_quota=True,user_id='c2ab5a7c9b61494492f0f3bd6193ebdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:42:51 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a286543c-d8b5-4b81-a12b-d3ba6446f70e tempest-ProjectMemberTests-2050864699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bb80da3-33b5-4eb0-8e08-04218e4eb4cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:42:51 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a286543c-d8b5-4b81-a12b-d3ba6446f70e tempest-ProjectMemberTests-2050864699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bb80da3-33b5-4eb0-8e08-04218e4eb4cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:42:51 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a286543c-d8b5-4b81-a12b-d3ba6446f70e tempest-ProjectMemberTests-2050864699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32d12241-8959-42f3-9379-b360b4e59ca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:42:51 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a286543c-d8b5-4b81-a12b-d3ba6446f70e tempest-ProjectMemberTests-2050864699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32d12241-8959-42f3-9379-b360b4e59ca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '622d3323-dbc1-451e-8df5-fcd83b38fd80', 'volume_name': 'volume-622d3323-dbc1-451e-8df5-fcd83b38fd80', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:42:51 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a286543c-d8b5-4b81-a12b-d3ba6446f70e tempest-ProjectMemberTests-2050864699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eee47c63-e18d-4b15-af66-941f3e2b4827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:42:51 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a286543c-d8b5-4b81-a12b-d3ba6446f70e tempest-ProjectMemberTests-2050864699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eee47c63-e18d-4b15-af66-941f3e2b4827) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:42:51 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a286543c-d8b5-4b81-a12b-d3ba6446f70e tempest-ProjectMemberTests-2050864699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed7a6133-b5a5-4f2b-a3b6-01e062f53505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:42:51 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-a286543c-d8b5-4b81-a12b-d3ba6446f70e tempest-ProjectMemberTests-2050864699 None] Volume 622d3323-dbc1-451e-8df5-fcd83b38fd80: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-622d3323-dbc1-451e-8df5-fcd83b38fd80', 'volume_size': 1} Nov 06 15:42:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a286543c-d8b5-4b81-a12b-d3ba6446f70e tempest-ProjectMemberTests-2050864699 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:42:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a286543c-d8b5-4b81-a12b-d3ba6446f70e tempest-ProjectMemberTests-2050864699 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:42:51 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-a286543c-d8b5-4b81-a12b-d3ba6446f70e tempest-ProjectMemberTests-2050864699 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:42:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1314565203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=622d3323-dbc1-451e-8df5-fcd83b38fd80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='631b1acb2fe74ff38bf682df0fb94c26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:42:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:42:51Z,use_quota=True,user_id='c2ab5a7c9b61494492f0f3bd6193ebdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:42:51 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-a286543c-d8b5-4b81-a12b-d3ba6446f70e tempest-ProjectMemberTests-2050864699 None] Creating volume 622d3323-dbc1-451e-8df5-fcd83b38fd80 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:42:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a286543c-d8b5-4b81-a12b-d3ba6446f70e tempest-ProjectMemberTests-2050864699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:42:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a286543c-d8b5-4b81-a12b-d3ba6446f70e tempest-ProjectMemberTests-2050864699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:42:51 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-a286543c-d8b5-4b81-a12b-d3ba6446f70e tempest-ProjectMemberTests-2050864699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:42:51 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-a286543c-d8b5-4b81-a12b-d3ba6446f70e tempest-ProjectMemberTests-2050864699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:42:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a286543c-d8b5-4b81-a12b-d3ba6446f70e tempest-ProjectMemberTests-2050864699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:42:51 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-a286543c-d8b5-4b81-a12b-d3ba6446f70e tempest-ProjectMemberTests-2050864699 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:42:51 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-a286543c-d8b5-4b81-a12b-d3ba6446f70e tempest-ProjectMemberTests-2050864699 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:42:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a286543c-d8b5-4b81-a12b-d3ba6446f70e tempest-ProjectMemberTests-2050864699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-622d3323-dbc1-451e-8df5-fcd83b38fd80 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:51 devstack sudo[108876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-622d3323-dbc1-451e-8df5-fcd83b38fd80 1073741824 Nov 06 15:42:51 devstack sudo[108876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:51 devstack sudo[108876]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a286543c-d8b5-4b81-a12b-d3ba6446f70e tempest-ProjectMemberTests-2050864699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-622d3323-dbc1-451e-8df5-fcd83b38fd80 1073741824" returned: 0 in 0.427s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a286543c-d8b5-4b81-a12b-d3ba6446f70e tempest-ProjectMemberTests-2050864699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-622d3323-dbc1-451e-8df5-fcd83b38fd80 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:52 devstack sudo[108884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-622d3323-dbc1-451e-8df5-fcd83b38fd80 Nov 06 15:42:52 devstack sudo[108884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:52 devstack sudo[108884]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a286543c-d8b5-4b81-a12b-d3ba6446f70e tempest-ProjectMemberTests-2050864699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-622d3323-dbc1-451e-8df5-fcd83b38fd80" returned: 0 in 0.260s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:52 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-a286543c-d8b5-4b81-a12b-d3ba6446f70e tempest-ProjectMemberTests-2050864699 None] <== create_volume: return (725ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:42:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a286543c-d8b5-4b81-a12b-d3ba6446f70e tempest-ProjectMemberTests-2050864699 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.727s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:42:52 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a286543c-d8b5-4b81-a12b-d3ba6446f70e tempest-ProjectMemberTests-2050864699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed7a6133-b5a5-4f2b-a3b6-01e062f53505) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-622d3323-dbc1-451e-8df5-fcd83b38fd80', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:42:52 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a286543c-d8b5-4b81-a12b-d3ba6446f70e tempest-ProjectMemberTests-2050864699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c9c25f6-9ab0-4180-865c-9c67f440d5ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:42:52 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-a286543c-d8b5-4b81-a12b-d3ba6446f70e tempest-ProjectMemberTests-2050864699 None] Volume volume-622d3323-dbc1-451e-8df5-fcd83b38fd80 (622d3323-dbc1-451e-8df5-fcd83b38fd80): created successfully Nov 06 15:42:52 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a286543c-d8b5-4b81-a12b-d3ba6446f70e tempest-ProjectMemberTests-2050864699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c9c25f6-9ab0-4180-865c-9c67f440d5ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:42:52 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a286543c-d8b5-4b81-a12b-d3ba6446f70e tempest-ProjectMemberTests-2050864699 None] Flow 'volume_create_manager' (19c1d2b9-e505-4b82-aa82-09c4e0566cf6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:42:52 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-a286543c-d8b5-4b81-a12b-d3ba6446f70e tempest-ProjectMemberTests-2050864699 None] Created volume successfully. Nov 06 15:42:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-04dd4fce-6ad6-4c15-8bfb-b4d870ef1967 tempest-ProjectMemberTests-2050864699 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:42:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-04dd4fce-6ad6-4c15-8bfb-b4d870ef1967 tempest-ProjectMemberTests-2050864699 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:42:52 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-04dd4fce-6ad6-4c15-8bfb-b4d870ef1967 tempest-ProjectMemberTests-2050864699 None] Creating offline snapshot b0765957-c12e-4f2c-827f-3ee747e4fcb4 of volume 622d3323-dbc1-451e-8df5-fcd83b38fd80 {{(pid=87132) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 15:42:52 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[af3d49cf-3c0f-4543-9af8-8bad7988d41d]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:42:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-04dd4fce-6ad6-4c15-8bfb-b4d870ef1967 tempest-ProjectMemberTests-2050864699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-622d3323-dbc1-451e-8df5-fcd83b38fd80 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:52 devstack sudo[108887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-622d3323-dbc1-451e-8df5-fcd83b38fd80 Nov 06 15:42:52 devstack sudo[108887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:52 devstack sudo[108887]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-04dd4fce-6ad6-4c15-8bfb-b4d870ef1967 tempest-ProjectMemberTests-2050864699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-622d3323-dbc1-451e-8df5-fcd83b38fd80" returned: 0 in 0.354s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-04dd4fce-6ad6-4c15-8bfb-b4d870ef1967 tempest-ProjectMemberTests-2050864699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-622d3323-dbc1-451e-8df5-fcd83b38fd80,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-622d3323-dbc1-451e-8df5-fcd83b38fd80.b0765957-c12e-4f2c-827f-3ee747e4fcb4 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:53 devstack sudo[108892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-622d3323-dbc1-451e-8df5-fcd83b38fd80,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-622d3323-dbc1-451e-8df5-fcd83b38fd80.b0765957-c12e-4f2c-827f-3ee747e4fcb4 1G Nov 06 15:42:53 devstack sudo[108892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:53 devstack sudo[108892]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-04dd4fce-6ad6-4c15-8bfb-b4d870ef1967 tempest-ProjectMemberTests-2050864699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-622d3323-dbc1-451e-8df5-fcd83b38fd80,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-622d3323-dbc1-451e-8df5-fcd83b38fd80.b0765957-c12e-4f2c-827f-3ee747e4fcb4 1G" returned: 0 in 0.382s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-04dd4fce-6ad6-4c15-8bfb-b4d870ef1967 tempest-ProjectMemberTests-2050864699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-622d3323-dbc1-451e-8df5-fcd83b38fd80 -F qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-622d3323-dbc1-451e-8df5-fcd83b38fd80.b0765957-c12e-4f2c-827f-3ee747e4fcb4 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:53 devstack sudo[108897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-622d3323-dbc1-451e-8df5-fcd83b38fd80 -F qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-622d3323-dbc1-451e-8df5-fcd83b38fd80.b0765957-c12e-4f2c-827f-3ee747e4fcb4 Nov 06 15:42:53 devstack sudo[108897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:53 devstack sudo[108897]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-04dd4fce-6ad6-4c15-8bfb-b4d870ef1967 tempest-ProjectMemberTests-2050864699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-622d3323-dbc1-451e-8df5-fcd83b38fd80 -F qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-622d3323-dbc1-451e-8df5-fcd83b38fd80.b0765957-c12e-4f2c-827f-3ee747e4fcb4" returned: 0 in 0.291s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:53 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-04dd4fce-6ad6-4c15-8bfb-b4d870ef1967 tempest-ProjectMemberTests-2050864699 None] /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-622d3323-dbc1-451e-8df5-fcd83b38fd80.b0765957-c12e-4f2c-827f-3ee747e4fcb4 is being set with open permissions: ugo+rw Nov 06 15:42:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-04dd4fce-6ad6-4c15-8bfb-b4d870ef1967 tempest-ProjectMemberTests-2050864699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-622d3323-dbc1-451e-8df5-fcd83b38fd80.b0765957-c12e-4f2c-827f-3ee747e4fcb4 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:53 devstack sudo[108902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-622d3323-dbc1-451e-8df5-fcd83b38fd80.b0765957-c12e-4f2c-827f-3ee747e4fcb4 Nov 06 15:42:53 devstack sudo[108902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:53 devstack sudo[108902]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-04dd4fce-6ad6-4c15-8bfb-b4d870ef1967 tempest-ProjectMemberTests-2050864699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-622d3323-dbc1-451e-8df5-fcd83b38fd80.b0765957-c12e-4f2c-827f-3ee747e4fcb4" returned: 0 in 0.234s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-04dd4fce-6ad6-4c15-8bfb-b4d870ef1967 tempest-ProjectMemberTests-2050864699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-622d3323-dbc1-451e-8df5-fcd83b38fd80.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:53 devstack sudo[108905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-622d3323-dbc1-451e-8df5-fcd83b38fd80.info Nov 06 15:42:53 devstack sudo[108905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:54 devstack sudo[108905]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-04dd4fce-6ad6-4c15-8bfb-b4d870ef1967 tempest-ProjectMemberTests-2050864699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-622d3323-dbc1-451e-8df5-fcd83b38fd80.info" returned: 0 in 0.249s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:54 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-04dd4fce-6ad6-4c15-8bfb-b4d870ef1967 tempest-ProjectMemberTests-2050864699 None] /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-622d3323-dbc1-451e-8df5-fcd83b38fd80.info is being set with open permissions: ugo+rw Nov 06 15:42:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-04dd4fce-6ad6-4c15-8bfb-b4d870ef1967 tempest-ProjectMemberTests-2050864699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-622d3323-dbc1-451e-8df5-fcd83b38fd80.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:54 devstack sudo[108908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-622d3323-dbc1-451e-8df5-fcd83b38fd80.info Nov 06 15:42:54 devstack sudo[108908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:54 devstack sudo[108908]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-04dd4fce-6ad6-4c15-8bfb-b4d870ef1967 tempest-ProjectMemberTests-2050864699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-622d3323-dbc1-451e-8df5-fcd83b38fd80.info" returned: 0 in 0.233s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-04dd4fce-6ad6-4c15-8bfb-b4d870ef1967 tempest-ProjectMemberTests-2050864699 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.816s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:42:54 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-04dd4fce-6ad6-4c15-8bfb-b4d870ef1967 tempest-ProjectMemberTests-2050864699 None] Create snapshot completed successfully Nov 06 15:42:54 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b8dad88e-fddc-4bc2-98cb-319bf0adfddc tempest-ProjectMemberTests-2050864699 None] Acquiring lock "cinder-b0765957-c12e-4f2c-827f-3ee747e4fcb4-delete_snapshot" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:42:54 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b8dad88e-fddc-4bc2-98cb-319bf0adfddc tempest-ProjectMemberTests-2050864699 None] Lock "cinder-b0765957-c12e-4f2c-827f-3ee747e4fcb4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:42:54 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b8dad88e-fddc-4bc2-98cb-319bf0adfddc tempest-ProjectMemberTests-2050864699 None] Acquiring lock "cinder-quobyte-622d3323-dbc1-451e-8df5-fcd83b38fd80" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:42:54 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b8dad88e-fddc-4bc2-98cb-319bf0adfddc tempest-ProjectMemberTests-2050864699 None] Lock "cinder-quobyte-622d3323-dbc1-451e-8df5-fcd83b38fd80" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:42:54 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b8dad88e-fddc-4bc2-98cb-319bf0adfddc tempest-ProjectMemberTests-2050864699 None] Acquiring lock "cinder-quobyte-b0765957-c12e-4f2c-827f-3ee747e4fcb4" by "_delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:42:54 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b8dad88e-fddc-4bc2-98cb-319bf0adfddc tempest-ProjectMemberTests-2050864699 None] Lock "cinder-quobyte-b0765957-c12e-4f2c-827f-3ee747e4fcb4" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:42:54 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-b8dad88e-fddc-4bc2-98cb-319bf0adfddc tempest-ProjectMemberTests-2050864699 None] Deleting offline snapshot b0765957-c12e-4f2c-827f-3ee747e4fcb4 of volume 622d3323-dbc1-451e-8df5-fcd83b38fd80 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 15:42:54 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-b8dad88e-fddc-4bc2-98cb-319bf0adfddc tempest-ProjectMemberTests-2050864699 None] snapshot_file for this snap is: volume-622d3323-dbc1-451e-8df5-fcd83b38fd80.b0765957-c12e-4f2c-827f-3ee747e4fcb4 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 15:42:54 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6c5c3dc-8e96-457c-b15e-2612c59d5af7]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:42:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b8dad88e-fddc-4bc2-98cb-319bf0adfddc tempest-ProjectMemberTests-2050864699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-622d3323-dbc1-451e-8df5-fcd83b38fd80.b0765957-c12e-4f2c-827f-3ee747e4fcb4 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:54 devstack sudo[108911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-622d3323-dbc1-451e-8df5-fcd83b38fd80.b0765957-c12e-4f2c-827f-3ee747e4fcb4 Nov 06 15:42:54 devstack sudo[108911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:55 devstack sudo[108911]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b8dad88e-fddc-4bc2-98cb-319bf0adfddc tempest-ProjectMemberTests-2050864699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-622d3323-dbc1-451e-8df5-fcd83b38fd80.b0765957-c12e-4f2c-827f-3ee747e4fcb4" returned: 0 in 0.341s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:55 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-b8dad88e-fddc-4bc2-98cb-319bf0adfddc tempest-ProjectMemberTests-2050864699 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-622d3323-dbc1-451e-8df5-fcd83b38fd80(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 15:42:55 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[7145abab-932e-420c-9861-58cdc90cf63f]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:42:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b8dad88e-fddc-4bc2-98cb-319bf0adfddc tempest-ProjectMemberTests-2050864699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-622d3323-dbc1-451e-8df5-fcd83b38fd80 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:55 devstack sudo[108916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-622d3323-dbc1-451e-8df5-fcd83b38fd80 Nov 06 15:42:55 devstack sudo[108916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:55 devstack sudo[108916]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b8dad88e-fddc-4bc2-98cb-319bf0adfddc tempest-ProjectMemberTests-2050864699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-622d3323-dbc1-451e-8df5-fcd83b38fd80" returned: 0 in 0.346s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b8dad88e-fddc-4bc2-98cb-319bf0adfddc tempest-ProjectMemberTests-2050864699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-622d3323-dbc1-451e-8df5-fcd83b38fd80.b0765957-c12e-4f2c-827f-3ee747e4fcb4 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:55 devstack sudo[108921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-622d3323-dbc1-451e-8df5-fcd83b38fd80.b0765957-c12e-4f2c-827f-3ee747e4fcb4 Nov 06 15:42:55 devstack sudo[108921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:55 devstack sudo[108921]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b8dad88e-fddc-4bc2-98cb-319bf0adfddc tempest-ProjectMemberTests-2050864699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-622d3323-dbc1-451e-8df5-fcd83b38fd80.b0765957-c12e-4f2c-827f-3ee747e4fcb4" returned: 0 in 0.333s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b8dad88e-fddc-4bc2-98cb-319bf0adfddc tempest-ProjectMemberTests-2050864699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-622d3323-dbc1-451e-8df5-fcd83b38fd80.b0765957-c12e-4f2c-827f-3ee747e4fcb4 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:55 devstack sudo[108927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-622d3323-dbc1-451e-8df5-fcd83b38fd80.b0765957-c12e-4f2c-827f-3ee747e4fcb4 Nov 06 15:42:55 devstack sudo[108927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:56 devstack sudo[108927]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b8dad88e-fddc-4bc2-98cb-319bf0adfddc tempest-ProjectMemberTests-2050864699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-622d3323-dbc1-451e-8df5-fcd83b38fd80.b0765957-c12e-4f2c-827f-3ee747e4fcb4" returned: 0 in 0.244s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:56 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b8dad88e-fddc-4bc2-98cb-319bf0adfddc tempest-ProjectMemberTests-2050864699 None] Lock "cinder-quobyte-b0765957-c12e-4f2c-827f-3ee747e4fcb4" released by "_delete_snapshot" :: held 1.353s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:42:56 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b8dad88e-fddc-4bc2-98cb-319bf0adfddc tempest-ProjectMemberTests-2050864699 None] Lock "cinder-quobyte-622d3323-dbc1-451e-8df5-fcd83b38fd80" released by "delete_snapshot" :: held 1.377s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:42:56 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-b8dad88e-fddc-4bc2-98cb-319bf0adfddc tempest-ProjectMemberTests-2050864699 None] Created reservations ['48dc5061-d8d3-430d-9853-48a2071efb60', 'ede849f7-00f2-49d5-8173-cb5fdba2b0b8', 'abe3d699-9a0e-493a-ae9a-6f1ecd438057', 'e2713133-9e80-457c-ab76-23ee06278601'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:42:56 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-b8dad88e-fddc-4bc2-98cb-319bf0adfddc tempest-ProjectMemberTests-2050864699 None] Delete snapshot completed successfully. Nov 06 15:42:56 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b8dad88e-fddc-4bc2-98cb-319bf0adfddc tempest-ProjectMemberTests-2050864699 None] Lock "cinder-b0765957-c12e-4f2c-827f-3ee747e4fcb4-delete_snapshot" released by "delete_snapshot" :: held 1.502s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:42:56 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-13660d5c-c054-4749-9dd5-5895c4bd886a tempest-ProjectMemberTests-2050864699 None] Acquiring lock "cinder-622d3323-dbc1-451e-8df5-fcd83b38fd80-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:42:56 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-13660d5c-c054-4749-9dd5-5895c4bd886a tempest-ProjectMemberTests-2050864699 None] Lock "cinder-622d3323-dbc1-451e-8df5-fcd83b38fd80-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:42:56 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-13660d5c-c054-4749-9dd5-5895c4bd886a tempest-ProjectMemberTests-2050864699 None] Acquiring lock "cinder-quobyte-622d3323-dbc1-451e-8df5-fcd83b38fd80" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:42:56 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-13660d5c-c054-4749-9dd5-5895c4bd886a tempest-ProjectMemberTests-2050864699 None] Lock "cinder-quobyte-622d3323-dbc1-451e-8df5-fcd83b38fd80" acquired by "delete_volume" :: waited 0.016s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:42:56 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[a69518c6-0420-4ed4-8df1-6422e279fe43]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:42:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-13660d5c-c054-4749-9dd5-5895c4bd886a tempest-ProjectMemberTests-2050864699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-622d3323-dbc1-451e-8df5-fcd83b38fd80 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:57 devstack sudo[108930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-622d3323-dbc1-451e-8df5-fcd83b38fd80 Nov 06 15:42:57 devstack sudo[108930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:57 devstack sudo[108930]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-13660d5c-c054-4749-9dd5-5895c4bd886a tempest-ProjectMemberTests-2050864699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-622d3323-dbc1-451e-8df5-fcd83b38fd80" returned: 0 in 0.357s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-13660d5c-c054-4749-9dd5-5895c4bd886a tempest-ProjectMemberTests-2050864699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-622d3323-dbc1-451e-8df5-fcd83b38fd80 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:57 devstack sudo[108935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-622d3323-dbc1-451e-8df5-fcd83b38fd80 Nov 06 15:42:57 devstack sudo[108935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:57 devstack sudo[108935]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-13660d5c-c054-4749-9dd5-5895c4bd886a tempest-ProjectMemberTests-2050864699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-622d3323-dbc1-451e-8df5-fcd83b38fd80" returned: 0 in 0.241s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:57 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-13660d5c-c054-4749-9dd5-5895c4bd886a tempest-ProjectMemberTests-2050864699 None] Lock "cinder-quobyte-622d3323-dbc1-451e-8df5-fcd83b38fd80" released by "delete_volume" :: held 0.652s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:42:57 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-13660d5c-c054-4749-9dd5-5895c4bd886a tempest-ProjectMemberTests-2050864699 None] Created reservations ['4ce194a3-7432-4abf-bb55-ded91d544344', '66188200-256b-4a44-bcfa-51c6ead199da', 'ba20ea87-80b4-45c6-b6b0-0026e30b7ee2', 'c58b6d19-b469-4569-9980-aad51090acc1'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:42:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-13660d5c-c054-4749-9dd5-5895c4bd886a tempest-ProjectMemberTests-2050864699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:42:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-13660d5c-c054-4749-9dd5-5895c4bd886a tempest-ProjectMemberTests-2050864699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:42:57 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-13660d5c-c054-4749-9dd5-5895c4bd886a tempest-ProjectMemberTests-2050864699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:42:57 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-13660d5c-c054-4749-9dd5-5895c4bd886a tempest-ProjectMemberTests-2050864699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:42:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-13660d5c-c054-4749-9dd5-5895c4bd886a tempest-ProjectMemberTests-2050864699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:42:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-13660d5c-c054-4749-9dd5-5895c4bd886a tempest-ProjectMemberTests-2050864699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:57 devstack sudo[108938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:42:57 devstack sudo[108938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:57 devstack sudo[108938]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-13660d5c-c054-4749-9dd5-5895c4bd886a tempest-ProjectMemberTests-2050864699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.245s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:57 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-13660d5c-c054-4749-9dd5-5895c4bd886a tempest-ProjectMemberTests-2050864699 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:42:57 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-13660d5c-c054-4749-9dd5-5895c4bd886a tempest-ProjectMemberTests-2050864699 None] Deleted volume successfully. Nov 06 15:42:58 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-13660d5c-c054-4749-9dd5-5895c4bd886a tempest-ProjectMemberTests-2050864699 None] Lock "cinder-622d3323-dbc1-451e-8df5-fcd83b38fd80-delete_volume" released by "delete_volume" :: held 1.095s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:42:58 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-fad2dfd5-a5a9-4d76-8d25-e1b9e3fade3f tempest-ProjectMemberTests-2050864699 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:42:58 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fad2dfd5-a5a9-4d76-8d25-e1b9e3fade3f tempest-ProjectMemberTests-2050864699 None] Flow 'volume_create_manager' (d9554473-2f1a-4ed6-8cf8-4a459a7dc7a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:42:58 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fad2dfd5-a5a9-4d76-8d25-e1b9e3fade3f tempest-ProjectMemberTests-2050864699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05bf2943-58a6-4037-b0ef-78386c20f8cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:42:58 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fad2dfd5-a5a9-4d76-8d25-e1b9e3fade3f tempest-ProjectMemberTests-2050864699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05bf2943-58a6-4037-b0ef-78386c20f8cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:42:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1420342678',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=283eb92f-be95-43e7-a29e-7dc1801b7bca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='631b1acb2fe74ff38bf682df0fb94c26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:42:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:42:58Z,use_quota=True,user_id='c2ab5a7c9b61494492f0f3bd6193ebdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:42:58 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fad2dfd5-a5a9-4d76-8d25-e1b9e3fade3f tempest-ProjectMemberTests-2050864699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9e2a0db-ae13-4518-b425-3732ffeb1d32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:42:58 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fad2dfd5-a5a9-4d76-8d25-e1b9e3fade3f tempest-ProjectMemberTests-2050864699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9e2a0db-ae13-4518-b425-3732ffeb1d32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:42:58 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fad2dfd5-a5a9-4d76-8d25-e1b9e3fade3f tempest-ProjectMemberTests-2050864699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7451de2e-d7c4-40d6-820e-ae5d6f188b6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:42:58 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fad2dfd5-a5a9-4d76-8d25-e1b9e3fade3f tempest-ProjectMemberTests-2050864699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7451de2e-d7c4-40d6-820e-ae5d6f188b6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '283eb92f-be95-43e7-a29e-7dc1801b7bca', 'volume_name': 'volume-283eb92f-be95-43e7-a29e-7dc1801b7bca', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:42:58 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fad2dfd5-a5a9-4d76-8d25-e1b9e3fade3f tempest-ProjectMemberTests-2050864699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1439f35d-7ee8-44e2-9302-c310525e34d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:42:58 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fad2dfd5-a5a9-4d76-8d25-e1b9e3fade3f tempest-ProjectMemberTests-2050864699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1439f35d-7ee8-44e2-9302-c310525e34d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:42:58 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fad2dfd5-a5a9-4d76-8d25-e1b9e3fade3f tempest-ProjectMemberTests-2050864699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52e6d97c-c1b3-49c5-8c78-a80df21d8ddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:42:58 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-fad2dfd5-a5a9-4d76-8d25-e1b9e3fade3f tempest-ProjectMemberTests-2050864699 None] Volume 283eb92f-be95-43e7-a29e-7dc1801b7bca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-283eb92f-be95-43e7-a29e-7dc1801b7bca', 'volume_size': 1} Nov 06 15:42:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-fad2dfd5-a5a9-4d76-8d25-e1b9e3fade3f tempest-ProjectMemberTests-2050864699 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:42:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-fad2dfd5-a5a9-4d76-8d25-e1b9e3fade3f tempest-ProjectMemberTests-2050864699 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:42:58 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-fad2dfd5-a5a9-4d76-8d25-e1b9e3fade3f tempest-ProjectMemberTests-2050864699 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:42:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1420342678',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=283eb92f-be95-43e7-a29e-7dc1801b7bca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='631b1acb2fe74ff38bf682df0fb94c26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:42:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:42:58Z,use_quota=True,user_id='c2ab5a7c9b61494492f0f3bd6193ebdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:42:58 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-fad2dfd5-a5a9-4d76-8d25-e1b9e3fade3f tempest-ProjectMemberTests-2050864699 None] Creating volume 283eb92f-be95-43e7-a29e-7dc1801b7bca {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:42:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-fad2dfd5-a5a9-4d76-8d25-e1b9e3fade3f tempest-ProjectMemberTests-2050864699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:42:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-fad2dfd5-a5a9-4d76-8d25-e1b9e3fade3f tempest-ProjectMemberTests-2050864699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:42:58 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-fad2dfd5-a5a9-4d76-8d25-e1b9e3fade3f tempest-ProjectMemberTests-2050864699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:42:58 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-fad2dfd5-a5a9-4d76-8d25-e1b9e3fade3f tempest-ProjectMemberTests-2050864699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:42:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-fad2dfd5-a5a9-4d76-8d25-e1b9e3fade3f tempest-ProjectMemberTests-2050864699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:42:58 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-fad2dfd5-a5a9-4d76-8d25-e1b9e3fade3f tempest-ProjectMemberTests-2050864699 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:42:58 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-fad2dfd5-a5a9-4d76-8d25-e1b9e3fade3f tempest-ProjectMemberTests-2050864699 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:42:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-fad2dfd5-a5a9-4d76-8d25-e1b9e3fade3f tempest-ProjectMemberTests-2050864699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-283eb92f-be95-43e7-a29e-7dc1801b7bca 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:58 devstack sudo[108947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-283eb92f-be95-43e7-a29e-7dc1801b7bca 1073741824 Nov 06 15:42:58 devstack sudo[108947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:58 devstack sudo[108947]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-fad2dfd5-a5a9-4d76-8d25-e1b9e3fade3f tempest-ProjectMemberTests-2050864699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-283eb92f-be95-43e7-a29e-7dc1801b7bca 1073741824" returned: 0 in 0.396s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-fad2dfd5-a5a9-4d76-8d25-e1b9e3fade3f tempest-ProjectMemberTests-2050864699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-283eb92f-be95-43e7-a29e-7dc1801b7bca {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:59 devstack sudo[108952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-283eb92f-be95-43e7-a29e-7dc1801b7bca Nov 06 15:42:59 devstack sudo[108952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:42:59 devstack sudo[108952]: pam_unix(sudo:session): session closed for user root Nov 06 15:42:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-fad2dfd5-a5a9-4d76-8d25-e1b9e3fade3f tempest-ProjectMemberTests-2050864699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-283eb92f-be95-43e7-a29e-7dc1801b7bca" returned: 0 in 0.244s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:42:59 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-fad2dfd5-a5a9-4d76-8d25-e1b9e3fade3f tempest-ProjectMemberTests-2050864699 None] <== create_volume: return (679ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:42:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-fad2dfd5-a5a9-4d76-8d25-e1b9e3fade3f tempest-ProjectMemberTests-2050864699 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.681s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:42:59 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fad2dfd5-a5a9-4d76-8d25-e1b9e3fade3f tempest-ProjectMemberTests-2050864699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52e6d97c-c1b3-49c5-8c78-a80df21d8ddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-283eb92f-be95-43e7-a29e-7dc1801b7bca', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:42:59 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fad2dfd5-a5a9-4d76-8d25-e1b9e3fade3f tempest-ProjectMemberTests-2050864699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b921c44-3eee-43f0-a5ef-3593ec363dab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:42:59 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-fad2dfd5-a5a9-4d76-8d25-e1b9e3fade3f tempest-ProjectMemberTests-2050864699 None] Volume volume-283eb92f-be95-43e7-a29e-7dc1801b7bca (283eb92f-be95-43e7-a29e-7dc1801b7bca): created successfully Nov 06 15:42:59 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fad2dfd5-a5a9-4d76-8d25-e1b9e3fade3f tempest-ProjectMemberTests-2050864699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b921c44-3eee-43f0-a5ef-3593ec363dab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:42:59 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fad2dfd5-a5a9-4d76-8d25-e1b9e3fade3f tempest-ProjectMemberTests-2050864699 None] Flow 'volume_create_manager' (d9554473-2f1a-4ed6-8cf8-4a459a7dc7a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:42:59 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-fad2dfd5-a5a9-4d76-8d25-e1b9e3fade3f tempest-ProjectMemberTests-2050864699 None] Created volume successfully. Nov 06 15:42:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-987636ea-2b45-4d19-ae79-bc3ba2c06c1a tempest-ProjectMemberTests-2050864699 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:42:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-987636ea-2b45-4d19-ae79-bc3ba2c06c1a tempest-ProjectMemberTests-2050864699 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:42:59 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-987636ea-2b45-4d19-ae79-bc3ba2c06c1a tempest-ProjectMemberTests-2050864699 None] Creating offline snapshot 1571f795-f14a-44ae-957a-780135484c40 of volume 283eb92f-be95-43e7-a29e-7dc1801b7bca {{(pid=87132) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 15:42:59 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[b58a641a-73d6-4ff9-86ce-6d11deace282]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:42:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-987636ea-2b45-4d19-ae79-bc3ba2c06c1a tempest-ProjectMemberTests-2050864699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-283eb92f-be95-43e7-a29e-7dc1801b7bca {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:42:59 devstack sudo[108955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-283eb92f-be95-43e7-a29e-7dc1801b7bca Nov 06 15:42:59 devstack sudo[108955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:43:00 devstack sudo[108955]: pam_unix(sudo:session): session closed for user root Nov 06 15:43:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-987636ea-2b45-4d19-ae79-bc3ba2c06c1a tempest-ProjectMemberTests-2050864699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-283eb92f-be95-43e7-a29e-7dc1801b7bca" returned: 0 in 0.361s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:43:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-987636ea-2b45-4d19-ae79-bc3ba2c06c1a tempest-ProjectMemberTests-2050864699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-283eb92f-be95-43e7-a29e-7dc1801b7bca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-283eb92f-be95-43e7-a29e-7dc1801b7bca.1571f795-f14a-44ae-957a-780135484c40 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:43:00 devstack sudo[108960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-283eb92f-be95-43e7-a29e-7dc1801b7bca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-283eb92f-be95-43e7-a29e-7dc1801b7bca.1571f795-f14a-44ae-957a-780135484c40 1G Nov 06 15:43:00 devstack sudo[108960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:43:00 devstack sudo[108960]: pam_unix(sudo:session): session closed for user root Nov 06 15:43:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-987636ea-2b45-4d19-ae79-bc3ba2c06c1a tempest-ProjectMemberTests-2050864699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-283eb92f-be95-43e7-a29e-7dc1801b7bca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-283eb92f-be95-43e7-a29e-7dc1801b7bca.1571f795-f14a-44ae-957a-780135484c40 1G" returned: 0 in 0.368s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:43:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-987636ea-2b45-4d19-ae79-bc3ba2c06c1a tempest-ProjectMemberTests-2050864699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-283eb92f-be95-43e7-a29e-7dc1801b7bca -F qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-283eb92f-be95-43e7-a29e-7dc1801b7bca.1571f795-f14a-44ae-957a-780135484c40 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:43:00 devstack sudo[108966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-283eb92f-be95-43e7-a29e-7dc1801b7bca -F qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-283eb92f-be95-43e7-a29e-7dc1801b7bca.1571f795-f14a-44ae-957a-780135484c40 Nov 06 15:43:00 devstack sudo[108966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:43:00 devstack sudo[108966]: pam_unix(sudo:session): session closed for user root Nov 06 15:43:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-987636ea-2b45-4d19-ae79-bc3ba2c06c1a tempest-ProjectMemberTests-2050864699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-283eb92f-be95-43e7-a29e-7dc1801b7bca -F qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-283eb92f-be95-43e7-a29e-7dc1801b7bca.1571f795-f14a-44ae-957a-780135484c40" returned: 0 in 0.278s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:43:00 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-987636ea-2b45-4d19-ae79-bc3ba2c06c1a tempest-ProjectMemberTests-2050864699 None] /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-283eb92f-be95-43e7-a29e-7dc1801b7bca.1571f795-f14a-44ae-957a-780135484c40 is being set with open permissions: ugo+rw Nov 06 15:43:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-987636ea-2b45-4d19-ae79-bc3ba2c06c1a tempest-ProjectMemberTests-2050864699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-283eb92f-be95-43e7-a29e-7dc1801b7bca.1571f795-f14a-44ae-957a-780135484c40 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:43:00 devstack sudo[108971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-283eb92f-be95-43e7-a29e-7dc1801b7bca.1571f795-f14a-44ae-957a-780135484c40 Nov 06 15:43:00 devstack sudo[108971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:43:00 devstack sudo[108971]: pam_unix(sudo:session): session closed for user root Nov 06 15:43:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-987636ea-2b45-4d19-ae79-bc3ba2c06c1a tempest-ProjectMemberTests-2050864699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-283eb92f-be95-43e7-a29e-7dc1801b7bca.1571f795-f14a-44ae-957a-780135484c40" returned: 0 in 0.240s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:43:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-987636ea-2b45-4d19-ae79-bc3ba2c06c1a tempest-ProjectMemberTests-2050864699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-283eb92f-be95-43e7-a29e-7dc1801b7bca.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:43:00 devstack sudo[108974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-283eb92f-be95-43e7-a29e-7dc1801b7bca.info Nov 06 15:43:00 devstack sudo[108974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:43:01 devstack sudo[108974]: pam_unix(sudo:session): session closed for user root Nov 06 15:43:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-987636ea-2b45-4d19-ae79-bc3ba2c06c1a tempest-ProjectMemberTests-2050864699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-283eb92f-be95-43e7-a29e-7dc1801b7bca.info" returned: 0 in 0.247s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:43:01 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-987636ea-2b45-4d19-ae79-bc3ba2c06c1a tempest-ProjectMemberTests-2050864699 None] /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-283eb92f-be95-43e7-a29e-7dc1801b7bca.info is being set with open permissions: ugo+rw Nov 06 15:43:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-987636ea-2b45-4d19-ae79-bc3ba2c06c1a tempest-ProjectMemberTests-2050864699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-283eb92f-be95-43e7-a29e-7dc1801b7bca.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:43:01 devstack sudo[108977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-283eb92f-be95-43e7-a29e-7dc1801b7bca.info Nov 06 15:43:01 devstack sudo[108977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:43:01 devstack sudo[108977]: pam_unix(sudo:session): session closed for user root Nov 06 15:43:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-987636ea-2b45-4d19-ae79-bc3ba2c06c1a tempest-ProjectMemberTests-2050864699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-283eb92f-be95-43e7-a29e-7dc1801b7bca.info" returned: 0 in 0.235s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:43:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-987636ea-2b45-4d19-ae79-bc3ba2c06c1a tempest-ProjectMemberTests-2050864699 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.818s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:43:01 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:SELECT=190,cinder:UPDATE=226,cinder:INSERT=64,cinder:DELETE=17 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 15:43:01 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:SELECT=175,cinder:DELETE=24,cinder:UPDATE=262,cinder:INSERT=66 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 15:43:01 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-987636ea-2b45-4d19-ae79-bc3ba2c06c1a tempest-ProjectMemberTests-2050864699 None] Create snapshot completed successfully Nov 06 15:43:01 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-23e8adb2-cbed-46f3-bc39-95f321c2a36f tempest-ProjectMemberTests-2050864699 None] Acquiring lock "cinder-1571f795-f14a-44ae-957a-780135484c40-delete_snapshot" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:43:01 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-23e8adb2-cbed-46f3-bc39-95f321c2a36f tempest-ProjectMemberTests-2050864699 None] Lock "cinder-1571f795-f14a-44ae-957a-780135484c40-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:43:01 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-23e8adb2-cbed-46f3-bc39-95f321c2a36f tempest-ProjectMemberTests-2050864699 None] Acquiring lock "cinder-quobyte-283eb92f-be95-43e7-a29e-7dc1801b7bca" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:43:01 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-23e8adb2-cbed-46f3-bc39-95f321c2a36f tempest-ProjectMemberTests-2050864699 None] Lock "cinder-quobyte-283eb92f-be95-43e7-a29e-7dc1801b7bca" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:43:01 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-23e8adb2-cbed-46f3-bc39-95f321c2a36f tempest-ProjectMemberTests-2050864699 None] Acquiring lock "cinder-quobyte-1571f795-f14a-44ae-957a-780135484c40" by "_delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:43:01 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-23e8adb2-cbed-46f3-bc39-95f321c2a36f tempest-ProjectMemberTests-2050864699 None] Lock "cinder-quobyte-1571f795-f14a-44ae-957a-780135484c40" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:43:01 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-23e8adb2-cbed-46f3-bc39-95f321c2a36f tempest-ProjectMemberTests-2050864699 None] Deleting offline snapshot 1571f795-f14a-44ae-957a-780135484c40 of volume 283eb92f-be95-43e7-a29e-7dc1801b7bca {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 15:43:01 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-23e8adb2-cbed-46f3-bc39-95f321c2a36f tempest-ProjectMemberTests-2050864699 None] snapshot_file for this snap is: volume-283eb92f-be95-43e7-a29e-7dc1801b7bca.1571f795-f14a-44ae-957a-780135484c40 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 15:43:01 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb498d00-3d95-4184-991e-ec47a4ee26bb]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:43:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-23e8adb2-cbed-46f3-bc39-95f321c2a36f tempest-ProjectMemberTests-2050864699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-283eb92f-be95-43e7-a29e-7dc1801b7bca.1571f795-f14a-44ae-957a-780135484c40 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:43:02 devstack sudo[108980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-283eb92f-be95-43e7-a29e-7dc1801b7bca.1571f795-f14a-44ae-957a-780135484c40 Nov 06 15:43:02 devstack sudo[108980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:43:02 devstack sudo[108980]: pam_unix(sudo:session): session closed for user root Nov 06 15:43:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-23e8adb2-cbed-46f3-bc39-95f321c2a36f tempest-ProjectMemberTests-2050864699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-283eb92f-be95-43e7-a29e-7dc1801b7bca.1571f795-f14a-44ae-957a-780135484c40" returned: 0 in 0.368s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:43:02 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-23e8adb2-cbed-46f3-bc39-95f321c2a36f tempest-ProjectMemberTests-2050864699 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-283eb92f-be95-43e7-a29e-7dc1801b7bca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 15:43:02 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[e363dc1f-1ad7-429c-9a73-6a60db0e005e]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:43:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-23e8adb2-cbed-46f3-bc39-95f321c2a36f tempest-ProjectMemberTests-2050864699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-283eb92f-be95-43e7-a29e-7dc1801b7bca {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:43:02 devstack sudo[108985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-283eb92f-be95-43e7-a29e-7dc1801b7bca Nov 06 15:43:02 devstack sudo[108985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:43:02 devstack sudo[108985]: pam_unix(sudo:session): session closed for user root Nov 06 15:43:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-23e8adb2-cbed-46f3-bc39-95f321c2a36f tempest-ProjectMemberTests-2050864699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-283eb92f-be95-43e7-a29e-7dc1801b7bca" returned: 0 in 0.363s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:43:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-23e8adb2-cbed-46f3-bc39-95f321c2a36f tempest-ProjectMemberTests-2050864699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-283eb92f-be95-43e7-a29e-7dc1801b7bca.1571f795-f14a-44ae-957a-780135484c40 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:43:02 devstack sudo[109024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-283eb92f-be95-43e7-a29e-7dc1801b7bca.1571f795-f14a-44ae-957a-780135484c40 Nov 06 15:43:02 devstack sudo[109024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:43:02 devstack sudo[109024]: pam_unix(sudo:session): session closed for user root Nov 06 15:43:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-23e8adb2-cbed-46f3-bc39-95f321c2a36f tempest-ProjectMemberTests-2050864699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-283eb92f-be95-43e7-a29e-7dc1801b7bca.1571f795-f14a-44ae-957a-780135484c40" returned: 0 in 0.325s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:43:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-23e8adb2-cbed-46f3-bc39-95f321c2a36f tempest-ProjectMemberTests-2050864699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-283eb92f-be95-43e7-a29e-7dc1801b7bca.1571f795-f14a-44ae-957a-780135484c40 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:43:03 devstack sudo[109031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-283eb92f-be95-43e7-a29e-7dc1801b7bca.1571f795-f14a-44ae-957a-780135484c40 Nov 06 15:43:03 devstack sudo[109031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:43:03 devstack sudo[109031]: pam_unix(sudo:session): session closed for user root Nov 06 15:43:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-23e8adb2-cbed-46f3-bc39-95f321c2a36f tempest-ProjectMemberTests-2050864699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-283eb92f-be95-43e7-a29e-7dc1801b7bca.1571f795-f14a-44ae-957a-780135484c40" returned: 0 in 0.244s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:43:03 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-23e8adb2-cbed-46f3-bc39-95f321c2a36f tempest-ProjectMemberTests-2050864699 None] Lock "cinder-quobyte-1571f795-f14a-44ae-957a-780135484c40" released by "_delete_snapshot" :: held 1.388s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:43:03 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-23e8adb2-cbed-46f3-bc39-95f321c2a36f tempest-ProjectMemberTests-2050864699 None] Lock "cinder-quobyte-283eb92f-be95-43e7-a29e-7dc1801b7bca" released by "delete_snapshot" :: held 1.409s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:43:03 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-23e8adb2-cbed-46f3-bc39-95f321c2a36f tempest-ProjectMemberTests-2050864699 None] Created reservations ['6ced276a-17ac-45d8-b182-83d6a173c817', '6be3215e-5f7e-4f22-b640-21f41eb539d0', '5e1a3548-c871-4a94-8c98-14cf183e1f76', '5a841aa1-4c9a-4a44-aa33-e6a498f31592'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:43:03 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-23e8adb2-cbed-46f3-bc39-95f321c2a36f tempest-ProjectMemberTests-2050864699 None] Delete snapshot completed successfully. Nov 06 15:43:03 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-23e8adb2-cbed-46f3-bc39-95f321c2a36f tempest-ProjectMemberTests-2050864699 None] Lock "cinder-1571f795-f14a-44ae-957a-780135484c40-delete_snapshot" released by "delete_snapshot" :: held 1.531s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:43:03 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-5942b0bf-588a-4110-a27d-a5b3abd1d767 tempest-ProjectMemberTests-2050864699 None] Acquiring lock "cinder-283eb92f-be95-43e7-a29e-7dc1801b7bca-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:43:04 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-5942b0bf-588a-4110-a27d-a5b3abd1d767 tempest-ProjectMemberTests-2050864699 None] Lock "cinder-283eb92f-be95-43e7-a29e-7dc1801b7bca-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:43:04 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-5942b0bf-588a-4110-a27d-a5b3abd1d767 tempest-ProjectMemberTests-2050864699 None] Acquiring lock "cinder-quobyte-283eb92f-be95-43e7-a29e-7dc1801b7bca" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:43:04 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-5942b0bf-588a-4110-a27d-a5b3abd1d767 tempest-ProjectMemberTests-2050864699 None] Lock "cinder-quobyte-283eb92f-be95-43e7-a29e-7dc1801b7bca" acquired by "delete_volume" :: waited 0.017s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:43:04 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8113d7d-4f54-461b-a713-666fdd4ab7b7]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:43:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5942b0bf-588a-4110-a27d-a5b3abd1d767 tempest-ProjectMemberTests-2050864699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-283eb92f-be95-43e7-a29e-7dc1801b7bca {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:43:04 devstack sudo[109034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-283eb92f-be95-43e7-a29e-7dc1801b7bca Nov 06 15:43:04 devstack sudo[109034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:43:04 devstack sudo[109034]: pam_unix(sudo:session): session closed for user root Nov 06 15:43:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5942b0bf-588a-4110-a27d-a5b3abd1d767 tempest-ProjectMemberTests-2050864699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-283eb92f-be95-43e7-a29e-7dc1801b7bca" returned: 0 in 0.348s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:43:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5942b0bf-588a-4110-a27d-a5b3abd1d767 tempest-ProjectMemberTests-2050864699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-283eb92f-be95-43e7-a29e-7dc1801b7bca {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:43:04 devstack sudo[109039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-283eb92f-be95-43e7-a29e-7dc1801b7bca Nov 06 15:43:04 devstack sudo[109039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:43:04 devstack sudo[109039]: pam_unix(sudo:session): session closed for user root Nov 06 15:43:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5942b0bf-588a-4110-a27d-a5b3abd1d767 tempest-ProjectMemberTests-2050864699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-283eb92f-be95-43e7-a29e-7dc1801b7bca" returned: 0 in 0.238s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:43:04 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-5942b0bf-588a-4110-a27d-a5b3abd1d767 tempest-ProjectMemberTests-2050864699 None] Lock "cinder-quobyte-283eb92f-be95-43e7-a29e-7dc1801b7bca" released by "delete_volume" :: held 0.643s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:43:04 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-5942b0bf-588a-4110-a27d-a5b3abd1d767 tempest-ProjectMemberTests-2050864699 None] Created reservations ['669f5c4a-4828-4a5f-a50c-4161ea1f63f0', '3b4ad4c6-9310-44c8-b30c-33c84193a0f3', '2737f202-d445-4a96-95ae-ddb15606bb26', '5c944512-6508-4f16-9df2-a9969f0ba048'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:43:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5942b0bf-588a-4110-a27d-a5b3abd1d767 tempest-ProjectMemberTests-2050864699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:43:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5942b0bf-588a-4110-a27d-a5b3abd1d767 tempest-ProjectMemberTests-2050864699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:43:04 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-5942b0bf-588a-4110-a27d-a5b3abd1d767 tempest-ProjectMemberTests-2050864699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:43:04 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-5942b0bf-588a-4110-a27d-a5b3abd1d767 tempest-ProjectMemberTests-2050864699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:43:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5942b0bf-588a-4110-a27d-a5b3abd1d767 tempest-ProjectMemberTests-2050864699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:43:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5942b0bf-588a-4110-a27d-a5b3abd1d767 tempest-ProjectMemberTests-2050864699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:43:04 devstack sudo[109042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:43:04 devstack sudo[109042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:43:05 devstack sudo[109042]: pam_unix(sudo:session): session closed for user root Nov 06 15:43:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5942b0bf-588a-4110-a27d-a5b3abd1d767 tempest-ProjectMemberTests-2050864699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.236s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:43:05 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-5942b0bf-588a-4110-a27d-a5b3abd1d767 tempest-ProjectMemberTests-2050864699 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:43:05 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-5942b0bf-588a-4110-a27d-a5b3abd1d767 tempest-ProjectMemberTests-2050864699 None] Deleted volume successfully. Nov 06 15:43:05 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-5942b0bf-588a-4110-a27d-a5b3abd1d767 tempest-ProjectMemberTests-2050864699 None] Lock "cinder-283eb92f-be95-43e7-a29e-7dc1801b7bca-delete_volume" released by "delete_volume" :: held 1.061s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:43:08 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 15:43:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:43:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:43:08 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:43:08 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:43:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:43:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:43:08 devstack sudo[109046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:43:08 devstack sudo[109046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:43:08 devstack sudo[109046]: pam_unix(sudo:session): session closed for user root Nov 06 15:43:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.270s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:43:08 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:43:08 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Running periodic task VolumeManager._thread_info {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 15:43:08 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] thread count: 28 {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 15:43:08 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] thread info: [<_MainThread(MainThread, started 140011251929216)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 06 15:43:14 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:SELECT=9,cinder:INSERT=3,cinder:UPDATE=15 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 15:43:15 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:DELETE=2,cinder:SELECT=10,cinder:INSERT=5,cinder:UPDATE=12 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 15:43:25 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-117cb8f8-9690-4254-9048-886f7050b0f5 tempest-SnapshotDependencyTests-350062247 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:43:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-117cb8f8-9690-4254-9048-886f7050b0f5 tempest-SnapshotDependencyTests-350062247 None] Flow 'volume_create_manager' (298267e0-58b4-4c40-a7f8-284db25cbf6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:43:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-117cb8f8-9690-4254-9048-886f7050b0f5 tempest-SnapshotDependencyTests-350062247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f9c26ba-8ddc-44ed-9aa9-41857924ecd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:43:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-117cb8f8-9690-4254-9048-886f7050b0f5 tempest-SnapshotDependencyTests-350062247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f9c26ba-8ddc-44ed-9aa9-41857924ecd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:43:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-409740601',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a90e7e3c-1413-4174-b41a-48e94c820eef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='189e075f4c4d46e5bd37f9f4d7fe4516',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:43:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:43:25Z,use_quota=True,user_id='217a7de28ce3402b9c7108758b1b9b06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:43:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-117cb8f8-9690-4254-9048-886f7050b0f5 tempest-SnapshotDependencyTests-350062247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd606825-8d6b-4051-a124-03bfd7d72249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:43:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-117cb8f8-9690-4254-9048-886f7050b0f5 tempest-SnapshotDependencyTests-350062247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd606825-8d6b-4051-a124-03bfd7d72249) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:43:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-117cb8f8-9690-4254-9048-886f7050b0f5 tempest-SnapshotDependencyTests-350062247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cef9e3e-8c34-4d6a-bbd5-3256ef48351b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:43:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-117cb8f8-9690-4254-9048-886f7050b0f5 tempest-SnapshotDependencyTests-350062247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cef9e3e-8c34-4d6a-bbd5-3256ef48351b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a90e7e3c-1413-4174-b41a-48e94c820eef', 'volume_name': 'volume-a90e7e3c-1413-4174-b41a-48e94c820eef', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:43:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-117cb8f8-9690-4254-9048-886f7050b0f5 tempest-SnapshotDependencyTests-350062247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7642cbd3-c511-4695-85a8-80101181b6ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:43:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-117cb8f8-9690-4254-9048-886f7050b0f5 tempest-SnapshotDependencyTests-350062247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7642cbd3-c511-4695-85a8-80101181b6ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:43:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-117cb8f8-9690-4254-9048-886f7050b0f5 tempest-SnapshotDependencyTests-350062247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8c629a0-4af0-4fb1-ace6-caacdf617701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:43:25 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-117cb8f8-9690-4254-9048-886f7050b0f5 tempest-SnapshotDependencyTests-350062247 None] Volume a90e7e3c-1413-4174-b41a-48e94c820eef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a90e7e3c-1413-4174-b41a-48e94c820eef', 'volume_size': 1} Nov 06 15:43:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-117cb8f8-9690-4254-9048-886f7050b0f5 tempest-SnapshotDependencyTests-350062247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:43:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-117cb8f8-9690-4254-9048-886f7050b0f5 tempest-SnapshotDependencyTests-350062247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:43:25 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-117cb8f8-9690-4254-9048-886f7050b0f5 tempest-SnapshotDependencyTests-350062247 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:43:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-409740601',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a90e7e3c-1413-4174-b41a-48e94c820eef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='189e075f4c4d46e5bd37f9f4d7fe4516',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:43:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:43:25Z,use_quota=True,user_id='217a7de28ce3402b9c7108758b1b9b06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 15:43:25 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-117cb8f8-9690-4254-9048-886f7050b0f5 tempest-SnapshotDependencyTests-350062247 None] Creating volume a90e7e3c-1413-4174-b41a-48e94c820eef {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 15:43:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-117cb8f8-9690-4254-9048-886f7050b0f5 tempest-SnapshotDependencyTests-350062247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:43:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-117cb8f8-9690-4254-9048-886f7050b0f5 tempest-SnapshotDependencyTests-350062247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:43:25 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-117cb8f8-9690-4254-9048-886f7050b0f5 tempest-SnapshotDependencyTests-350062247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:43:25 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-117cb8f8-9690-4254-9048-886f7050b0f5 tempest-SnapshotDependencyTests-350062247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:43:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-117cb8f8-9690-4254-9048-886f7050b0f5 tempest-SnapshotDependencyTests-350062247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:43:25 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-117cb8f8-9690-4254-9048-886f7050b0f5 tempest-SnapshotDependencyTests-350062247 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:43:25 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-117cb8f8-9690-4254-9048-886f7050b0f5 tempest-SnapshotDependencyTests-350062247 None] casted to osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b Nov 06 15:43:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-117cb8f8-9690-4254-9048-886f7050b0f5 tempest-SnapshotDependencyTests-350062247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a90e7e3c-1413-4174-b41a-48e94c820eef 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:43:25 devstack sudo[109054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a90e7e3c-1413-4174-b41a-48e94c820eef 1073741824 Nov 06 15:43:25 devstack sudo[109054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:43:25 devstack sudo[109054]: pam_unix(sudo:session): session closed for user root Nov 06 15:43:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-117cb8f8-9690-4254-9048-886f7050b0f5 tempest-SnapshotDependencyTests-350062247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a90e7e3c-1413-4174-b41a-48e94c820eef 1073741824" returned: 0 in 0.399s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:43:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-117cb8f8-9690-4254-9048-886f7050b0f5 tempest-SnapshotDependencyTests-350062247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a90e7e3c-1413-4174-b41a-48e94c820eef {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:43:25 devstack sudo[109060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a90e7e3c-1413-4174-b41a-48e94c820eef Nov 06 15:43:25 devstack sudo[109060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:43:26 devstack sudo[109060]: pam_unix(sudo:session): session closed for user root Nov 06 15:43:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-117cb8f8-9690-4254-9048-886f7050b0f5 tempest-SnapshotDependencyTests-350062247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a90e7e3c-1413-4174-b41a-48e94c820eef" returned: 0 in 0.242s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:43:26 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-117cb8f8-9690-4254-9048-886f7050b0f5 tempest-SnapshotDependencyTests-350062247 None] <== create_volume: return (683ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 15:43:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-117cb8f8-9690-4254-9048-886f7050b0f5 tempest-SnapshotDependencyTests-350062247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.686s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:43:26 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-117cb8f8-9690-4254-9048-886f7050b0f5 tempest-SnapshotDependencyTests-350062247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8c629a0-4af0-4fb1-ace6-caacdf617701) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a90e7e3c-1413-4174-b41a-48e94c820eef', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:43:26 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-117cb8f8-9690-4254-9048-886f7050b0f5 tempest-SnapshotDependencyTests-350062247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4879e00a-004d-486c-9fb7-a734472ae0de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:43:26 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-117cb8f8-9690-4254-9048-886f7050b0f5 tempest-SnapshotDependencyTests-350062247 None] Volume volume-a90e7e3c-1413-4174-b41a-48e94c820eef (a90e7e3c-1413-4174-b41a-48e94c820eef): created successfully Nov 06 15:43:26 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-117cb8f8-9690-4254-9048-886f7050b0f5 tempest-SnapshotDependencyTests-350062247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4879e00a-004d-486c-9fb7-a734472ae0de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:43:26 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-117cb8f8-9690-4254-9048-886f7050b0f5 tempest-SnapshotDependencyTests-350062247 None] Flow 'volume_create_manager' (298267e0-58b4-4c40-a7f8-284db25cbf6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:43:26 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-117cb8f8-9690-4254-9048-886f7050b0f5 tempest-SnapshotDependencyTests-350062247 None] Created volume successfully. Nov 06 15:43:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6e92299a-2572-409c-b1a0-e897d2e8a094 tempest-SnapshotDependencyTests-350062247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:43:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6e92299a-2572-409c-b1a0-e897d2e8a094 tempest-SnapshotDependencyTests-350062247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:43:26 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-6e92299a-2572-409c-b1a0-e897d2e8a094 tempest-SnapshotDependencyTests-350062247 None] Creating offline snapshot a7d623cb-7296-4b34-98d1-49afe33be9c5 of volume a90e7e3c-1413-4174-b41a-48e94c820eef {{(pid=87132) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 15:43:26 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[96ca7762-1ff5-4746-b687-320e6d2ca7f3]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:43:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6e92299a-2572-409c-b1a0-e897d2e8a094 tempest-SnapshotDependencyTests-350062247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a90e7e3c-1413-4174-b41a-48e94c820eef {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:43:26 devstack sudo[109063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a90e7e3c-1413-4174-b41a-48e94c820eef Nov 06 15:43:26 devstack sudo[109063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:43:26 devstack sudo[109063]: pam_unix(sudo:session): session closed for user root Nov 06 15:43:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6e92299a-2572-409c-b1a0-e897d2e8a094 tempest-SnapshotDependencyTests-350062247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a90e7e3c-1413-4174-b41a-48e94c820eef" returned: 0 in 0.353s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:43:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6e92299a-2572-409c-b1a0-e897d2e8a094 tempest-SnapshotDependencyTests-350062247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a90e7e3c-1413-4174-b41a-48e94c820eef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a90e7e3c-1413-4174-b41a-48e94c820eef.a7d623cb-7296-4b34-98d1-49afe33be9c5 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:43:27 devstack sudo[109068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a90e7e3c-1413-4174-b41a-48e94c820eef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a90e7e3c-1413-4174-b41a-48e94c820eef.a7d623cb-7296-4b34-98d1-49afe33be9c5 1G Nov 06 15:43:27 devstack sudo[109068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:43:27 devstack sudo[109068]: pam_unix(sudo:session): session closed for user root Nov 06 15:43:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6e92299a-2572-409c-b1a0-e897d2e8a094 tempest-SnapshotDependencyTests-350062247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a90e7e3c-1413-4174-b41a-48e94c820eef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a90e7e3c-1413-4174-b41a-48e94c820eef.a7d623cb-7296-4b34-98d1-49afe33be9c5 1G" returned: 0 in 0.379s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:43:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6e92299a-2572-409c-b1a0-e897d2e8a094 tempest-SnapshotDependencyTests-350062247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a90e7e3c-1413-4174-b41a-48e94c820eef -F qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a90e7e3c-1413-4174-b41a-48e94c820eef.a7d623cb-7296-4b34-98d1-49afe33be9c5 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:43:27 devstack sudo[109074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a90e7e3c-1413-4174-b41a-48e94c820eef -F qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a90e7e3c-1413-4174-b41a-48e94c820eef.a7d623cb-7296-4b34-98d1-49afe33be9c5 Nov 06 15:43:27 devstack sudo[109074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:43:27 devstack sudo[109074]: pam_unix(sudo:session): session closed for user root Nov 06 15:43:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6e92299a-2572-409c-b1a0-e897d2e8a094 tempest-SnapshotDependencyTests-350062247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a90e7e3c-1413-4174-b41a-48e94c820eef -F qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a90e7e3c-1413-4174-b41a-48e94c820eef.a7d623cb-7296-4b34-98d1-49afe33be9c5" returned: 0 in 0.293s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:43:27 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-6e92299a-2572-409c-b1a0-e897d2e8a094 tempest-SnapshotDependencyTests-350062247 None] /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a90e7e3c-1413-4174-b41a-48e94c820eef.a7d623cb-7296-4b34-98d1-49afe33be9c5 is being set with open permissions: ugo+rw Nov 06 15:43:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6e92299a-2572-409c-b1a0-e897d2e8a094 tempest-SnapshotDependencyTests-350062247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a90e7e3c-1413-4174-b41a-48e94c820eef.a7d623cb-7296-4b34-98d1-49afe33be9c5 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:43:27 devstack sudo[109079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a90e7e3c-1413-4174-b41a-48e94c820eef.a7d623cb-7296-4b34-98d1-49afe33be9c5 Nov 06 15:43:27 devstack sudo[109079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:43:27 devstack sudo[109079]: pam_unix(sudo:session): session closed for user root Nov 06 15:43:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6e92299a-2572-409c-b1a0-e897d2e8a094 tempest-SnapshotDependencyTests-350062247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a90e7e3c-1413-4174-b41a-48e94c820eef.a7d623cb-7296-4b34-98d1-49afe33be9c5" returned: 0 in 0.236s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:43:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6e92299a-2572-409c-b1a0-e897d2e8a094 tempest-SnapshotDependencyTests-350062247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a90e7e3c-1413-4174-b41a-48e94c820eef.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:43:27 devstack sudo[109082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a90e7e3c-1413-4174-b41a-48e94c820eef.info Nov 06 15:43:27 devstack sudo[109082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:43:28 devstack sudo[109082]: pam_unix(sudo:session): session closed for user root Nov 06 15:43:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6e92299a-2572-409c-b1a0-e897d2e8a094 tempest-SnapshotDependencyTests-350062247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a90e7e3c-1413-4174-b41a-48e94c820eef.info" returned: 0 in 0.246s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:43:28 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-6e92299a-2572-409c-b1a0-e897d2e8a094 tempest-SnapshotDependencyTests-350062247 None] /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a90e7e3c-1413-4174-b41a-48e94c820eef.info is being set with open permissions: ugo+rw Nov 06 15:43:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6e92299a-2572-409c-b1a0-e897d2e8a094 tempest-SnapshotDependencyTests-350062247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a90e7e3c-1413-4174-b41a-48e94c820eef.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:43:28 devstack sudo[109085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a90e7e3c-1413-4174-b41a-48e94c820eef.info Nov 06 15:43:28 devstack sudo[109085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:43:28 devstack sudo[109085]: pam_unix(sudo:session): session closed for user root Nov 06 15:43:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6e92299a-2572-409c-b1a0-e897d2e8a094 tempest-SnapshotDependencyTests-350062247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a90e7e3c-1413-4174-b41a-48e94c820eef.info" returned: 0 in 0.234s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:43:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6e92299a-2572-409c-b1a0-e897d2e8a094 tempest-SnapshotDependencyTests-350062247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.823s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:43:28 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-6e92299a-2572-409c-b1a0-e897d2e8a094 tempest-SnapshotDependencyTests-350062247 None] Create snapshot completed successfully Nov 06 15:43:29 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-4619192a-5965-43d4-9e98-ed558d5b9103 tempest-SnapshotDependencyTests-350062247 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 15:43:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4619192a-5965-43d4-9e98-ed558d5b9103 tempest-SnapshotDependencyTests-350062247 None] Flow 'volume_create_manager' (3285b1b4-1e57-4cef-9c3f-b804d9c43823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:43:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4619192a-5965-43d4-9e98-ed558d5b9103 tempest-SnapshotDependencyTests-350062247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (044e87c7-7aa3-4d2d-b261-af99c4bab6f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:43:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4619192a-5965-43d4-9e98-ed558d5b9103 tempest-SnapshotDependencyTests-350062247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (044e87c7-7aa3-4d2d-b261-af99c4bab6f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T14:43:29Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b1fd022-65db-4790-88c3-4f8e97a16df7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='189e075f4c4d46e5bd37f9f4d7fe4516',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T14:43:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a7d623cb-7296-4b34-98d1-49afe33be9c5,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T14:43:29Z,use_quota=True,user_id='217a7de28ce3402b9c7108758b1b9b06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b529ef1-f801-4fef-bd21-5c6ae24785f1),volume_type_id=8b529ef1-f801-4fef-bd21-5c6ae24785f1)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:43:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4619192a-5965-43d4-9e98-ed558d5b9103 tempest-SnapshotDependencyTests-350062247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e96393fe-ed8e-4398-96ee-55fd27ed587f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:43:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4619192a-5965-43d4-9e98-ed558d5b9103 tempest-SnapshotDependencyTests-350062247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e96393fe-ed8e-4398-96ee-55fd27ed587f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:43:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4619192a-5965-43d4-9e98-ed558d5b9103 tempest-SnapshotDependencyTests-350062247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6844e3fd-8a77-4b79-adcf-f145b396a26d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:43:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4619192a-5965-43d4-9e98-ed558d5b9103 tempest-SnapshotDependencyTests-350062247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6844e3fd-8a77-4b79-adcf-f145b396a26d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6b1fd022-65db-4790-88c3-4f8e97a16df7', 'volume_name': 'volume-6b1fd022-65db-4790-88c3-4f8e97a16df7', 'volume_size': 1, 'snapshot_id': 'a7d623cb-7296-4b34-98d1-49afe33be9c5'}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:43:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4619192a-5965-43d4-9e98-ed558d5b9103 tempest-SnapshotDependencyTests-350062247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e1c191b-0b7e-4132-9fa0-bd6c324a26d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:43:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4619192a-5965-43d4-9e98-ed558d5b9103 tempest-SnapshotDependencyTests-350062247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e1c191b-0b7e-4132-9fa0-bd6c324a26d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:43:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4619192a-5965-43d4-9e98-ed558d5b9103 tempest-SnapshotDependencyTests-350062247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db2601d6-4deb-4d5d-bf0e-6b070390639b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:43:29 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-4619192a-5965-43d4-9e98-ed558d5b9103 tempest-SnapshotDependencyTests-350062247 None] Volume 6b1fd022-65db-4790-88c3-4f8e97a16df7: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6b1fd022-65db-4790-88c3-4f8e97a16df7', 'volume_size': 1, 'snapshot_id': 'a7d623cb-7296-4b34-98d1-49afe33be9c5'} Nov 06 15:43:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4619192a-5965-43d4-9e98-ed558d5b9103 tempest-SnapshotDependencyTests-350062247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:43:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4619192a-5965-43d4-9e98-ed558d5b9103 tempest-SnapshotDependencyTests-350062247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:43:29 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-4619192a-5965-43d4-9e98-ed558d5b9103 tempest-SnapshotDependencyTests-350062247 None] Acquiring lock "cinder-quobyte-a7d623cb-7296-4b34-98d1-49afe33be9c5-6b1fd022-65db-4790-88c3-4f8e97a16df7" by "_create_volume_from_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:43:29 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-4619192a-5965-43d4-9e98-ed558d5b9103 tempest-SnapshotDependencyTests-350062247 None] Lock "cinder-quobyte-a7d623cb-7296-4b34-98d1-49afe33be9c5-6b1fd022-65db-4790-88c3-4f8e97a16df7" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:43:29 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-4619192a-5965-43d4-9e98-ed558d5b9103 tempest-SnapshotDependencyTests-350062247 None] Creating volume 6b1fd022-65db-4790-88c3-4f8e97a16df7 from snapshot a7d623cb-7296-4b34-98d1-49afe33be9c5 {{(pid=87132) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 06 15:43:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4619192a-5965-43d4-9e98-ed558d5b9103 tempest-SnapshotDependencyTests-350062247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:43:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4619192a-5965-43d4-9e98-ed558d5b9103 tempest-SnapshotDependencyTests-350062247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:43:29 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-4619192a-5965-43d4-9e98-ed558d5b9103 tempest-SnapshotDependencyTests-350062247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:43:29 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-4619192a-5965-43d4-9e98-ed558d5b9103 tempest-SnapshotDependencyTests-350062247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:43:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4619192a-5965-43d4-9e98-ed558d5b9103 tempest-SnapshotDependencyTests-350062247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:43:29 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-4619192a-5965-43d4-9e98-ed558d5b9103 tempest-SnapshotDependencyTests-350062247 None] Selected osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 15:43:29 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-4619192a-5965-43d4-9e98-ed558d5b9103 tempest-SnapshotDependencyTests-350062247 None] Acquiring lock "cinder-quobyte-6b1fd022-65db-4790-88c3-4f8e97a16df7" by "_copy_volume_from_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:43:29 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-4619192a-5965-43d4-9e98-ed558d5b9103 tempest-SnapshotDependencyTests-350062247 None] Lock "cinder-quobyte-6b1fd022-65db-4790-88c3-4f8e97a16df7" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:43:29 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-4619192a-5965-43d4-9e98-ed558d5b9103 tempest-SnapshotDependencyTests-350062247 None] snapshot: a7d623cb-7296-4b34-98d1-49afe33be9c5, volume: 6b1fd022-65db-4790-88c3-4f8e97a16df7, {{(pid=87132) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 06 15:43:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4619192a-5965-43d4-9e98-ed558d5b9103 tempest-SnapshotDependencyTests-350062247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:43:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4619192a-5965-43d4-9e98-ed558d5b9103 tempest-SnapshotDependencyTests-350062247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:43:29 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-4619192a-5965-43d4-9e98-ed558d5b9103 tempest-SnapshotDependencyTests-350062247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:43:29 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-4619192a-5965-43d4-9e98-ed558d5b9103 tempest-SnapshotDependencyTests-350062247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:43:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4619192a-5965-43d4-9e98-ed558d5b9103 tempest-SnapshotDependencyTests-350062247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:43:29 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[72928c66-98e2-4924-912d-4974efb47c9a]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:43:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4619192a-5965-43d4-9e98-ed558d5b9103 tempest-SnapshotDependencyTests-350062247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a90e7e3c-1413-4174-b41a-48e94c820eef.a7d623cb-7296-4b34-98d1-49afe33be9c5 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:43:29 devstack sudo[109088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a90e7e3c-1413-4174-b41a-48e94c820eef.a7d623cb-7296-4b34-98d1-49afe33be9c5 Nov 06 15:43:29 devstack sudo[109088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:43:29 devstack sudo[109088]: pam_unix(sudo:session): session closed for user root Nov 06 15:43:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4619192a-5965-43d4-9e98-ed558d5b9103 tempest-SnapshotDependencyTests-350062247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a90e7e3c-1413-4174-b41a-48e94c820eef.a7d623cb-7296-4b34-98d1-49afe33be9c5" returned: 0 in 0.347s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:43:29 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-4619192a-5965-43d4-9e98-ed558d5b9103 tempest-SnapshotDependencyTests-350062247 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a90e7e3c-1413-4174-b41a-48e94c820eef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 15:43:29 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[76feb5b1-e66d-4086-8cf2-2004948218f6]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:43:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4619192a-5965-43d4-9e98-ed558d5b9103 tempest-SnapshotDependencyTests-350062247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a90e7e3c-1413-4174-b41a-48e94c820eef {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:43:29 devstack sudo[109093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a90e7e3c-1413-4174-b41a-48e94c820eef Nov 06 15:43:29 devstack sudo[109093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:43:30 devstack sudo[109093]: pam_unix(sudo:session): session closed for user root Nov 06 15:43:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4619192a-5965-43d4-9e98-ed558d5b9103 tempest-SnapshotDependencyTests-350062247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a90e7e3c-1413-4174-b41a-48e94c820eef" returned: 0 in 0.350s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:43:30 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-4619192a-5965-43d4-9e98-ed558d5b9103 tempest-SnapshotDependencyTests-350062247 None] will copy from snapshot at /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a90e7e3c-1413-4174-b41a-48e94c820eef {{(pid=87132) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 06 15:43:30 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-4619192a-5965-43d4-9e98-ed558d5b9103 tempest-SnapshotDependencyTests-350062247 None] Creating direct copy from snapshot {{(pid=87132) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 06 15:43:30 devstack cinder-volume[87132]: DEBUG cinder.utils [None req-4619192a-5965-43d4-9e98-ed558d5b9103 tempest-SnapshotDependencyTests-350062247 None] Path /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-6b1fd022-65db-4790-88c3-4f8e97a16df7 not found in is_blk_device check {{(pid=87132) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 06 15:43:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4619192a-5965-43d4-9e98-ed558d5b9103 tempest-SnapshotDependencyTests-350062247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a90e7e3c-1413-4174-b41a-48e94c820eef /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-6b1fd022-65db-4790-88c3-4f8e97a16df7 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:43:30 devstack sudo[109099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a90e7e3c-1413-4174-b41a-48e94c820eef /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-6b1fd022-65db-4790-88c3-4f8e97a16df7 Nov 06 15:43:30 devstack sudo[109099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:43:36 devstack sudo[109099]: pam_unix(sudo:session): session closed for user root Nov 06 15:43:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4619192a-5965-43d4-9e98-ed558d5b9103 tempest-SnapshotDependencyTests-350062247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a90e7e3c-1413-4174-b41a-48e94c820eef /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-6b1fd022-65db-4790-88c3-4f8e97a16df7" returned: 0 in 5.931s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:43:36 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-4619192a-5965-43d4-9e98-ed558d5b9103 tempest-SnapshotDependencyTests-350062247 None] Image conversion details: src /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a90e7e3c-1413-4174-b41a-48e94c820eef, size 1024.00 MB, duration 5.93 sec, destination /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-6b1fd022-65db-4790-88c3-4f8e97a16df7 {{(pid=87132) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 06 15:43:36 devstack cinder-volume[87132]: INFO cinder.image.image_utils [None req-4619192a-5965-43d4-9e98-ed558d5b9103 tempest-SnapshotDependencyTests-350062247 None] Converted 1024.00 MB image at 172.62 MB/s Nov 06 15:43:36 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-4619192a-5965-43d4-9e98-ed558d5b9103 tempest-SnapshotDependencyTests-350062247 None] /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-6b1fd022-65db-4790-88c3-4f8e97a16df7 is being set with open permissions: ugo+rw Nov 06 15:43:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4619192a-5965-43d4-9e98-ed558d5b9103 tempest-SnapshotDependencyTests-350062247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-6b1fd022-65db-4790-88c3-4f8e97a16df7 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:43:36 devstack sudo[109113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-6b1fd022-65db-4790-88c3-4f8e97a16df7 Nov 06 15:43:36 devstack sudo[109113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:43:36 devstack sudo[109113]: pam_unix(sudo:session): session closed for user root Nov 06 15:43:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4619192a-5965-43d4-9e98-ed558d5b9103 tempest-SnapshotDependencyTests-350062247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-6b1fd022-65db-4790-88c3-4f8e97a16df7" returned: 0 in 0.252s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:43:36 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-4619192a-5965-43d4-9e98-ed558d5b9103 tempest-SnapshotDependencyTests-350062247 None] Lock "cinder-quobyte-6b1fd022-65db-4790-88c3-4f8e97a16df7" released by "_copy_volume_from_snapshot" :: held 6.958s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:43:36 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-4619192a-5965-43d4-9e98-ed558d5b9103 tempest-SnapshotDependencyTests-350062247 None] Lock "cinder-quobyte-a7d623cb-7296-4b34-98d1-49afe33be9c5-6b1fd022-65db-4790-88c3-4f8e97a16df7" released by "_create_volume_from_snapshot" :: held 7.031s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:43:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4619192a-5965-43d4-9e98-ed558d5b9103 tempest-SnapshotDependencyTests-350062247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.046s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:43:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4619192a-5965-43d4-9e98-ed558d5b9103 tempest-SnapshotDependencyTests-350062247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db2601d6-4deb-4d5d-bf0e-6b070390639b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b1fd022-65db-4790-88c3-4f8e97a16df7', 'volume_size': 1, 'snapshot_id': 'a7d623cb-7296-4b34-98d1-49afe33be9c5'}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:43:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4619192a-5965-43d4-9e98-ed558d5b9103 tempest-SnapshotDependencyTests-350062247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d645cf6-e2a1-4852-8290-3801896dca67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 15:43:36 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-4619192a-5965-43d4-9e98-ed558d5b9103 tempest-SnapshotDependencyTests-350062247 None] Volume volume-6b1fd022-65db-4790-88c3-4f8e97a16df7 (6b1fd022-65db-4790-88c3-4f8e97a16df7): created successfully Nov 06 15:43:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4619192a-5965-43d4-9e98-ed558d5b9103 tempest-SnapshotDependencyTests-350062247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d645cf6-e2a1-4852-8290-3801896dca67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 15:43:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4619192a-5965-43d4-9e98-ed558d5b9103 tempest-SnapshotDependencyTests-350062247 None] Flow 'volume_create_manager' (3285b1b4-1e57-4cef-9c3f-b804d9c43823) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 15:43:36 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-4619192a-5965-43d4-9e98-ed558d5b9103 tempest-SnapshotDependencyTests-350062247 None] Created volume successfully. Nov 06 15:43:36 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-8f4f4620-439c-4d45-ae14-9908a671a3ed tempest-SnapshotDependencyTests-350062247 None] Acquiring lock "cinder-a7d623cb-7296-4b34-98d1-49afe33be9c5-delete_snapshot" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:43:36 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-8f4f4620-439c-4d45-ae14-9908a671a3ed tempest-SnapshotDependencyTests-350062247 None] Lock "cinder-a7d623cb-7296-4b34-98d1-49afe33be9c5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:43:36 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-8f4f4620-439c-4d45-ae14-9908a671a3ed tempest-SnapshotDependencyTests-350062247 None] Acquiring lock "cinder-quobyte-a90e7e3c-1413-4174-b41a-48e94c820eef" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:43:36 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-8f4f4620-439c-4d45-ae14-9908a671a3ed tempest-SnapshotDependencyTests-350062247 None] Lock "cinder-quobyte-a90e7e3c-1413-4174-b41a-48e94c820eef" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:43:36 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-8f4f4620-439c-4d45-ae14-9908a671a3ed tempest-SnapshotDependencyTests-350062247 None] Acquiring lock "cinder-quobyte-a7d623cb-7296-4b34-98d1-49afe33be9c5" by "_delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:43:36 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-8f4f4620-439c-4d45-ae14-9908a671a3ed tempest-SnapshotDependencyTests-350062247 None] Lock "cinder-quobyte-a7d623cb-7296-4b34-98d1-49afe33be9c5" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:43:36 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-8f4f4620-439c-4d45-ae14-9908a671a3ed tempest-SnapshotDependencyTests-350062247 None] Deleting offline snapshot a7d623cb-7296-4b34-98d1-49afe33be9c5 of volume a90e7e3c-1413-4174-b41a-48e94c820eef {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 15:43:36 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-8f4f4620-439c-4d45-ae14-9908a671a3ed tempest-SnapshotDependencyTests-350062247 None] snapshot_file for this snap is: volume-a90e7e3c-1413-4174-b41a-48e94c820eef.a7d623cb-7296-4b34-98d1-49afe33be9c5 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 15:43:36 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc8359fa-1800-4b3e-97dd-1b040f44708c]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:43:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8f4f4620-439c-4d45-ae14-9908a671a3ed tempest-SnapshotDependencyTests-350062247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a90e7e3c-1413-4174-b41a-48e94c820eef.a7d623cb-7296-4b34-98d1-49afe33be9c5 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:43:36 devstack sudo[109116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a90e7e3c-1413-4174-b41a-48e94c820eef.a7d623cb-7296-4b34-98d1-49afe33be9c5 Nov 06 15:43:36 devstack sudo[109116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:43:37 devstack sudo[109116]: pam_unix(sudo:session): session closed for user root Nov 06 15:43:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8f4f4620-439c-4d45-ae14-9908a671a3ed tempest-SnapshotDependencyTests-350062247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a90e7e3c-1413-4174-b41a-48e94c820eef.a7d623cb-7296-4b34-98d1-49afe33be9c5" returned: 0 in 0.362s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:43:37 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-8f4f4620-439c-4d45-ae14-9908a671a3ed tempest-SnapshotDependencyTests-350062247 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a90e7e3c-1413-4174-b41a-48e94c820eef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 15:43:37 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0cd92f3-45fb-46ef-a486-583394332db5]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:43:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8f4f4620-439c-4d45-ae14-9908a671a3ed tempest-SnapshotDependencyTests-350062247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a90e7e3c-1413-4174-b41a-48e94c820eef {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:43:37 devstack sudo[109121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a90e7e3c-1413-4174-b41a-48e94c820eef Nov 06 15:43:37 devstack sudo[109121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:43:37 devstack sudo[109121]: pam_unix(sudo:session): session closed for user root Nov 06 15:43:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8f4f4620-439c-4d45-ae14-9908a671a3ed tempest-SnapshotDependencyTests-350062247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a90e7e3c-1413-4174-b41a-48e94c820eef" returned: 0 in 0.515s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:43:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8f4f4620-439c-4d45-ae14-9908a671a3ed tempest-SnapshotDependencyTests-350062247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a90e7e3c-1413-4174-b41a-48e94c820eef.a7d623cb-7296-4b34-98d1-49afe33be9c5 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:43:37 devstack sudo[109126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a90e7e3c-1413-4174-b41a-48e94c820eef.a7d623cb-7296-4b34-98d1-49afe33be9c5 Nov 06 15:43:37 devstack sudo[109126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:43:38 devstack sudo[109126]: pam_unix(sudo:session): session closed for user root Nov 06 15:43:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8f4f4620-439c-4d45-ae14-9908a671a3ed tempest-SnapshotDependencyTests-350062247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a90e7e3c-1413-4174-b41a-48e94c820eef.a7d623cb-7296-4b34-98d1-49afe33be9c5" returned: 0 in 0.324s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:43:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8f4f4620-439c-4d45-ae14-9908a671a3ed tempest-SnapshotDependencyTests-350062247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a90e7e3c-1413-4174-b41a-48e94c820eef.a7d623cb-7296-4b34-98d1-49afe33be9c5 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:43:38 devstack sudo[109131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a90e7e3c-1413-4174-b41a-48e94c820eef.a7d623cb-7296-4b34-98d1-49afe33be9c5 Nov 06 15:43:38 devstack sudo[109131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:43:38 devstack sudo[109131]: pam_unix(sudo:session): session closed for user root Nov 06 15:43:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8f4f4620-439c-4d45-ae14-9908a671a3ed tempest-SnapshotDependencyTests-350062247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a90e7e3c-1413-4174-b41a-48e94c820eef.a7d623cb-7296-4b34-98d1-49afe33be9c5" returned: 0 in 0.244s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:43:38 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-8f4f4620-439c-4d45-ae14-9908a671a3ed tempest-SnapshotDependencyTests-350062247 None] Lock "cinder-quobyte-a7d623cb-7296-4b34-98d1-49afe33be9c5" released by "_delete_snapshot" :: held 1.537s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:43:38 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-8f4f4620-439c-4d45-ae14-9908a671a3ed tempest-SnapshotDependencyTests-350062247 None] Lock "cinder-quobyte-a90e7e3c-1413-4174-b41a-48e94c820eef" released by "delete_snapshot" :: held 1.556s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:43:38 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-8f4f4620-439c-4d45-ae14-9908a671a3ed tempest-SnapshotDependencyTests-350062247 None] Created reservations ['f93541be-d47c-45c3-83b7-9ba4fac86732', 'b80d1997-6e73-4892-97fa-dc6c23c4c4f5', '1905ed7c-3b3f-4f51-8c3d-2d77e6ab94e2', 'f2ede3eb-e18e-46e9-b67e-2983faab4f04'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:43:38 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-8f4f4620-439c-4d45-ae14-9908a671a3ed tempest-SnapshotDependencyTests-350062247 None] Delete snapshot completed successfully. Nov 06 15:43:38 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-8f4f4620-439c-4d45-ae14-9908a671a3ed tempest-SnapshotDependencyTests-350062247 None] Lock "cinder-a7d623cb-7296-4b34-98d1-49afe33be9c5-delete_snapshot" released by "delete_snapshot" :: held 1.674s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:43:38 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-006eefe3-dccd-4c20-aaae-9bdb10497c3b tempest-SnapshotDependencyTests-350062247 None] Acquiring lock "cinder-a90e7e3c-1413-4174-b41a-48e94c820eef-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:43:38 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-006eefe3-dccd-4c20-aaae-9bdb10497c3b tempest-SnapshotDependencyTests-350062247 None] Lock "cinder-a90e7e3c-1413-4174-b41a-48e94c820eef-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:43:38 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-006eefe3-dccd-4c20-aaae-9bdb10497c3b tempest-SnapshotDependencyTests-350062247 None] Acquiring lock "cinder-quobyte-a90e7e3c-1413-4174-b41a-48e94c820eef" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:43:38 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-006eefe3-dccd-4c20-aaae-9bdb10497c3b tempest-SnapshotDependencyTests-350062247 None] Lock "cinder-quobyte-a90e7e3c-1413-4174-b41a-48e94c820eef" acquired by "delete_volume" :: waited 0.013s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:43:39 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd2a4d03-2eb6-4f55-ac78-7cda81917463]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:43:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-006eefe3-dccd-4c20-aaae-9bdb10497c3b tempest-SnapshotDependencyTests-350062247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a90e7e3c-1413-4174-b41a-48e94c820eef {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:43:39 devstack sudo[109134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a90e7e3c-1413-4174-b41a-48e94c820eef Nov 06 15:43:39 devstack sudo[109134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:43:39 devstack sudo[109134]: pam_unix(sudo:session): session closed for user root Nov 06 15:43:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-006eefe3-dccd-4c20-aaae-9bdb10497c3b tempest-SnapshotDependencyTests-350062247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a90e7e3c-1413-4174-b41a-48e94c820eef" returned: 0 in 0.349s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:43:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-006eefe3-dccd-4c20-aaae-9bdb10497c3b tempest-SnapshotDependencyTests-350062247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a90e7e3c-1413-4174-b41a-48e94c820eef {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:43:39 devstack sudo[109139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a90e7e3c-1413-4174-b41a-48e94c820eef Nov 06 15:43:39 devstack sudo[109139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:43:39 devstack sudo[109139]: pam_unix(sudo:session): session closed for user root Nov 06 15:43:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-006eefe3-dccd-4c20-aaae-9bdb10497c3b tempest-SnapshotDependencyTests-350062247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-a90e7e3c-1413-4174-b41a-48e94c820eef" returned: 0 in 0.244s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:43:39 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-006eefe3-dccd-4c20-aaae-9bdb10497c3b tempest-SnapshotDependencyTests-350062247 None] Lock "cinder-quobyte-a90e7e3c-1413-4174-b41a-48e94c820eef" released by "delete_volume" :: held 0.650s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:43:39 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-006eefe3-dccd-4c20-aaae-9bdb10497c3b tempest-SnapshotDependencyTests-350062247 None] Created reservations ['945315c9-d800-43d3-8c0f-368b85665701', '6ac0c749-b7db-4251-850d-fc747b3d5aec', '9df8baeb-4b9a-4a26-a8b4-c1f08f1b3c06', 'd6cfd8b8-3052-4321-a328-273ae54b91a4'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:43:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-006eefe3-dccd-4c20-aaae-9bdb10497c3b tempest-SnapshotDependencyTests-350062247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:43:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-006eefe3-dccd-4c20-aaae-9bdb10497c3b tempest-SnapshotDependencyTests-350062247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:43:39 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-006eefe3-dccd-4c20-aaae-9bdb10497c3b tempest-SnapshotDependencyTests-350062247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:43:39 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-006eefe3-dccd-4c20-aaae-9bdb10497c3b tempest-SnapshotDependencyTests-350062247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:43:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-006eefe3-dccd-4c20-aaae-9bdb10497c3b tempest-SnapshotDependencyTests-350062247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:43:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-006eefe3-dccd-4c20-aaae-9bdb10497c3b tempest-SnapshotDependencyTests-350062247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:43:39 devstack sudo[109142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:43:39 devstack sudo[109142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:43:39 devstack sudo[109142]: pam_unix(sudo:session): session closed for user root Nov 06 15:43:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-006eefe3-dccd-4c20-aaae-9bdb10497c3b tempest-SnapshotDependencyTests-350062247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.245s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:43:39 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-006eefe3-dccd-4c20-aaae-9bdb10497c3b tempest-SnapshotDependencyTests-350062247 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:43:40 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-006eefe3-dccd-4c20-aaae-9bdb10497c3b tempest-SnapshotDependencyTests-350062247 None] Deleted volume successfully. Nov 06 15:43:40 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-006eefe3-dccd-4c20-aaae-9bdb10497c3b tempest-SnapshotDependencyTests-350062247 None] Lock "cinder-a90e7e3c-1413-4174-b41a-48e94c820eef-delete_volume" released by "delete_volume" :: held 1.085s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:43:40 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-0db5576b-a2a0-4591-bb51-b90326d469dc tempest-SnapshotDependencyTests-350062247 None] Acquiring lock "cinder-6b1fd022-65db-4790-88c3-4f8e97a16df7-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:43:40 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-0db5576b-a2a0-4591-bb51-b90326d469dc tempest-SnapshotDependencyTests-350062247 None] Lock "cinder-6b1fd022-65db-4790-88c3-4f8e97a16df7-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:43:40 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-0db5576b-a2a0-4591-bb51-b90326d469dc tempest-SnapshotDependencyTests-350062247 None] Acquiring lock "cinder-quobyte-6b1fd022-65db-4790-88c3-4f8e97a16df7" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 15:43:40 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-0db5576b-a2a0-4591-bb51-b90326d469dc tempest-SnapshotDependencyTests-350062247 None] Lock "cinder-quobyte-6b1fd022-65db-4790-88c3-4f8e97a16df7" acquired by "delete_volume" :: waited 0.020s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 15:43:40 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[38596b0a-64f7-4c1a-ab65-604e72b487b7]: (4, 'qcow2') {{(pid=88924) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 15:43:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0db5576b-a2a0-4591-bb51-b90326d469dc tempest-SnapshotDependencyTests-350062247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-6b1fd022-65db-4790-88c3-4f8e97a16df7 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:43:40 devstack sudo[109145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-6b1fd022-65db-4790-88c3-4f8e97a16df7 Nov 06 15:43:40 devstack sudo[109145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:43:40 devstack sudo[109145]: pam_unix(sudo:session): session closed for user root Nov 06 15:43:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0db5576b-a2a0-4591-bb51-b90326d469dc tempest-SnapshotDependencyTests-350062247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-6b1fd022-65db-4790-88c3-4f8e97a16df7" returned: 0 in 0.358s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:43:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0db5576b-a2a0-4591-bb51-b90326d469dc tempest-SnapshotDependencyTests-350062247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-6b1fd022-65db-4790-88c3-4f8e97a16df7 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:43:40 devstack sudo[109150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-6b1fd022-65db-4790-88c3-4f8e97a16df7 Nov 06 15:43:40 devstack sudo[109150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:43:40 devstack sudo[109150]: pam_unix(sudo:session): session closed for user root Nov 06 15:43:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0db5576b-a2a0-4591-bb51-b90326d469dc tempest-SnapshotDependencyTests-350062247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239/volume-6b1fd022-65db-4790-88c3-4f8e97a16df7" returned: 0 in 0.239s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:43:40 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-0db5576b-a2a0-4591-bb51-b90326d469dc tempest-SnapshotDependencyTests-350062247 None] Lock "cinder-quobyte-6b1fd022-65db-4790-88c3-4f8e97a16df7" released by "delete_volume" :: held 0.637s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:43:40 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-0db5576b-a2a0-4591-bb51-b90326d469dc tempest-SnapshotDependencyTests-350062247 None] Created reservations ['900b643b-d298-4369-9d19-d5e9cd121230', 'a8b777da-edac-4eaf-b868-500b2766a4a0', '03a2b7e6-58fa-4d40-9c4d-0fed93f528fe', 'b08c8be7-cc97-4a86-9e23-b4cccbbc8196'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 15:43:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0db5576b-a2a0-4591-bb51-b90326d469dc tempest-SnapshotDependencyTests-350062247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:43:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0db5576b-a2a0-4591-bb51-b90326d469dc tempest-SnapshotDependencyTests-350062247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:43:40 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0db5576b-a2a0-4591-bb51-b90326d469dc tempest-SnapshotDependencyTests-350062247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:43:40 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0db5576b-a2a0-4591-bb51-b90326d469dc tempest-SnapshotDependencyTests-350062247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:43:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0db5576b-a2a0-4591-bb51-b90326d469dc tempest-SnapshotDependencyTests-350062247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:43:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0db5576b-a2a0-4591-bb51-b90326d469dc tempest-SnapshotDependencyTests-350062247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:43:40 devstack sudo[109153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:43:40 devstack sudo[109153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:43:41 devstack sudo[109153]: pam_unix(sudo:session): session closed for user root Nov 06 15:43:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0db5576b-a2a0-4591-bb51-b90326d469dc tempest-SnapshotDependencyTests-350062247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.248s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:43:41 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-0db5576b-a2a0-4591-bb51-b90326d469dc tempest-SnapshotDependencyTests-350062247 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:43:41 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-0db5576b-a2a0-4591-bb51-b90326d469dc tempest-SnapshotDependencyTests-350062247 None] Deleted volume successfully. Nov 06 15:43:41 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-0db5576b-a2a0-4591-bb51-b90326d469dc tempest-SnapshotDependencyTests-350062247 None] Lock "cinder-6b1fd022-65db-4790-88c3-4f8e97a16df7-delete_volume" released by "delete_volume" :: held 1.081s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 15:43:50 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:UPDATE=29,cinder:SELECT=24,cinder:INSERT=8 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 15:43:51 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:SELECT=25,cinder:INSERT=7,cinder:UPDATE=29,cinder:DELETE=5 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 15:44:08 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 15:44:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 15:44:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 15:44:08 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 15:44:08 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d8cf1765-e853-4ba1-a189-d081172c2b4b'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 15:44:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 15:44:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 15:44:08 devstack sudo[109358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239 Nov 06 15:44:08 devstack sudo[109358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 15:44:08 devstack sudo[109358]: pam_unix(sudo:session): session closed for user root Nov 06 15:44:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dce4ca1db0e2a0d2d4e4259e2c8f9239" returned: 0 in 0.256s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 15:44:08 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 15:44:08 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] Running periodic task VolumeManager._thread_info {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 15:44:08 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] thread count: 28 {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 15:44:08 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-35cae7a2-fa5f-4ad8-8769-1dc241aef338 None None] thread info: [<_MainThread(MainThread, started 140011251929216)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}